00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2417 00:00:00.001 originally caused by: 00:00:00.002 Started by upstream project "nightly-trigger" build number 3678 00:00:00.002 originally caused by: 00:00:00.002 Started by timer 00:00:00.002 Started by timer 00:00:00.144 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.145 The recommended git tool is: git 00:00:00.145 using credential 00000000-0000-0000-0000-000000000002 00:00:00.160 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.213 Fetching changes from the remote Git repository 00:00:00.215 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.262 Using shallow fetch with depth 1 00:00:00.262 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.262 > git --version # timeout=10 00:00:00.292 > git --version # 'git version 2.39.2' 00:00:00.292 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.313 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.313 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:07.905 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:07.916 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:07.926 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:07.926 > git config core.sparsecheckout # timeout=10 00:00:07.937 > git read-tree -mu HEAD # timeout=10 00:00:07.953 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:07.981 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:07.981 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:08.087 [Pipeline] Start of Pipeline 00:00:08.102 [Pipeline] library 00:00:08.104 Loading library shm_lib@master 00:00:08.104 Library shm_lib@master is cached. Copying from home. 00:00:08.118 [Pipeline] node 00:00:08.126 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:08.128 [Pipeline] { 00:00:08.137 [Pipeline] catchError 00:00:08.139 [Pipeline] { 00:00:08.156 [Pipeline] wrap 00:00:08.166 [Pipeline] { 00:00:08.174 [Pipeline] stage 00:00:08.176 [Pipeline] { (Prologue) 00:00:08.411 [Pipeline] sh 00:00:08.697 + logger -p user.info -t JENKINS-CI 00:00:08.717 [Pipeline] echo 00:00:08.719 Node: GP11 00:00:08.727 [Pipeline] sh 00:00:09.031 [Pipeline] setCustomBuildProperty 00:00:09.045 [Pipeline] echo 00:00:09.047 Cleanup processes 00:00:09.053 [Pipeline] sh 00:00:09.340 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:09.340 4021839 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:09.352 [Pipeline] sh 00:00:09.635 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:09.635 ++ grep -v 'sudo pgrep' 00:00:09.636 ++ awk '{print $1}' 00:00:09.636 + sudo kill -9 00:00:09.636 + true 00:00:09.651 [Pipeline] cleanWs 00:00:09.661 [WS-CLEANUP] Deleting project workspace... 00:00:09.661 [WS-CLEANUP] Deferred wipeout is used... 00:00:09.667 [WS-CLEANUP] done 00:00:09.672 [Pipeline] setCustomBuildProperty 00:00:09.689 [Pipeline] sh 00:00:09.974 + sudo git config --global --replace-all safe.directory '*' 00:00:10.081 [Pipeline] httpRequest 00:00:11.269 [Pipeline] echo 00:00:11.271 Sorcerer 10.211.164.20 is alive 00:00:11.279 [Pipeline] retry 00:00:11.282 [Pipeline] { 00:00:11.294 [Pipeline] httpRequest 00:00:11.298 HttpMethod: GET 00:00:11.299 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:11.299 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:11.324 Response Code: HTTP/1.1 200 OK 00:00:11.325 Success: Status code 200 is in the accepted range: 200,404 00:00:11.325 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:28.881 [Pipeline] } 00:00:28.898 [Pipeline] // retry 00:00:28.906 [Pipeline] sh 00:00:29.192 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:29.209 [Pipeline] httpRequest 00:00:30.731 [Pipeline] echo 00:00:30.735 Sorcerer 10.211.164.20 is alive 00:00:30.746 [Pipeline] retry 00:00:30.748 [Pipeline] { 00:00:30.762 [Pipeline] httpRequest 00:00:30.767 HttpMethod: GET 00:00:30.768 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:30.768 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:30.781 Response Code: HTTP/1.1 200 OK 00:00:30.781 Success: Status code 200 is in the accepted range: 200,404 00:00:30.781 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:10.988 [Pipeline] } 00:01:11.006 [Pipeline] // retry 00:01:11.014 [Pipeline] sh 00:01:11.308 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:14.626 [Pipeline] sh 00:01:14.916 + git -C spdk log --oneline -n5 00:01:14.916 c13c99a5e test: Various fixes for Fedora40 00:01:14.916 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:14.916 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:14.916 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:14.916 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:14.930 [Pipeline] } 00:01:14.944 [Pipeline] // stage 00:01:14.953 [Pipeline] stage 00:01:14.956 [Pipeline] { (Prepare) 00:01:14.973 [Pipeline] writeFile 00:01:14.989 [Pipeline] sh 00:01:15.279 + logger -p user.info -t JENKINS-CI 00:01:15.295 [Pipeline] sh 00:01:15.642 + logger -p user.info -t JENKINS-CI 00:01:15.656 [Pipeline] sh 00:01:15.944 + cat autorun-spdk.conf 00:01:15.944 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:15.944 SPDK_TEST_NVMF=1 00:01:15.944 SPDK_TEST_NVME_CLI=1 00:01:15.944 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:15.944 SPDK_TEST_NVMF_NICS=e810 00:01:15.944 SPDK_RUN_UBSAN=1 00:01:15.944 NET_TYPE=phy 00:01:15.953 RUN_NIGHTLY=1 00:01:15.958 [Pipeline] readFile 00:01:15.984 [Pipeline] withEnv 00:01:15.986 [Pipeline] { 00:01:15.999 [Pipeline] sh 00:01:16.289 + set -ex 00:01:16.289 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:16.289 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:16.289 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:16.289 ++ SPDK_TEST_NVMF=1 00:01:16.289 ++ SPDK_TEST_NVME_CLI=1 00:01:16.289 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:16.289 ++ SPDK_TEST_NVMF_NICS=e810 00:01:16.289 ++ SPDK_RUN_UBSAN=1 00:01:16.289 ++ NET_TYPE=phy 00:01:16.289 ++ RUN_NIGHTLY=1 00:01:16.289 + case $SPDK_TEST_NVMF_NICS in 00:01:16.289 + DRIVERS=ice 00:01:16.289 + [[ tcp == \r\d\m\a ]] 00:01:16.289 + [[ -n ice ]] 00:01:16.289 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:16.289 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:16.289 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:16.289 rmmod: ERROR: Module irdma is not currently loaded 00:01:16.289 rmmod: ERROR: Module i40iw is not currently loaded 00:01:16.289 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:16.289 + true 00:01:16.289 + for D in $DRIVERS 00:01:16.289 + sudo modprobe ice 00:01:16.289 + exit 0 00:01:16.300 [Pipeline] } 00:01:16.315 [Pipeline] // withEnv 00:01:16.320 [Pipeline] } 00:01:16.335 [Pipeline] // stage 00:01:16.344 [Pipeline] catchError 00:01:16.345 [Pipeline] { 00:01:16.359 [Pipeline] timeout 00:01:16.359 Timeout set to expire in 1 hr 0 min 00:01:16.361 [Pipeline] { 00:01:16.375 [Pipeline] stage 00:01:16.377 [Pipeline] { (Tests) 00:01:16.391 [Pipeline] sh 00:01:16.679 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:16.679 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:16.679 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:16.679 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:16.679 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:16.679 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:16.679 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:16.679 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:16.679 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:16.679 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:16.679 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:16.679 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:16.679 + source /etc/os-release 00:01:16.679 ++ NAME='Fedora Linux' 00:01:16.679 ++ VERSION='39 (Cloud Edition)' 00:01:16.679 ++ ID=fedora 00:01:16.679 ++ VERSION_ID=39 00:01:16.679 ++ VERSION_CODENAME= 00:01:16.679 ++ PLATFORM_ID=platform:f39 00:01:16.679 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:16.679 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:16.679 ++ LOGO=fedora-logo-icon 00:01:16.679 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:16.679 ++ HOME_URL=https://fedoraproject.org/ 00:01:16.679 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:16.679 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:16.679 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:16.679 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:16.679 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:16.679 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:16.679 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:16.679 ++ SUPPORT_END=2024-11-12 00:01:16.679 ++ VARIANT='Cloud Edition' 00:01:16.679 ++ VARIANT_ID=cloud 00:01:16.679 + uname -a 00:01:16.679 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:16.679 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:17.619 Hugepages 00:01:17.619 node hugesize free / total 00:01:17.619 node0 1048576kB 0 / 0 00:01:17.619 node0 2048kB 0 / 0 00:01:17.619 node1 1048576kB 0 / 0 00:01:17.619 node1 2048kB 0 / 0 00:01:17.619 00:01:17.619 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:17.619 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:17.619 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:17.619 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:17.619 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:17.619 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:17.619 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:17.619 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:17.619 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:17.619 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:17.619 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:17.619 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:17.619 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:17.619 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:17.619 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:17.619 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:17.619 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:17.619 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:17.619 + rm -f /tmp/spdk-ld-path 00:01:17.619 + source autorun-spdk.conf 00:01:17.619 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:17.619 ++ SPDK_TEST_NVMF=1 00:01:17.619 ++ SPDK_TEST_NVME_CLI=1 00:01:17.619 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:17.619 ++ SPDK_TEST_NVMF_NICS=e810 00:01:17.619 ++ SPDK_RUN_UBSAN=1 00:01:17.619 ++ NET_TYPE=phy 00:01:17.619 ++ RUN_NIGHTLY=1 00:01:17.619 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:17.619 + [[ -n '' ]] 00:01:17.619 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:17.619 + for M in /var/spdk/build-*-manifest.txt 00:01:17.619 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:17.619 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:17.619 + for M in /var/spdk/build-*-manifest.txt 00:01:17.619 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:17.619 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:17.619 + for M in /var/spdk/build-*-manifest.txt 00:01:17.619 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:17.619 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:17.619 ++ uname 00:01:17.619 + [[ Linux == \L\i\n\u\x ]] 00:01:17.619 + sudo dmesg -T 00:01:17.619 + sudo dmesg --clear 00:01:17.879 + dmesg_pid=4023126 00:01:17.879 + [[ Fedora Linux == FreeBSD ]] 00:01:17.879 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:17.879 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:17.879 + sudo dmesg -Tw 00:01:17.879 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:17.879 + [[ -x /usr/src/fio-static/fio ]] 00:01:17.879 + export FIO_BIN=/usr/src/fio-static/fio 00:01:17.879 + FIO_BIN=/usr/src/fio-static/fio 00:01:17.879 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:17.879 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:17.879 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:17.879 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:17.879 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:17.879 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:17.879 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:17.879 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:17.879 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:17.879 Test configuration: 00:01:17.879 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:17.879 SPDK_TEST_NVMF=1 00:01:17.879 SPDK_TEST_NVME_CLI=1 00:01:17.879 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:17.879 SPDK_TEST_NVMF_NICS=e810 00:01:17.879 SPDK_RUN_UBSAN=1 00:01:17.879 NET_TYPE=phy 00:01:17.879 RUN_NIGHTLY=1 09:24:40 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:17.879 09:24:40 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:17.879 09:24:40 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:17.879 09:24:40 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:17.879 09:24:40 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:17.879 09:24:40 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.879 09:24:40 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.879 09:24:40 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.879 09:24:40 -- paths/export.sh@5 -- $ export PATH 00:01:17.879 09:24:40 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.879 09:24:40 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:17.879 09:24:40 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:17.879 09:24:40 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732868680.XXXXXX 00:01:17.879 09:24:40 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732868680.a5QELj 00:01:17.879 09:24:40 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:17.879 09:24:40 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:17.879 09:24:40 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:17.879 09:24:40 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:17.879 09:24:40 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:17.879 09:24:40 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:17.879 09:24:40 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:17.879 09:24:40 -- common/autotest_common.sh@10 -- $ set +x 00:01:17.879 09:24:40 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:17.879 09:24:40 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:17.879 09:24:40 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:17.879 09:24:40 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:17.879 09:24:40 -- spdk/autobuild.sh@16 -- $ date -u 00:01:17.879 Fri Nov 29 08:24:40 AM UTC 2024 00:01:17.879 09:24:40 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:17.879 LTS-67-gc13c99a5e 00:01:17.879 09:24:40 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:17.879 09:24:40 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:17.879 09:24:40 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:17.879 09:24:40 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:17.879 09:24:40 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:17.879 09:24:40 -- common/autotest_common.sh@10 -- $ set +x 00:01:17.879 ************************************ 00:01:17.879 START TEST ubsan 00:01:17.879 ************************************ 00:01:17.879 09:24:40 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:17.879 using ubsan 00:01:17.879 00:01:17.879 real 0m0.000s 00:01:17.879 user 0m0.000s 00:01:17.879 sys 0m0.000s 00:01:17.879 09:24:40 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:17.879 09:24:40 -- common/autotest_common.sh@10 -- $ set +x 00:01:17.879 ************************************ 00:01:17.879 END TEST ubsan 00:01:17.879 ************************************ 00:01:17.879 09:24:40 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:17.879 09:24:40 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:17.879 09:24:40 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:17.879 09:24:40 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:17.879 09:24:40 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:17.879 09:24:40 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:17.879 09:24:40 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:17.879 09:24:40 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:17.879 09:24:40 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:17.879 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:17.879 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:18.138 Using 'verbs' RDMA provider 00:01:28.696 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:38.686 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:38.686 Creating mk/config.mk...done. 00:01:38.686 Creating mk/cc.flags.mk...done. 00:01:38.686 Type 'make' to build. 00:01:38.686 09:25:01 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:38.686 09:25:01 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:38.686 09:25:01 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:38.686 09:25:01 -- common/autotest_common.sh@10 -- $ set +x 00:01:38.686 ************************************ 00:01:38.686 START TEST make 00:01:38.686 ************************************ 00:01:38.686 09:25:01 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:38.686 make[1]: Nothing to be done for 'all'. 00:01:48.698 The Meson build system 00:01:48.698 Version: 1.5.0 00:01:48.698 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:48.698 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:48.698 Build type: native build 00:01:48.698 Program cat found: YES (/usr/bin/cat) 00:01:48.698 Project name: DPDK 00:01:48.698 Project version: 23.11.0 00:01:48.698 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:48.698 C linker for the host machine: cc ld.bfd 2.40-14 00:01:48.698 Host machine cpu family: x86_64 00:01:48.698 Host machine cpu: x86_64 00:01:48.698 Message: ## Building in Developer Mode ## 00:01:48.698 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:48.698 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:48.698 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:48.698 Program python3 found: YES (/usr/bin/python3) 00:01:48.698 Program cat found: YES (/usr/bin/cat) 00:01:48.698 Compiler for C supports arguments -march=native: YES 00:01:48.698 Checking for size of "void *" : 8 00:01:48.698 Checking for size of "void *" : 8 (cached) 00:01:48.698 Library m found: YES 00:01:48.698 Library numa found: YES 00:01:48.698 Has header "numaif.h" : YES 00:01:48.698 Library fdt found: NO 00:01:48.698 Library execinfo found: NO 00:01:48.698 Has header "execinfo.h" : YES 00:01:48.699 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:48.699 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:48.699 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:48.699 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:48.699 Run-time dependency openssl found: YES 3.1.1 00:01:48.699 Run-time dependency libpcap found: YES 1.10.4 00:01:48.699 Has header "pcap.h" with dependency libpcap: YES 00:01:48.699 Compiler for C supports arguments -Wcast-qual: YES 00:01:48.699 Compiler for C supports arguments -Wdeprecated: YES 00:01:48.699 Compiler for C supports arguments -Wformat: YES 00:01:48.699 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:48.699 Compiler for C supports arguments -Wformat-security: NO 00:01:48.699 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:48.699 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:48.699 Compiler for C supports arguments -Wnested-externs: YES 00:01:48.699 Compiler for C supports arguments -Wold-style-definition: YES 00:01:48.699 Compiler for C supports arguments -Wpointer-arith: YES 00:01:48.699 Compiler for C supports arguments -Wsign-compare: YES 00:01:48.699 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:48.699 Compiler for C supports arguments -Wundef: YES 00:01:48.699 Compiler for C supports arguments -Wwrite-strings: YES 00:01:48.699 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:48.699 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:48.699 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:48.699 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:48.699 Program objdump found: YES (/usr/bin/objdump) 00:01:48.699 Compiler for C supports arguments -mavx512f: YES 00:01:48.699 Checking if "AVX512 checking" compiles: YES 00:01:48.699 Fetching value of define "__SSE4_2__" : 1 00:01:48.699 Fetching value of define "__AES__" : 1 00:01:48.699 Fetching value of define "__AVX__" : 1 00:01:48.699 Fetching value of define "__AVX2__" : (undefined) 00:01:48.699 Fetching value of define "__AVX512BW__" : (undefined) 00:01:48.699 Fetching value of define "__AVX512CD__" : (undefined) 00:01:48.699 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:48.699 Fetching value of define "__AVX512F__" : (undefined) 00:01:48.699 Fetching value of define "__AVX512VL__" : (undefined) 00:01:48.699 Fetching value of define "__PCLMUL__" : 1 00:01:48.699 Fetching value of define "__RDRND__" : 1 00:01:48.699 Fetching value of define "__RDSEED__" : (undefined) 00:01:48.699 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:48.699 Fetching value of define "__znver1__" : (undefined) 00:01:48.699 Fetching value of define "__znver2__" : (undefined) 00:01:48.699 Fetching value of define "__znver3__" : (undefined) 00:01:48.699 Fetching value of define "__znver4__" : (undefined) 00:01:48.699 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:48.699 Message: lib/log: Defining dependency "log" 00:01:48.699 Message: lib/kvargs: Defining dependency "kvargs" 00:01:48.699 Message: lib/telemetry: Defining dependency "telemetry" 00:01:48.699 Checking for function "getentropy" : NO 00:01:48.699 Message: lib/eal: Defining dependency "eal" 00:01:48.699 Message: lib/ring: Defining dependency "ring" 00:01:48.699 Message: lib/rcu: Defining dependency "rcu" 00:01:48.699 Message: lib/mempool: Defining dependency "mempool" 00:01:48.699 Message: lib/mbuf: Defining dependency "mbuf" 00:01:48.699 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:48.699 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:48.699 Compiler for C supports arguments -mpclmul: YES 00:01:48.699 Compiler for C supports arguments -maes: YES 00:01:48.699 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:48.699 Compiler for C supports arguments -mavx512bw: YES 00:01:48.699 Compiler for C supports arguments -mavx512dq: YES 00:01:48.699 Compiler for C supports arguments -mavx512vl: YES 00:01:48.699 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:48.699 Compiler for C supports arguments -mavx2: YES 00:01:48.699 Compiler for C supports arguments -mavx: YES 00:01:48.699 Message: lib/net: Defining dependency "net" 00:01:48.699 Message: lib/meter: Defining dependency "meter" 00:01:48.699 Message: lib/ethdev: Defining dependency "ethdev" 00:01:48.699 Message: lib/pci: Defining dependency "pci" 00:01:48.699 Message: lib/cmdline: Defining dependency "cmdline" 00:01:48.699 Message: lib/hash: Defining dependency "hash" 00:01:48.699 Message: lib/timer: Defining dependency "timer" 00:01:48.699 Message: lib/compressdev: Defining dependency "compressdev" 00:01:48.699 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:48.699 Message: lib/dmadev: Defining dependency "dmadev" 00:01:48.699 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:48.699 Message: lib/power: Defining dependency "power" 00:01:48.699 Message: lib/reorder: Defining dependency "reorder" 00:01:48.699 Message: lib/security: Defining dependency "security" 00:01:48.699 Has header "linux/userfaultfd.h" : YES 00:01:48.699 Has header "linux/vduse.h" : YES 00:01:48.699 Message: lib/vhost: Defining dependency "vhost" 00:01:48.699 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:48.699 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:48.699 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:48.699 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:48.699 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:48.699 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:48.699 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:48.699 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:48.699 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:48.699 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:48.699 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:48.699 Configuring doxy-api-html.conf using configuration 00:01:48.699 Configuring doxy-api-man.conf using configuration 00:01:48.699 Program mandb found: YES (/usr/bin/mandb) 00:01:48.699 Program sphinx-build found: NO 00:01:48.699 Configuring rte_build_config.h using configuration 00:01:48.699 Message: 00:01:48.699 ================= 00:01:48.699 Applications Enabled 00:01:48.699 ================= 00:01:48.699 00:01:48.699 apps: 00:01:48.699 00:01:48.699 00:01:48.699 Message: 00:01:48.699 ================= 00:01:48.699 Libraries Enabled 00:01:48.699 ================= 00:01:48.699 00:01:48.699 libs: 00:01:48.699 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:48.699 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:48.699 cryptodev, dmadev, power, reorder, security, vhost, 00:01:48.699 00:01:48.699 Message: 00:01:48.699 =============== 00:01:48.699 Drivers Enabled 00:01:48.699 =============== 00:01:48.699 00:01:48.699 common: 00:01:48.699 00:01:48.699 bus: 00:01:48.699 pci, vdev, 00:01:48.699 mempool: 00:01:48.699 ring, 00:01:48.699 dma: 00:01:48.699 00:01:48.699 net: 00:01:48.699 00:01:48.699 crypto: 00:01:48.699 00:01:48.699 compress: 00:01:48.699 00:01:48.699 vdpa: 00:01:48.699 00:01:48.699 00:01:48.699 Message: 00:01:48.699 ================= 00:01:48.699 Content Skipped 00:01:48.699 ================= 00:01:48.699 00:01:48.699 apps: 00:01:48.699 dumpcap: explicitly disabled via build config 00:01:48.699 graph: explicitly disabled via build config 00:01:48.699 pdump: explicitly disabled via build config 00:01:48.699 proc-info: explicitly disabled via build config 00:01:48.699 test-acl: explicitly disabled via build config 00:01:48.699 test-bbdev: explicitly disabled via build config 00:01:48.699 test-cmdline: explicitly disabled via build config 00:01:48.699 test-compress-perf: explicitly disabled via build config 00:01:48.699 test-crypto-perf: explicitly disabled via build config 00:01:48.699 test-dma-perf: explicitly disabled via build config 00:01:48.699 test-eventdev: explicitly disabled via build config 00:01:48.699 test-fib: explicitly disabled via build config 00:01:48.699 test-flow-perf: explicitly disabled via build config 00:01:48.699 test-gpudev: explicitly disabled via build config 00:01:48.699 test-mldev: explicitly disabled via build config 00:01:48.699 test-pipeline: explicitly disabled via build config 00:01:48.699 test-pmd: explicitly disabled via build config 00:01:48.699 test-regex: explicitly disabled via build config 00:01:48.699 test-sad: explicitly disabled via build config 00:01:48.699 test-security-perf: explicitly disabled via build config 00:01:48.699 00:01:48.699 libs: 00:01:48.699 metrics: explicitly disabled via build config 00:01:48.699 acl: explicitly disabled via build config 00:01:48.699 bbdev: explicitly disabled via build config 00:01:48.699 bitratestats: explicitly disabled via build config 00:01:48.699 bpf: explicitly disabled via build config 00:01:48.699 cfgfile: explicitly disabled via build config 00:01:48.699 distributor: explicitly disabled via build config 00:01:48.699 efd: explicitly disabled via build config 00:01:48.699 eventdev: explicitly disabled via build config 00:01:48.699 dispatcher: explicitly disabled via build config 00:01:48.699 gpudev: explicitly disabled via build config 00:01:48.699 gro: explicitly disabled via build config 00:01:48.699 gso: explicitly disabled via build config 00:01:48.699 ip_frag: explicitly disabled via build config 00:01:48.699 jobstats: explicitly disabled via build config 00:01:48.699 latencystats: explicitly disabled via build config 00:01:48.699 lpm: explicitly disabled via build config 00:01:48.699 member: explicitly disabled via build config 00:01:48.699 pcapng: explicitly disabled via build config 00:01:48.699 rawdev: explicitly disabled via build config 00:01:48.699 regexdev: explicitly disabled via build config 00:01:48.699 mldev: explicitly disabled via build config 00:01:48.699 rib: explicitly disabled via build config 00:01:48.699 sched: explicitly disabled via build config 00:01:48.699 stack: explicitly disabled via build config 00:01:48.699 ipsec: explicitly disabled via build config 00:01:48.699 pdcp: explicitly disabled via build config 00:01:48.699 fib: explicitly disabled via build config 00:01:48.699 port: explicitly disabled via build config 00:01:48.699 pdump: explicitly disabled via build config 00:01:48.699 table: explicitly disabled via build config 00:01:48.699 pipeline: explicitly disabled via build config 00:01:48.699 graph: explicitly disabled via build config 00:01:48.699 node: explicitly disabled via build config 00:01:48.699 00:01:48.699 drivers: 00:01:48.699 common/cpt: not in enabled drivers build config 00:01:48.699 common/dpaax: not in enabled drivers build config 00:01:48.699 common/iavf: not in enabled drivers build config 00:01:48.699 common/idpf: not in enabled drivers build config 00:01:48.699 common/mvep: not in enabled drivers build config 00:01:48.699 common/octeontx: not in enabled drivers build config 00:01:48.699 bus/auxiliary: not in enabled drivers build config 00:01:48.699 bus/cdx: not in enabled drivers build config 00:01:48.699 bus/dpaa: not in enabled drivers build config 00:01:48.699 bus/fslmc: not in enabled drivers build config 00:01:48.699 bus/ifpga: not in enabled drivers build config 00:01:48.699 bus/platform: not in enabled drivers build config 00:01:48.699 bus/vmbus: not in enabled drivers build config 00:01:48.699 common/cnxk: not in enabled drivers build config 00:01:48.699 common/mlx5: not in enabled drivers build config 00:01:48.699 common/nfp: not in enabled drivers build config 00:01:48.699 common/qat: not in enabled drivers build config 00:01:48.699 common/sfc_efx: not in enabled drivers build config 00:01:48.699 mempool/bucket: not in enabled drivers build config 00:01:48.699 mempool/cnxk: not in enabled drivers build config 00:01:48.699 mempool/dpaa: not in enabled drivers build config 00:01:48.699 mempool/dpaa2: not in enabled drivers build config 00:01:48.699 mempool/octeontx: not in enabled drivers build config 00:01:48.699 mempool/stack: not in enabled drivers build config 00:01:48.699 dma/cnxk: not in enabled drivers build config 00:01:48.699 dma/dpaa: not in enabled drivers build config 00:01:48.699 dma/dpaa2: not in enabled drivers build config 00:01:48.699 dma/hisilicon: not in enabled drivers build config 00:01:48.699 dma/idxd: not in enabled drivers build config 00:01:48.699 dma/ioat: not in enabled drivers build config 00:01:48.699 dma/skeleton: not in enabled drivers build config 00:01:48.699 net/af_packet: not in enabled drivers build config 00:01:48.699 net/af_xdp: not in enabled drivers build config 00:01:48.699 net/ark: not in enabled drivers build config 00:01:48.699 net/atlantic: not in enabled drivers build config 00:01:48.699 net/avp: not in enabled drivers build config 00:01:48.699 net/axgbe: not in enabled drivers build config 00:01:48.699 net/bnx2x: not in enabled drivers build config 00:01:48.700 net/bnxt: not in enabled drivers build config 00:01:48.700 net/bonding: not in enabled drivers build config 00:01:48.700 net/cnxk: not in enabled drivers build config 00:01:48.700 net/cpfl: not in enabled drivers build config 00:01:48.700 net/cxgbe: not in enabled drivers build config 00:01:48.700 net/dpaa: not in enabled drivers build config 00:01:48.700 net/dpaa2: not in enabled drivers build config 00:01:48.700 net/e1000: not in enabled drivers build config 00:01:48.700 net/ena: not in enabled drivers build config 00:01:48.700 net/enetc: not in enabled drivers build config 00:01:48.700 net/enetfec: not in enabled drivers build config 00:01:48.700 net/enic: not in enabled drivers build config 00:01:48.700 net/failsafe: not in enabled drivers build config 00:01:48.700 net/fm10k: not in enabled drivers build config 00:01:48.700 net/gve: not in enabled drivers build config 00:01:48.700 net/hinic: not in enabled drivers build config 00:01:48.700 net/hns3: not in enabled drivers build config 00:01:48.700 net/i40e: not in enabled drivers build config 00:01:48.700 net/iavf: not in enabled drivers build config 00:01:48.700 net/ice: not in enabled drivers build config 00:01:48.700 net/idpf: not in enabled drivers build config 00:01:48.700 net/igc: not in enabled drivers build config 00:01:48.700 net/ionic: not in enabled drivers build config 00:01:48.700 net/ipn3ke: not in enabled drivers build config 00:01:48.700 net/ixgbe: not in enabled drivers build config 00:01:48.700 net/mana: not in enabled drivers build config 00:01:48.700 net/memif: not in enabled drivers build config 00:01:48.700 net/mlx4: not in enabled drivers build config 00:01:48.700 net/mlx5: not in enabled drivers build config 00:01:48.700 net/mvneta: not in enabled drivers build config 00:01:48.700 net/mvpp2: not in enabled drivers build config 00:01:48.700 net/netvsc: not in enabled drivers build config 00:01:48.700 net/nfb: not in enabled drivers build config 00:01:48.700 net/nfp: not in enabled drivers build config 00:01:48.700 net/ngbe: not in enabled drivers build config 00:01:48.700 net/null: not in enabled drivers build config 00:01:48.700 net/octeontx: not in enabled drivers build config 00:01:48.700 net/octeon_ep: not in enabled drivers build config 00:01:48.700 net/pcap: not in enabled drivers build config 00:01:48.700 net/pfe: not in enabled drivers build config 00:01:48.700 net/qede: not in enabled drivers build config 00:01:48.700 net/ring: not in enabled drivers build config 00:01:48.700 net/sfc: not in enabled drivers build config 00:01:48.700 net/softnic: not in enabled drivers build config 00:01:48.700 net/tap: not in enabled drivers build config 00:01:48.700 net/thunderx: not in enabled drivers build config 00:01:48.700 net/txgbe: not in enabled drivers build config 00:01:48.700 net/vdev_netvsc: not in enabled drivers build config 00:01:48.700 net/vhost: not in enabled drivers build config 00:01:48.700 net/virtio: not in enabled drivers build config 00:01:48.700 net/vmxnet3: not in enabled drivers build config 00:01:48.700 raw/*: missing internal dependency, "rawdev" 00:01:48.700 crypto/armv8: not in enabled drivers build config 00:01:48.700 crypto/bcmfs: not in enabled drivers build config 00:01:48.700 crypto/caam_jr: not in enabled drivers build config 00:01:48.700 crypto/ccp: not in enabled drivers build config 00:01:48.700 crypto/cnxk: not in enabled drivers build config 00:01:48.700 crypto/dpaa_sec: not in enabled drivers build config 00:01:48.700 crypto/dpaa2_sec: not in enabled drivers build config 00:01:48.700 crypto/ipsec_mb: not in enabled drivers build config 00:01:48.700 crypto/mlx5: not in enabled drivers build config 00:01:48.700 crypto/mvsam: not in enabled drivers build config 00:01:48.700 crypto/nitrox: not in enabled drivers build config 00:01:48.700 crypto/null: not in enabled drivers build config 00:01:48.700 crypto/octeontx: not in enabled drivers build config 00:01:48.700 crypto/openssl: not in enabled drivers build config 00:01:48.700 crypto/scheduler: not in enabled drivers build config 00:01:48.700 crypto/uadk: not in enabled drivers build config 00:01:48.700 crypto/virtio: not in enabled drivers build config 00:01:48.700 compress/isal: not in enabled drivers build config 00:01:48.700 compress/mlx5: not in enabled drivers build config 00:01:48.700 compress/octeontx: not in enabled drivers build config 00:01:48.700 compress/zlib: not in enabled drivers build config 00:01:48.700 regex/*: missing internal dependency, "regexdev" 00:01:48.700 ml/*: missing internal dependency, "mldev" 00:01:48.700 vdpa/ifc: not in enabled drivers build config 00:01:48.700 vdpa/mlx5: not in enabled drivers build config 00:01:48.700 vdpa/nfp: not in enabled drivers build config 00:01:48.700 vdpa/sfc: not in enabled drivers build config 00:01:48.700 event/*: missing internal dependency, "eventdev" 00:01:48.700 baseband/*: missing internal dependency, "bbdev" 00:01:48.700 gpu/*: missing internal dependency, "gpudev" 00:01:48.700 00:01:48.700 00:01:48.700 Build targets in project: 85 00:01:48.700 00:01:48.700 DPDK 23.11.0 00:01:48.700 00:01:48.700 User defined options 00:01:48.700 buildtype : debug 00:01:48.700 default_library : shared 00:01:48.700 libdir : lib 00:01:48.700 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:48.700 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:48.700 c_link_args : 00:01:48.700 cpu_instruction_set: native 00:01:48.700 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:48.700 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:48.700 enable_docs : false 00:01:48.700 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:48.700 enable_kmods : false 00:01:48.700 tests : false 00:01:48.700 00:01:48.700 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:48.700 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:48.700 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:48.700 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:48.700 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:48.700 [4/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:48.700 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:48.700 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:48.700 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:48.700 [8/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:48.700 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:48.700 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:48.700 [11/265] Linking static target lib/librte_kvargs.a 00:01:48.700 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:48.700 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:48.700 [14/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:48.700 [15/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:48.700 [16/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:48.700 [17/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:48.700 [18/265] Linking static target lib/librte_log.a 00:01:48.700 [19/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:48.700 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:48.700 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:48.700 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.962 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:48.962 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:48.962 [25/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:48.962 [26/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:48.962 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:48.962 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:48.962 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:48.962 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:48.962 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:48.962 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:48.962 [33/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:48.962 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:48.962 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:48.962 [36/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:48.962 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:48.962 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:48.962 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:48.962 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:48.962 [41/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:48.962 [42/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:48.962 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:48.962 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:48.962 [45/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:48.962 [46/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:48.962 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:48.962 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:48.962 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:48.962 [50/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:48.962 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:48.962 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:48.962 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:48.962 [54/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:48.962 [55/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:48.962 [56/265] Linking static target lib/librte_telemetry.a 00:01:48.962 [57/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:48.962 [58/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:48.962 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:48.962 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:48.962 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:48.962 [62/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:49.221 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:49.221 [64/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.221 [65/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:49.221 [66/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:49.221 [67/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:49.221 [68/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:49.221 [69/265] Linking target lib/librte_log.so.24.0 00:01:49.221 [70/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:49.221 [71/265] Linking static target lib/librte_pci.a 00:01:49.221 [72/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:49.221 [73/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:49.221 [74/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:49.221 [75/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:49.221 [76/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:49.481 [77/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:49.481 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:49.481 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:49.481 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:49.481 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:49.481 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:49.481 [83/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:49.481 [84/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:49.481 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:49.481 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:49.742 [87/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:49.742 [88/265] Linking target lib/librte_kvargs.so.24.0 00:01:49.742 [89/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.742 [90/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:49.742 [91/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:49.742 [92/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:50.003 [93/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:50.003 [94/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:50.003 [95/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:50.003 [96/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:50.003 [97/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.003 [98/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:50.003 [99/265] Linking static target lib/librte_ring.a 00:01:50.003 [100/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:50.003 [101/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:50.003 [102/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:50.003 [103/265] Linking static target lib/librte_eal.a 00:01:50.003 [104/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:50.003 [105/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:50.003 [106/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:50.003 [107/265] Linking target lib/librte_telemetry.so.24.0 00:01:50.003 [108/265] Linking static target lib/librte_meter.a 00:01:50.003 [109/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:50.003 [110/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:50.003 [111/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:50.003 [112/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:50.003 [113/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:50.266 [114/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:50.266 [115/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:50.266 [116/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:50.266 [117/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:50.266 [118/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:50.266 [119/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:50.266 [120/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:50.266 [121/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:50.266 [122/265] Linking static target lib/librte_rcu.a 00:01:50.266 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:50.266 [124/265] Linking static target lib/librte_mempool.a 00:01:50.266 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:50.266 [126/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:50.266 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:50.266 [128/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:50.266 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:50.266 [130/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:50.266 [131/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:50.525 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:50.525 [133/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:50.525 [134/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:50.525 [135/265] Linking static target lib/librte_cmdline.a 00:01:50.525 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:50.525 [137/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.525 [138/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:50.525 [139/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.525 [140/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:50.525 [141/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:50.525 [142/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:50.525 [143/265] Linking static target lib/librte_timer.a 00:01:50.786 [144/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:50.786 [145/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:50.786 [146/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:50.786 [147/265] Linking static target lib/librte_net.a 00:01:50.786 [148/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:50.786 [149/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.786 [150/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:50.786 [151/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:50.786 [152/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:50.786 [153/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:51.046 [154/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:51.046 [155/265] Linking static target lib/librte_dmadev.a 00:01:51.046 [156/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:51.046 [157/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:51.046 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:51.046 [159/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:51.046 [160/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.046 [161/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.046 [162/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:51.046 [163/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:51.046 [164/265] Linking static target lib/librte_compressdev.a 00:01:51.305 [165/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:51.305 [166/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:51.305 [167/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.305 [168/265] Linking static target lib/librte_hash.a 00:01:51.305 [169/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:51.305 [170/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:51.305 [171/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:51.305 [172/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:51.305 [173/265] Linking static target lib/librte_power.a 00:01:51.305 [174/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:51.305 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:51.305 [176/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:51.305 [177/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.305 [178/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:51.305 [179/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:51.305 [180/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:51.305 [181/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.564 [182/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:51.564 [183/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:51.564 [184/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:51.564 [185/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:51.564 [186/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:51.564 [187/265] Linking static target lib/librte_mbuf.a 00:01:51.564 [188/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:51.564 [189/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:51.564 [190/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:51.564 [191/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:51.564 [192/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.564 [193/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:51.564 [194/265] Linking static target lib/librte_reorder.a 00:01:51.564 [195/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.823 [196/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:51.823 [197/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:51.823 [198/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:51.823 [199/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:51.823 [200/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:51.823 [201/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:51.823 [202/265] Linking static target drivers/librte_bus_vdev.a 00:01:51.823 [203/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:51.823 [204/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:51.823 [205/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:51.823 [206/265] Linking static target drivers/librte_bus_pci.a 00:01:51.823 [207/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:51.823 [208/265] Linking static target lib/librte_security.a 00:01:51.823 [209/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.823 [210/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:51.823 [211/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.823 [212/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:51.823 [213/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:51.823 [214/265] Linking static target drivers/librte_mempool_ring.a 00:01:52.081 [215/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.081 [216/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:52.081 [217/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.081 [218/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:52.081 [219/265] Linking static target lib/librte_ethdev.a 00:01:52.081 [220/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:52.081 [221/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.081 [222/265] Linking static target lib/librte_cryptodev.a 00:01:52.339 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.271 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.647 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:56.071 [226/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.071 [227/265] Linking target lib/librte_eal.so.24.0 00:01:56.071 [228/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.071 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:56.329 [230/265] Linking target lib/librte_meter.so.24.0 00:01:56.329 [231/265] Linking target lib/librte_ring.so.24.0 00:01:56.329 [232/265] Linking target lib/librte_timer.so.24.0 00:01:56.329 [233/265] Linking target lib/librte_pci.so.24.0 00:01:56.329 [234/265] Linking target lib/librte_dmadev.so.24.0 00:01:56.329 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:56.329 [236/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:56.329 [237/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:56.329 [238/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:56.329 [239/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:56.329 [240/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:56.329 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:56.329 [242/265] Linking target lib/librte_mempool.so.24.0 00:01:56.329 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:56.587 [244/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:56.587 [245/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:56.587 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:56.587 [247/265] Linking target lib/librte_mbuf.so.24.0 00:01:56.587 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:56.846 [249/265] Linking target lib/librte_reorder.so.24.0 00:01:56.846 [250/265] Linking target lib/librte_compressdev.so.24.0 00:01:56.846 [251/265] Linking target lib/librte_net.so.24.0 00:01:56.846 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:01:56.846 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:56.846 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:56.846 [255/265] Linking target lib/librte_hash.so.24.0 00:01:56.846 [256/265] Linking target lib/librte_security.so.24.0 00:01:56.846 [257/265] Linking target lib/librte_cmdline.so.24.0 00:01:56.846 [258/265] Linking target lib/librte_ethdev.so.24.0 00:01:57.104 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:57.104 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:57.104 [261/265] Linking target lib/librte_power.so.24.0 00:02:00.391 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:00.391 [263/265] Linking static target lib/librte_vhost.a 00:02:01.330 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.330 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:01.330 INFO: autodetecting backend as ninja 00:02:01.330 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:02:02.268 CC lib/ut/ut.o 00:02:02.268 CC lib/log/log.o 00:02:02.268 CC lib/log/log_flags.o 00:02:02.268 CC lib/log/log_deprecated.o 00:02:02.268 CC lib/ut_mock/mock.o 00:02:02.526 LIB libspdk_ut_mock.a 00:02:02.526 SO libspdk_ut_mock.so.5.0 00:02:02.526 LIB libspdk_log.a 00:02:02.526 LIB libspdk_ut.a 00:02:02.526 SO libspdk_ut.so.1.0 00:02:02.526 SO libspdk_log.so.6.1 00:02:02.526 SYMLINK libspdk_ut_mock.so 00:02:02.526 SYMLINK libspdk_ut.so 00:02:02.526 SYMLINK libspdk_log.so 00:02:02.783 CC lib/dma/dma.o 00:02:02.783 CC lib/ioat/ioat.o 00:02:02.783 CXX lib/trace_parser/trace.o 00:02:02.783 CC lib/util/base64.o 00:02:02.783 CC lib/util/bit_array.o 00:02:02.783 CC lib/util/cpuset.o 00:02:02.783 CC lib/util/crc16.o 00:02:02.783 CC lib/util/crc32.o 00:02:02.783 CC lib/util/crc32c.o 00:02:02.783 CC lib/util/crc32_ieee.o 00:02:02.783 CC lib/util/crc64.o 00:02:02.783 CC lib/util/dif.o 00:02:02.783 CC lib/util/fd.o 00:02:02.783 CC lib/util/file.o 00:02:02.783 CC lib/util/hexlify.o 00:02:02.783 CC lib/util/iov.o 00:02:02.783 CC lib/util/math.o 00:02:02.783 CC lib/util/pipe.o 00:02:02.783 CC lib/util/strerror_tls.o 00:02:02.783 CC lib/util/string.o 00:02:02.783 CC lib/util/uuid.o 00:02:02.783 CC lib/util/fd_group.o 00:02:02.783 CC lib/util/xor.o 00:02:02.783 CC lib/util/zipf.o 00:02:02.783 CC lib/vfio_user/host/vfio_user_pci.o 00:02:02.783 CC lib/vfio_user/host/vfio_user.o 00:02:02.783 LIB libspdk_dma.a 00:02:02.783 SO libspdk_dma.so.3.0 00:02:03.041 SYMLINK libspdk_dma.so 00:02:03.041 LIB libspdk_ioat.a 00:02:03.041 SO libspdk_ioat.so.6.0 00:02:03.041 LIB libspdk_vfio_user.a 00:02:03.041 SO libspdk_vfio_user.so.4.0 00:02:03.041 SYMLINK libspdk_ioat.so 00:02:03.041 SYMLINK libspdk_vfio_user.so 00:02:03.299 LIB libspdk_util.a 00:02:03.299 SO libspdk_util.so.8.0 00:02:03.299 SYMLINK libspdk_util.so 00:02:03.557 CC lib/conf/conf.o 00:02:03.557 CC lib/json/json_parse.o 00:02:03.557 CC lib/idxd/idxd.o 00:02:03.557 CC lib/env_dpdk/env.o 00:02:03.557 CC lib/idxd/idxd_user.o 00:02:03.557 CC lib/json/json_util.o 00:02:03.557 CC lib/env_dpdk/memory.o 00:02:03.557 CC lib/json/json_write.o 00:02:03.557 CC lib/idxd/idxd_kernel.o 00:02:03.557 CC lib/env_dpdk/pci.o 00:02:03.557 CC lib/env_dpdk/init.o 00:02:03.557 CC lib/env_dpdk/threads.o 00:02:03.558 CC lib/vmd/vmd.o 00:02:03.558 CC lib/rdma/common.o 00:02:03.558 CC lib/env_dpdk/pci_ioat.o 00:02:03.558 CC lib/vmd/led.o 00:02:03.558 CC lib/env_dpdk/pci_virtio.o 00:02:03.558 CC lib/rdma/rdma_verbs.o 00:02:03.558 CC lib/env_dpdk/pci_vmd.o 00:02:03.558 CC lib/env_dpdk/pci_idxd.o 00:02:03.558 CC lib/env_dpdk/pci_event.o 00:02:03.558 CC lib/env_dpdk/pci_dpdk.o 00:02:03.558 CC lib/env_dpdk/sigbus_handler.o 00:02:03.558 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:03.558 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:03.558 LIB libspdk_trace_parser.a 00:02:03.558 SO libspdk_trace_parser.so.4.0 00:02:03.817 SYMLINK libspdk_trace_parser.so 00:02:03.817 LIB libspdk_rdma.a 00:02:03.817 LIB libspdk_json.a 00:02:03.817 LIB libspdk_conf.a 00:02:03.817 SO libspdk_rdma.so.5.0 00:02:03.817 SO libspdk_json.so.5.1 00:02:03.817 SO libspdk_conf.so.5.0 00:02:03.817 SYMLINK libspdk_rdma.so 00:02:03.817 SYMLINK libspdk_json.so 00:02:03.817 SYMLINK libspdk_conf.so 00:02:04.075 CC lib/jsonrpc/jsonrpc_server.o 00:02:04.075 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:04.075 CC lib/jsonrpc/jsonrpc_client.o 00:02:04.075 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:04.075 LIB libspdk_idxd.a 00:02:04.075 SO libspdk_idxd.so.11.0 00:02:04.075 SYMLINK libspdk_idxd.so 00:02:04.334 LIB libspdk_vmd.a 00:02:04.334 SO libspdk_vmd.so.5.0 00:02:04.334 LIB libspdk_jsonrpc.a 00:02:04.334 SYMLINK libspdk_vmd.so 00:02:04.334 SO libspdk_jsonrpc.so.5.1 00:02:04.334 SYMLINK libspdk_jsonrpc.so 00:02:04.593 CC lib/rpc/rpc.o 00:02:04.593 LIB libspdk_rpc.a 00:02:04.593 SO libspdk_rpc.so.5.0 00:02:04.851 SYMLINK libspdk_rpc.so 00:02:04.852 CC lib/sock/sock.o 00:02:04.852 CC lib/notify/notify.o 00:02:04.852 CC lib/trace/trace.o 00:02:04.852 CC lib/trace/trace_flags.o 00:02:04.852 CC lib/sock/sock_rpc.o 00:02:04.852 CC lib/notify/notify_rpc.o 00:02:04.852 CC lib/trace/trace_rpc.o 00:02:05.110 LIB libspdk_notify.a 00:02:05.110 SO libspdk_notify.so.5.0 00:02:05.110 SYMLINK libspdk_notify.so 00:02:05.110 LIB libspdk_trace.a 00:02:05.110 SO libspdk_trace.so.9.0 00:02:05.110 SYMLINK libspdk_trace.so 00:02:05.369 LIB libspdk_sock.a 00:02:05.369 SO libspdk_sock.so.8.0 00:02:05.369 CC lib/thread/thread.o 00:02:05.369 CC lib/thread/iobuf.o 00:02:05.369 SYMLINK libspdk_sock.so 00:02:05.369 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:05.369 CC lib/nvme/nvme_ctrlr.o 00:02:05.369 CC lib/nvme/nvme_fabric.o 00:02:05.369 CC lib/nvme/nvme_ns_cmd.o 00:02:05.369 CC lib/nvme/nvme_ns.o 00:02:05.369 CC lib/nvme/nvme_pcie_common.o 00:02:05.369 CC lib/nvme/nvme_pcie.o 00:02:05.369 CC lib/nvme/nvme_qpair.o 00:02:05.369 CC lib/nvme/nvme.o 00:02:05.369 CC lib/nvme/nvme_quirks.o 00:02:05.369 CC lib/nvme/nvme_transport.o 00:02:05.369 CC lib/nvme/nvme_discovery.o 00:02:05.369 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:05.369 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:05.369 CC lib/nvme/nvme_tcp.o 00:02:05.369 CC lib/nvme/nvme_opal.o 00:02:05.369 CC lib/nvme/nvme_io_msg.o 00:02:05.369 CC lib/nvme/nvme_poll_group.o 00:02:05.369 CC lib/nvme/nvme_zns.o 00:02:05.369 CC lib/nvme/nvme_cuse.o 00:02:05.369 CC lib/nvme/nvme_vfio_user.o 00:02:05.369 CC lib/nvme/nvme_rdma.o 00:02:05.628 LIB libspdk_env_dpdk.a 00:02:05.628 SO libspdk_env_dpdk.so.13.0 00:02:05.628 SYMLINK libspdk_env_dpdk.so 00:02:07.002 LIB libspdk_thread.a 00:02:07.003 SO libspdk_thread.so.9.0 00:02:07.003 SYMLINK libspdk_thread.so 00:02:07.003 CC lib/virtio/virtio.o 00:02:07.003 CC lib/accel/accel.o 00:02:07.003 CC lib/virtio/virtio_vhost_user.o 00:02:07.003 CC lib/accel/accel_rpc.o 00:02:07.003 CC lib/init/json_config.o 00:02:07.003 CC lib/virtio/virtio_vfio_user.o 00:02:07.003 CC lib/blob/blobstore.o 00:02:07.003 CC lib/accel/accel_sw.o 00:02:07.003 CC lib/virtio/virtio_pci.o 00:02:07.003 CC lib/init/subsystem.o 00:02:07.003 CC lib/blob/request.o 00:02:07.003 CC lib/blob/zeroes.o 00:02:07.003 CC lib/init/subsystem_rpc.o 00:02:07.003 CC lib/blob/blob_bs_dev.o 00:02:07.003 CC lib/init/rpc.o 00:02:07.261 LIB libspdk_init.a 00:02:07.261 SO libspdk_init.so.4.0 00:02:07.520 SYMLINK libspdk_init.so 00:02:07.520 LIB libspdk_virtio.a 00:02:07.520 SO libspdk_virtio.so.6.0 00:02:07.520 SYMLINK libspdk_virtio.so 00:02:07.520 CC lib/event/app.o 00:02:07.520 CC lib/event/reactor.o 00:02:07.520 CC lib/event/log_rpc.o 00:02:07.520 CC lib/event/app_rpc.o 00:02:07.520 CC lib/event/scheduler_static.o 00:02:07.778 LIB libspdk_nvme.a 00:02:07.778 SO libspdk_nvme.so.12.0 00:02:08.036 LIB libspdk_event.a 00:02:08.036 SO libspdk_event.so.12.0 00:02:08.036 SYMLINK libspdk_nvme.so 00:02:08.036 SYMLINK libspdk_event.so 00:02:08.295 LIB libspdk_accel.a 00:02:08.295 SO libspdk_accel.so.14.0 00:02:08.295 SYMLINK libspdk_accel.so 00:02:08.295 CC lib/bdev/bdev.o 00:02:08.295 CC lib/bdev/bdev_rpc.o 00:02:08.295 CC lib/bdev/bdev_zone.o 00:02:08.295 CC lib/bdev/part.o 00:02:08.295 CC lib/bdev/scsi_nvme.o 00:02:10.195 LIB libspdk_blob.a 00:02:10.195 SO libspdk_blob.so.10.1 00:02:10.195 SYMLINK libspdk_blob.so 00:02:10.195 CC lib/lvol/lvol.o 00:02:10.195 CC lib/blobfs/blobfs.o 00:02:10.195 CC lib/blobfs/tree.o 00:02:11.234 LIB libspdk_blobfs.a 00:02:11.234 LIB libspdk_bdev.a 00:02:11.234 SO libspdk_blobfs.so.9.0 00:02:11.234 SO libspdk_bdev.so.14.0 00:02:11.234 SYMLINK libspdk_blobfs.so 00:02:11.234 LIB libspdk_lvol.a 00:02:11.234 SYMLINK libspdk_bdev.so 00:02:11.234 SO libspdk_lvol.so.9.1 00:02:11.234 SYMLINK libspdk_lvol.so 00:02:11.234 CC lib/ftl/ftl_core.o 00:02:11.234 CC lib/nbd/nbd.o 00:02:11.234 CC lib/ftl/ftl_init.o 00:02:11.234 CC lib/ublk/ublk.o 00:02:11.234 CC lib/scsi/dev.o 00:02:11.234 CC lib/nvmf/ctrlr.o 00:02:11.234 CC lib/nbd/nbd_rpc.o 00:02:11.234 CC lib/ftl/ftl_layout.o 00:02:11.234 CC lib/ublk/ublk_rpc.o 00:02:11.234 CC lib/nvmf/ctrlr_discovery.o 00:02:11.234 CC lib/scsi/lun.o 00:02:11.234 CC lib/ftl/ftl_debug.o 00:02:11.234 CC lib/nvmf/ctrlr_bdev.o 00:02:11.234 CC lib/ftl/ftl_io.o 00:02:11.234 CC lib/scsi/port.o 00:02:11.234 CC lib/nvmf/subsystem.o 00:02:11.234 CC lib/scsi/scsi.o 00:02:11.234 CC lib/nvmf/nvmf.o 00:02:11.234 CC lib/ftl/ftl_l2p.o 00:02:11.234 CC lib/ftl/ftl_sb.o 00:02:11.234 CC lib/nvmf/nvmf_rpc.o 00:02:11.234 CC lib/scsi/scsi_pr.o 00:02:11.234 CC lib/scsi/scsi_bdev.o 00:02:11.234 CC lib/ftl/ftl_l2p_flat.o 00:02:11.234 CC lib/ftl/ftl_nv_cache.o 00:02:11.234 CC lib/nvmf/transport.o 00:02:11.234 CC lib/scsi/scsi_rpc.o 00:02:11.234 CC lib/nvmf/tcp.o 00:02:11.234 CC lib/ftl/ftl_band.o 00:02:11.234 CC lib/scsi/task.o 00:02:11.234 CC lib/nvmf/rdma.o 00:02:11.234 CC lib/ftl/ftl_writer.o 00:02:11.234 CC lib/ftl/ftl_band_ops.o 00:02:11.234 CC lib/ftl/ftl_rq.o 00:02:11.234 CC lib/ftl/ftl_reloc.o 00:02:11.234 CC lib/ftl/ftl_l2p_cache.o 00:02:11.234 CC lib/ftl/ftl_p2l.o 00:02:11.234 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:11.234 CC lib/ftl/mngt/ftl_mngt.o 00:02:11.234 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:11.234 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:11.234 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:11.234 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:11.234 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:11.234 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:11.234 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:11.234 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:11.234 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:11.495 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:11.495 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:11.495 CC lib/ftl/utils/ftl_conf.o 00:02:11.495 CC lib/ftl/utils/ftl_md.o 00:02:11.495 CC lib/ftl/utils/ftl_mempool.o 00:02:11.495 CC lib/ftl/utils/ftl_bitmap.o 00:02:11.495 CC lib/ftl/utils/ftl_property.o 00:02:11.495 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:11.754 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:11.754 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:11.754 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:11.754 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:11.754 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:11.754 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:11.754 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:11.754 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:11.754 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:11.754 CC lib/ftl/base/ftl_base_dev.o 00:02:11.754 CC lib/ftl/base/ftl_base_bdev.o 00:02:11.754 CC lib/ftl/ftl_trace.o 00:02:12.013 LIB libspdk_nbd.a 00:02:12.013 SO libspdk_nbd.so.6.0 00:02:12.013 SYMLINK libspdk_nbd.so 00:02:12.013 LIB libspdk_scsi.a 00:02:12.270 SO libspdk_scsi.so.8.0 00:02:12.270 LIB libspdk_ublk.a 00:02:12.270 SO libspdk_ublk.so.2.0 00:02:12.270 SYMLINK libspdk_scsi.so 00:02:12.270 SYMLINK libspdk_ublk.so 00:02:12.271 CC lib/vhost/vhost.o 00:02:12.271 CC lib/iscsi/conn.o 00:02:12.271 CC lib/vhost/vhost_rpc.o 00:02:12.271 CC lib/vhost/vhost_scsi.o 00:02:12.271 CC lib/iscsi/init_grp.o 00:02:12.271 CC lib/vhost/vhost_blk.o 00:02:12.271 CC lib/iscsi/iscsi.o 00:02:12.271 CC lib/vhost/rte_vhost_user.o 00:02:12.271 CC lib/iscsi/md5.o 00:02:12.271 CC lib/iscsi/param.o 00:02:12.271 CC lib/iscsi/portal_grp.o 00:02:12.271 CC lib/iscsi/tgt_node.o 00:02:12.271 CC lib/iscsi/iscsi_subsystem.o 00:02:12.271 CC lib/iscsi/iscsi_rpc.o 00:02:12.271 CC lib/iscsi/task.o 00:02:12.528 LIB libspdk_ftl.a 00:02:12.528 SO libspdk_ftl.so.8.0 00:02:12.785 SYMLINK libspdk_ftl.so 00:02:13.719 LIB libspdk_vhost.a 00:02:13.719 SO libspdk_vhost.so.7.1 00:02:13.719 SYMLINK libspdk_vhost.so 00:02:13.719 LIB libspdk_nvmf.a 00:02:13.719 SO libspdk_nvmf.so.17.0 00:02:13.719 LIB libspdk_iscsi.a 00:02:13.719 SO libspdk_iscsi.so.7.0 00:02:13.977 SYMLINK libspdk_nvmf.so 00:02:13.977 SYMLINK libspdk_iscsi.so 00:02:14.236 CC module/env_dpdk/env_dpdk_rpc.o 00:02:14.236 CC module/accel/iaa/accel_iaa.o 00:02:14.236 CC module/accel/iaa/accel_iaa_rpc.o 00:02:14.236 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:14.236 CC module/scheduler/gscheduler/gscheduler.o 00:02:14.236 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:14.236 CC module/accel/dsa/accel_dsa.o 00:02:14.236 CC module/blob/bdev/blob_bdev.o 00:02:14.236 CC module/accel/ioat/accel_ioat.o 00:02:14.236 CC module/accel/error/accel_error.o 00:02:14.236 CC module/accel/dsa/accel_dsa_rpc.o 00:02:14.236 CC module/sock/posix/posix.o 00:02:14.236 CC module/accel/ioat/accel_ioat_rpc.o 00:02:14.236 CC module/accel/error/accel_error_rpc.o 00:02:14.236 LIB libspdk_env_dpdk_rpc.a 00:02:14.236 SO libspdk_env_dpdk_rpc.so.5.0 00:02:14.236 SYMLINK libspdk_env_dpdk_rpc.so 00:02:14.494 LIB libspdk_scheduler_gscheduler.a 00:02:14.494 LIB libspdk_scheduler_dpdk_governor.a 00:02:14.494 SO libspdk_scheduler_gscheduler.so.3.0 00:02:14.494 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:14.494 LIB libspdk_accel_error.a 00:02:14.494 LIB libspdk_accel_ioat.a 00:02:14.494 LIB libspdk_scheduler_dynamic.a 00:02:14.494 LIB libspdk_accel_iaa.a 00:02:14.494 SO libspdk_accel_error.so.1.0 00:02:14.494 SO libspdk_accel_ioat.so.5.0 00:02:14.494 SO libspdk_scheduler_dynamic.so.3.0 00:02:14.494 SYMLINK libspdk_scheduler_gscheduler.so 00:02:14.494 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:14.494 SO libspdk_accel_iaa.so.2.0 00:02:14.494 LIB libspdk_accel_dsa.a 00:02:14.494 SYMLINK libspdk_accel_error.so 00:02:14.494 SYMLINK libspdk_scheduler_dynamic.so 00:02:14.494 SYMLINK libspdk_accel_ioat.so 00:02:14.494 SO libspdk_accel_dsa.so.4.0 00:02:14.494 LIB libspdk_blob_bdev.a 00:02:14.494 SYMLINK libspdk_accel_iaa.so 00:02:14.494 SO libspdk_blob_bdev.so.10.1 00:02:14.494 SYMLINK libspdk_accel_dsa.so 00:02:14.494 SYMLINK libspdk_blob_bdev.so 00:02:14.754 CC module/bdev/lvol/vbdev_lvol.o 00:02:14.754 CC module/bdev/error/vbdev_error.o 00:02:14.754 CC module/bdev/gpt/gpt.o 00:02:14.754 CC module/bdev/nvme/bdev_nvme.o 00:02:14.754 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:14.754 CC module/bdev/gpt/vbdev_gpt.o 00:02:14.754 CC module/bdev/error/vbdev_error_rpc.o 00:02:14.754 CC module/bdev/delay/vbdev_delay.o 00:02:14.754 CC module/bdev/raid/bdev_raid.o 00:02:14.754 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:14.754 CC module/bdev/null/bdev_null.o 00:02:14.754 CC module/bdev/null/bdev_null_rpc.o 00:02:14.754 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:14.754 CC module/bdev/passthru/vbdev_passthru.o 00:02:14.754 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:14.754 CC module/bdev/nvme/nvme_rpc.o 00:02:14.754 CC module/bdev/raid/bdev_raid_rpc.o 00:02:14.754 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:14.754 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:14.754 CC module/bdev/malloc/bdev_malloc.o 00:02:14.754 CC module/bdev/nvme/bdev_mdns_client.o 00:02:14.754 CC module/bdev/raid/bdev_raid_sb.o 00:02:14.754 CC module/bdev/raid/raid0.o 00:02:14.754 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:14.754 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:14.754 CC module/bdev/nvme/vbdev_opal.o 00:02:14.754 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:14.754 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:14.754 CC module/bdev/raid/raid1.o 00:02:14.754 CC module/bdev/raid/concat.o 00:02:14.754 CC module/bdev/split/vbdev_split.o 00:02:14.754 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:14.754 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:14.754 CC module/bdev/split/vbdev_split_rpc.o 00:02:14.754 CC module/bdev/ftl/bdev_ftl.o 00:02:14.754 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:14.754 CC module/bdev/iscsi/bdev_iscsi.o 00:02:14.754 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:14.754 CC module/blobfs/bdev/blobfs_bdev.o 00:02:14.754 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:14.754 CC module/bdev/aio/bdev_aio.o 00:02:14.754 CC module/bdev/aio/bdev_aio_rpc.o 00:02:15.012 LIB libspdk_sock_posix.a 00:02:15.012 SO libspdk_sock_posix.so.5.0 00:02:15.012 LIB libspdk_bdev_null.a 00:02:15.012 LIB libspdk_blobfs_bdev.a 00:02:15.012 SYMLINK libspdk_sock_posix.so 00:02:15.012 SO libspdk_bdev_null.so.5.0 00:02:15.012 SO libspdk_blobfs_bdev.so.5.0 00:02:15.012 LIB libspdk_bdev_ftl.a 00:02:15.272 SO libspdk_bdev_ftl.so.5.0 00:02:15.272 SYMLINK libspdk_bdev_null.so 00:02:15.272 LIB libspdk_bdev_split.a 00:02:15.272 LIB libspdk_bdev_gpt.a 00:02:15.272 SYMLINK libspdk_blobfs_bdev.so 00:02:15.272 LIB libspdk_bdev_delay.a 00:02:15.272 LIB libspdk_bdev_malloc.a 00:02:15.272 SO libspdk_bdev_split.so.5.0 00:02:15.272 SO libspdk_bdev_gpt.so.5.0 00:02:15.272 SO libspdk_bdev_malloc.so.5.0 00:02:15.272 SO libspdk_bdev_delay.so.5.0 00:02:15.272 SYMLINK libspdk_bdev_ftl.so 00:02:15.272 LIB libspdk_bdev_zone_block.a 00:02:15.272 LIB libspdk_bdev_aio.a 00:02:15.272 LIB libspdk_bdev_error.a 00:02:15.272 SYMLINK libspdk_bdev_split.so 00:02:15.272 LIB libspdk_bdev_passthru.a 00:02:15.272 SYMLINK libspdk_bdev_gpt.so 00:02:15.272 SO libspdk_bdev_error.so.5.0 00:02:15.272 SO libspdk_bdev_aio.so.5.0 00:02:15.272 SO libspdk_bdev_zone_block.so.5.0 00:02:15.272 SYMLINK libspdk_bdev_malloc.so 00:02:15.272 SYMLINK libspdk_bdev_delay.so 00:02:15.272 SO libspdk_bdev_passthru.so.5.0 00:02:15.272 SYMLINK libspdk_bdev_error.so 00:02:15.272 SYMLINK libspdk_bdev_aio.so 00:02:15.272 SYMLINK libspdk_bdev_zone_block.so 00:02:15.272 LIB libspdk_bdev_iscsi.a 00:02:15.272 SYMLINK libspdk_bdev_passthru.so 00:02:15.272 SO libspdk_bdev_iscsi.so.5.0 00:02:15.272 SYMLINK libspdk_bdev_iscsi.so 00:02:15.531 LIB libspdk_bdev_lvol.a 00:02:15.531 SO libspdk_bdev_lvol.so.5.0 00:02:15.531 LIB libspdk_bdev_virtio.a 00:02:15.531 SYMLINK libspdk_bdev_lvol.so 00:02:15.531 SO libspdk_bdev_virtio.so.5.0 00:02:15.531 SYMLINK libspdk_bdev_virtio.so 00:02:15.789 LIB libspdk_bdev_raid.a 00:02:15.789 SO libspdk_bdev_raid.so.5.0 00:02:16.047 SYMLINK libspdk_bdev_raid.so 00:02:16.981 LIB libspdk_bdev_nvme.a 00:02:16.981 SO libspdk_bdev_nvme.so.6.0 00:02:17.238 SYMLINK libspdk_bdev_nvme.so 00:02:17.496 CC module/event/subsystems/vmd/vmd.o 00:02:17.496 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:17.496 CC module/event/subsystems/scheduler/scheduler.o 00:02:17.496 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:17.496 CC module/event/subsystems/iobuf/iobuf.o 00:02:17.496 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:17.496 CC module/event/subsystems/sock/sock.o 00:02:17.496 LIB libspdk_event_sock.a 00:02:17.496 LIB libspdk_event_vhost_blk.a 00:02:17.496 LIB libspdk_event_scheduler.a 00:02:17.496 LIB libspdk_event_vmd.a 00:02:17.496 SO libspdk_event_sock.so.4.0 00:02:17.496 LIB libspdk_event_iobuf.a 00:02:17.496 SO libspdk_event_scheduler.so.3.0 00:02:17.496 SO libspdk_event_vhost_blk.so.2.0 00:02:17.496 SO libspdk_event_vmd.so.5.0 00:02:17.496 SO libspdk_event_iobuf.so.2.0 00:02:17.496 SYMLINK libspdk_event_sock.so 00:02:17.496 SYMLINK libspdk_event_scheduler.so 00:02:17.496 SYMLINK libspdk_event_vhost_blk.so 00:02:17.496 SYMLINK libspdk_event_vmd.so 00:02:17.754 SYMLINK libspdk_event_iobuf.so 00:02:17.754 CC module/event/subsystems/accel/accel.o 00:02:18.012 LIB libspdk_event_accel.a 00:02:18.012 SO libspdk_event_accel.so.5.0 00:02:18.012 SYMLINK libspdk_event_accel.so 00:02:18.012 CC module/event/subsystems/bdev/bdev.o 00:02:18.270 LIB libspdk_event_bdev.a 00:02:18.270 SO libspdk_event_bdev.so.5.0 00:02:18.270 SYMLINK libspdk_event_bdev.so 00:02:18.528 CC module/event/subsystems/nbd/nbd.o 00:02:18.528 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:18.528 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:18.528 CC module/event/subsystems/scsi/scsi.o 00:02:18.528 CC module/event/subsystems/ublk/ublk.o 00:02:18.528 LIB libspdk_event_nbd.a 00:02:18.528 LIB libspdk_event_ublk.a 00:02:18.528 LIB libspdk_event_scsi.a 00:02:18.528 SO libspdk_event_nbd.so.5.0 00:02:18.528 SO libspdk_event_ublk.so.2.0 00:02:18.528 SO libspdk_event_scsi.so.5.0 00:02:18.528 SYMLINK libspdk_event_nbd.so 00:02:18.528 SYMLINK libspdk_event_ublk.so 00:02:18.528 SYMLINK libspdk_event_scsi.so 00:02:18.528 LIB libspdk_event_nvmf.a 00:02:18.786 SO libspdk_event_nvmf.so.5.0 00:02:18.786 SYMLINK libspdk_event_nvmf.so 00:02:18.786 CC module/event/subsystems/iscsi/iscsi.o 00:02:18.786 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:18.786 LIB libspdk_event_vhost_scsi.a 00:02:18.786 LIB libspdk_event_iscsi.a 00:02:19.045 SO libspdk_event_vhost_scsi.so.2.0 00:02:19.045 SO libspdk_event_iscsi.so.5.0 00:02:19.045 SYMLINK libspdk_event_vhost_scsi.so 00:02:19.045 SYMLINK libspdk_event_iscsi.so 00:02:19.045 SO libspdk.so.5.0 00:02:19.045 SYMLINK libspdk.so 00:02:19.307 CC app/trace_record/trace_record.o 00:02:19.307 CXX app/trace/trace.o 00:02:19.307 CC app/spdk_top/spdk_top.o 00:02:19.307 CC app/spdk_nvme_identify/identify.o 00:02:19.307 CC app/spdk_nvme_discover/discovery_aer.o 00:02:19.307 CC app/spdk_lspci/spdk_lspci.o 00:02:19.307 TEST_HEADER include/spdk/accel.h 00:02:19.307 TEST_HEADER include/spdk/accel_module.h 00:02:19.307 CC app/spdk_nvme_perf/perf.o 00:02:19.307 TEST_HEADER include/spdk/assert.h 00:02:19.307 CC test/rpc_client/rpc_client_test.o 00:02:19.307 TEST_HEADER include/spdk/barrier.h 00:02:19.307 TEST_HEADER include/spdk/base64.h 00:02:19.307 TEST_HEADER include/spdk/bdev.h 00:02:19.307 TEST_HEADER include/spdk/bdev_module.h 00:02:19.307 TEST_HEADER include/spdk/bdev_zone.h 00:02:19.307 TEST_HEADER include/spdk/bit_array.h 00:02:19.307 TEST_HEADER include/spdk/bit_pool.h 00:02:19.307 TEST_HEADER include/spdk/blob_bdev.h 00:02:19.307 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:19.307 TEST_HEADER include/spdk/blobfs.h 00:02:19.307 TEST_HEADER include/spdk/blob.h 00:02:19.307 TEST_HEADER include/spdk/conf.h 00:02:19.307 TEST_HEADER include/spdk/config.h 00:02:19.307 TEST_HEADER include/spdk/cpuset.h 00:02:19.307 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:19.307 CC app/spdk_dd/spdk_dd.o 00:02:19.307 TEST_HEADER include/spdk/crc16.h 00:02:19.307 TEST_HEADER include/spdk/crc32.h 00:02:19.307 CC app/nvmf_tgt/nvmf_main.o 00:02:19.307 TEST_HEADER include/spdk/crc64.h 00:02:19.307 TEST_HEADER include/spdk/dif.h 00:02:19.307 CC app/iscsi_tgt/iscsi_tgt.o 00:02:19.307 CC app/vhost/vhost.o 00:02:19.307 TEST_HEADER include/spdk/dma.h 00:02:19.307 TEST_HEADER include/spdk/endian.h 00:02:19.307 TEST_HEADER include/spdk/env_dpdk.h 00:02:19.307 CC examples/ioat/verify/verify.o 00:02:19.307 CC examples/idxd/perf/perf.o 00:02:19.307 TEST_HEADER include/spdk/env.h 00:02:19.307 CC examples/sock/hello_world/hello_sock.o 00:02:19.307 CC examples/nvme/hello_world/hello_world.o 00:02:19.307 CC app/fio/nvme/fio_plugin.o 00:02:19.307 CC examples/nvme/reconnect/reconnect.o 00:02:19.307 TEST_HEADER include/spdk/event.h 00:02:19.307 CC examples/ioat/perf/perf.o 00:02:19.307 CC examples/vmd/lsvmd/lsvmd.o 00:02:19.307 CC examples/accel/perf/accel_perf.o 00:02:19.307 CC examples/vmd/led/led.o 00:02:19.307 TEST_HEADER include/spdk/fd_group.h 00:02:19.308 CC examples/nvme/hotplug/hotplug.o 00:02:19.308 CC examples/nvme/arbitration/arbitration.o 00:02:19.308 TEST_HEADER include/spdk/fd.h 00:02:19.308 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:19.308 TEST_HEADER include/spdk/file.h 00:02:19.308 CC test/thread/poller_perf/poller_perf.o 00:02:19.308 TEST_HEADER include/spdk/ftl.h 00:02:19.308 TEST_HEADER include/spdk/gpt_spec.h 00:02:19.308 CC examples/util/zipf/zipf.o 00:02:19.308 CC test/env/vtophys/vtophys.o 00:02:19.308 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:19.308 TEST_HEADER include/spdk/hexlify.h 00:02:19.308 CC test/nvme/aer/aer.o 00:02:19.308 TEST_HEADER include/spdk/histogram_data.h 00:02:19.308 CC test/event/event_perf/event_perf.o 00:02:19.308 CC app/spdk_tgt/spdk_tgt.o 00:02:19.308 TEST_HEADER include/spdk/idxd.h 00:02:19.308 TEST_HEADER include/spdk/idxd_spec.h 00:02:19.308 TEST_HEADER include/spdk/init.h 00:02:19.308 TEST_HEADER include/spdk/ioat.h 00:02:19.308 TEST_HEADER include/spdk/ioat_spec.h 00:02:19.308 TEST_HEADER include/spdk/iscsi_spec.h 00:02:19.308 TEST_HEADER include/spdk/json.h 00:02:19.308 TEST_HEADER include/spdk/jsonrpc.h 00:02:19.308 TEST_HEADER include/spdk/likely.h 00:02:19.308 CC examples/bdev/hello_world/hello_bdev.o 00:02:19.308 TEST_HEADER include/spdk/log.h 00:02:19.308 TEST_HEADER include/spdk/lvol.h 00:02:19.308 CC app/fio/bdev/fio_plugin.o 00:02:19.308 CC examples/blob/hello_world/hello_blob.o 00:02:19.308 CC examples/thread/thread/thread_ex.o 00:02:19.308 TEST_HEADER include/spdk/memory.h 00:02:19.308 CC examples/bdev/bdevperf/bdevperf.o 00:02:19.308 CC test/blobfs/mkfs/mkfs.o 00:02:19.308 CC test/dma/test_dma/test_dma.o 00:02:19.308 CC examples/blob/cli/blobcli.o 00:02:19.308 TEST_HEADER include/spdk/mmio.h 00:02:19.308 CC test/accel/dif/dif.o 00:02:19.308 TEST_HEADER include/spdk/nbd.h 00:02:19.308 TEST_HEADER include/spdk/notify.h 00:02:19.308 TEST_HEADER include/spdk/nvme.h 00:02:19.308 TEST_HEADER include/spdk/nvme_intel.h 00:02:19.308 CC test/app/bdev_svc/bdev_svc.o 00:02:19.308 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:19.308 CC examples/nvmf/nvmf/nvmf.o 00:02:19.308 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:19.308 CC test/bdev/bdevio/bdevio.o 00:02:19.308 CC test/env/mem_callbacks/mem_callbacks.o 00:02:19.308 TEST_HEADER include/spdk/nvme_spec.h 00:02:19.308 CC test/lvol/esnap/esnap.o 00:02:19.308 TEST_HEADER include/spdk/nvme_zns.h 00:02:19.308 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:19.308 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:19.308 TEST_HEADER include/spdk/nvmf.h 00:02:19.308 TEST_HEADER include/spdk/nvmf_spec.h 00:02:19.308 TEST_HEADER include/spdk/nvmf_transport.h 00:02:19.308 TEST_HEADER include/spdk/opal.h 00:02:19.308 TEST_HEADER include/spdk/opal_spec.h 00:02:19.308 TEST_HEADER include/spdk/pci_ids.h 00:02:19.566 TEST_HEADER include/spdk/pipe.h 00:02:19.566 TEST_HEADER include/spdk/queue.h 00:02:19.566 TEST_HEADER include/spdk/reduce.h 00:02:19.566 TEST_HEADER include/spdk/rpc.h 00:02:19.566 TEST_HEADER include/spdk/scheduler.h 00:02:19.566 TEST_HEADER include/spdk/scsi.h 00:02:19.566 TEST_HEADER include/spdk/scsi_spec.h 00:02:19.566 TEST_HEADER include/spdk/sock.h 00:02:19.566 TEST_HEADER include/spdk/stdinc.h 00:02:19.566 TEST_HEADER include/spdk/string.h 00:02:19.566 TEST_HEADER include/spdk/thread.h 00:02:19.566 TEST_HEADER include/spdk/trace.h 00:02:19.566 TEST_HEADER include/spdk/trace_parser.h 00:02:19.566 TEST_HEADER include/spdk/tree.h 00:02:19.566 TEST_HEADER include/spdk/ublk.h 00:02:19.566 TEST_HEADER include/spdk/util.h 00:02:19.566 TEST_HEADER include/spdk/uuid.h 00:02:19.566 LINK spdk_lspci 00:02:19.566 TEST_HEADER include/spdk/version.h 00:02:19.566 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:19.566 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:19.566 TEST_HEADER include/spdk/vhost.h 00:02:19.566 TEST_HEADER include/spdk/vmd.h 00:02:19.566 TEST_HEADER include/spdk/xor.h 00:02:19.566 TEST_HEADER include/spdk/zipf.h 00:02:19.566 CXX test/cpp_headers/accel.o 00:02:19.566 LINK lsvmd 00:02:19.566 LINK led 00:02:19.566 LINK rpc_client_test 00:02:19.566 LINK spdk_nvme_discover 00:02:19.566 LINK vtophys 00:02:19.566 LINK event_perf 00:02:19.566 LINK interrupt_tgt 00:02:19.566 LINK nvmf_tgt 00:02:19.566 LINK zipf 00:02:19.566 LINK poller_perf 00:02:19.566 LINK vhost 00:02:19.566 LINK spdk_trace_record 00:02:19.566 LINK cmb_copy 00:02:19.566 LINK iscsi_tgt 00:02:19.833 LINK ioat_perf 00:02:19.833 LINK verify 00:02:19.833 LINK bdev_svc 00:02:19.833 LINK mkfs 00:02:19.833 LINK hello_world 00:02:19.833 LINK hello_sock 00:02:19.833 LINK spdk_tgt 00:02:19.833 LINK hotplug 00:02:19.833 LINK hello_blob 00:02:19.833 LINK hello_bdev 00:02:19.833 LINK thread 00:02:19.833 CXX test/cpp_headers/accel_module.o 00:02:19.833 LINK aer 00:02:19.833 CC examples/nvme/abort/abort.o 00:02:19.833 CXX test/cpp_headers/assert.o 00:02:19.833 CXX test/cpp_headers/barrier.o 00:02:19.833 CXX test/cpp_headers/base64.o 00:02:19.833 LINK arbitration 00:02:20.096 LINK nvmf 00:02:20.096 LINK idxd_perf 00:02:20.096 LINK reconnect 00:02:20.096 LINK spdk_dd 00:02:20.096 LINK spdk_trace 00:02:20.096 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:20.096 CC test/event/reactor/reactor.o 00:02:20.096 CC test/nvme/reset/reset.o 00:02:20.096 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:20.096 CXX test/cpp_headers/bdev.o 00:02:20.096 CC test/app/histogram_perf/histogram_perf.o 00:02:20.096 CC test/env/memory/memory_ut.o 00:02:20.096 CXX test/cpp_headers/bdev_module.o 00:02:20.096 LINK test_dma 00:02:20.096 CC test/event/reactor_perf/reactor_perf.o 00:02:20.096 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:20.096 LINK dif 00:02:20.096 LINK bdevio 00:02:20.096 CC test/app/jsoncat/jsoncat.o 00:02:20.096 CC test/app/stub/stub.o 00:02:20.096 CC test/nvme/sgl/sgl.o 00:02:20.096 CC test/env/pci/pci_ut.o 00:02:20.096 LINK accel_perf 00:02:20.096 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:20.096 CXX test/cpp_headers/bdev_zone.o 00:02:20.356 CXX test/cpp_headers/bit_array.o 00:02:20.356 CC test/event/app_repeat/app_repeat.o 00:02:20.356 LINK nvme_manage 00:02:20.356 CC test/nvme/e2edp/nvme_dp.o 00:02:20.356 CXX test/cpp_headers/bit_pool.o 00:02:20.356 CXX test/cpp_headers/blob_bdev.o 00:02:20.356 CXX test/cpp_headers/blobfs_bdev.o 00:02:20.356 CXX test/cpp_headers/blobfs.o 00:02:20.356 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:20.356 LINK spdk_bdev 00:02:20.356 CXX test/cpp_headers/blob.o 00:02:20.356 CXX test/cpp_headers/conf.o 00:02:20.356 LINK reactor 00:02:20.356 CC test/nvme/overhead/overhead.o 00:02:20.356 LINK blobcli 00:02:20.356 CC test/nvme/err_injection/err_injection.o 00:02:20.356 LINK spdk_nvme 00:02:20.356 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:20.356 CC test/nvme/startup/startup.o 00:02:20.356 CC test/event/scheduler/scheduler.o 00:02:20.356 LINK histogram_perf 00:02:20.356 LINK env_dpdk_post_init 00:02:20.356 LINK pmr_persistence 00:02:20.356 LINK reactor_perf 00:02:20.356 LINK jsoncat 00:02:20.356 CC test/nvme/reserve/reserve.o 00:02:20.356 CC test/nvme/simple_copy/simple_copy.o 00:02:20.618 LINK stub 00:02:20.618 CXX test/cpp_headers/config.o 00:02:20.618 CXX test/cpp_headers/cpuset.o 00:02:20.618 CXX test/cpp_headers/crc16.o 00:02:20.618 LINK reset 00:02:20.618 CXX test/cpp_headers/crc32.o 00:02:20.618 CXX test/cpp_headers/crc64.o 00:02:20.618 CXX test/cpp_headers/dif.o 00:02:20.618 LINK mem_callbacks 00:02:20.618 CXX test/cpp_headers/dma.o 00:02:20.618 CXX test/cpp_headers/endian.o 00:02:20.618 LINK app_repeat 00:02:20.618 CXX test/cpp_headers/env_dpdk.o 00:02:20.618 CC test/nvme/connect_stress/connect_stress.o 00:02:20.618 CC test/nvme/boot_partition/boot_partition.o 00:02:20.618 LINK abort 00:02:20.618 CC test/nvme/compliance/nvme_compliance.o 00:02:20.618 CXX test/cpp_headers/env.o 00:02:20.618 CXX test/cpp_headers/event.o 00:02:20.618 CXX test/cpp_headers/fd_group.o 00:02:20.618 LINK sgl 00:02:20.618 CXX test/cpp_headers/fd.o 00:02:20.618 CXX test/cpp_headers/file.o 00:02:20.618 CXX test/cpp_headers/ftl.o 00:02:20.618 CXX test/cpp_headers/gpt_spec.o 00:02:20.618 CC test/nvme/fused_ordering/fused_ordering.o 00:02:20.618 CXX test/cpp_headers/hexlify.o 00:02:20.618 LINK startup 00:02:20.618 LINK err_injection 00:02:20.618 CXX test/cpp_headers/histogram_data.o 00:02:20.618 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:20.618 CC test/nvme/fdp/fdp.o 00:02:20.881 CXX test/cpp_headers/idxd.o 00:02:20.881 CC test/nvme/cuse/cuse.o 00:02:20.881 CXX test/cpp_headers/idxd_spec.o 00:02:20.881 LINK nvme_dp 00:02:20.881 LINK spdk_nvme_perf 00:02:20.881 LINK scheduler 00:02:20.881 CXX test/cpp_headers/init.o 00:02:20.881 CXX test/cpp_headers/ioat.o 00:02:20.881 LINK spdk_nvme_identify 00:02:20.881 LINK bdevperf 00:02:20.881 LINK spdk_top 00:02:20.881 LINK overhead 00:02:20.881 CXX test/cpp_headers/ioat_spec.o 00:02:20.881 LINK reserve 00:02:20.881 CXX test/cpp_headers/iscsi_spec.o 00:02:20.881 CXX test/cpp_headers/json.o 00:02:20.881 CXX test/cpp_headers/jsonrpc.o 00:02:20.881 CXX test/cpp_headers/likely.o 00:02:20.881 LINK pci_ut 00:02:20.881 CXX test/cpp_headers/log.o 00:02:20.881 CXX test/cpp_headers/lvol.o 00:02:20.881 CXX test/cpp_headers/memory.o 00:02:20.881 LINK nvme_fuzz 00:02:20.881 CXX test/cpp_headers/mmio.o 00:02:20.881 CXX test/cpp_headers/nbd.o 00:02:20.881 LINK boot_partition 00:02:20.881 LINK simple_copy 00:02:20.881 LINK connect_stress 00:02:20.881 CXX test/cpp_headers/notify.o 00:02:20.881 CXX test/cpp_headers/nvme.o 00:02:20.881 CXX test/cpp_headers/nvme_intel.o 00:02:21.142 CXX test/cpp_headers/nvme_ocssd.o 00:02:21.142 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:21.142 CXX test/cpp_headers/nvme_spec.o 00:02:21.142 CXX test/cpp_headers/nvme_zns.o 00:02:21.142 CXX test/cpp_headers/nvmf_cmd.o 00:02:21.142 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:21.142 CXX test/cpp_headers/nvmf.o 00:02:21.142 CXX test/cpp_headers/nvmf_spec.o 00:02:21.142 CXX test/cpp_headers/nvmf_transport.o 00:02:21.142 LINK doorbell_aers 00:02:21.142 CXX test/cpp_headers/opal.o 00:02:21.142 CXX test/cpp_headers/opal_spec.o 00:02:21.142 LINK fused_ordering 00:02:21.142 LINK vhost_fuzz 00:02:21.142 CXX test/cpp_headers/pci_ids.o 00:02:21.142 CXX test/cpp_headers/pipe.o 00:02:21.142 CXX test/cpp_headers/queue.o 00:02:21.142 CXX test/cpp_headers/reduce.o 00:02:21.142 CXX test/cpp_headers/rpc.o 00:02:21.142 CXX test/cpp_headers/scheduler.o 00:02:21.142 CXX test/cpp_headers/scsi.o 00:02:21.142 CXX test/cpp_headers/scsi_spec.o 00:02:21.142 CXX test/cpp_headers/sock.o 00:02:21.142 CXX test/cpp_headers/stdinc.o 00:02:21.142 CXX test/cpp_headers/string.o 00:02:21.142 CXX test/cpp_headers/thread.o 00:02:21.142 CXX test/cpp_headers/trace.o 00:02:21.142 CXX test/cpp_headers/trace_parser.o 00:02:21.142 CXX test/cpp_headers/tree.o 00:02:21.142 CXX test/cpp_headers/ublk.o 00:02:21.142 CXX test/cpp_headers/util.o 00:02:21.142 CXX test/cpp_headers/uuid.o 00:02:21.142 CXX test/cpp_headers/version.o 00:02:21.142 CXX test/cpp_headers/vfio_user_pci.o 00:02:21.142 CXX test/cpp_headers/vfio_user_spec.o 00:02:21.404 CXX test/cpp_headers/vhost.o 00:02:21.404 CXX test/cpp_headers/vmd.o 00:02:21.404 CXX test/cpp_headers/xor.o 00:02:21.404 LINK nvme_compliance 00:02:21.404 CXX test/cpp_headers/zipf.o 00:02:21.404 LINK fdp 00:02:21.662 LINK memory_ut 00:02:22.229 LINK cuse 00:02:22.498 LINK iscsi_fuzz 00:02:25.027 LINK esnap 00:02:25.027 00:02:25.027 real 0m46.781s 00:02:25.027 user 9m39.990s 00:02:25.027 sys 2m8.739s 00:02:25.027 09:25:47 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:25.027 09:25:47 -- common/autotest_common.sh@10 -- $ set +x 00:02:25.027 ************************************ 00:02:25.027 END TEST make 00:02:25.027 ************************************ 00:02:25.286 09:25:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:25.286 09:25:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:25.286 09:25:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:25.286 09:25:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:25.286 09:25:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:25.286 09:25:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:25.286 09:25:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:25.286 09:25:47 -- scripts/common.sh@335 -- # IFS=.-: 00:02:25.286 09:25:47 -- scripts/common.sh@335 -- # read -ra ver1 00:02:25.286 09:25:47 -- scripts/common.sh@336 -- # IFS=.-: 00:02:25.286 09:25:47 -- scripts/common.sh@336 -- # read -ra ver2 00:02:25.286 09:25:47 -- scripts/common.sh@337 -- # local 'op=<' 00:02:25.286 09:25:47 -- scripts/common.sh@339 -- # ver1_l=2 00:02:25.286 09:25:47 -- scripts/common.sh@340 -- # ver2_l=1 00:02:25.286 09:25:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:25.286 09:25:47 -- scripts/common.sh@343 -- # case "$op" in 00:02:25.286 09:25:47 -- scripts/common.sh@344 -- # : 1 00:02:25.286 09:25:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:25.286 09:25:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:25.286 09:25:47 -- scripts/common.sh@364 -- # decimal 1 00:02:25.286 09:25:47 -- scripts/common.sh@352 -- # local d=1 00:02:25.286 09:25:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:25.286 09:25:47 -- scripts/common.sh@354 -- # echo 1 00:02:25.286 09:25:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:25.286 09:25:47 -- scripts/common.sh@365 -- # decimal 2 00:02:25.286 09:25:47 -- scripts/common.sh@352 -- # local d=2 00:02:25.286 09:25:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:25.286 09:25:47 -- scripts/common.sh@354 -- # echo 2 00:02:25.286 09:25:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:25.286 09:25:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:25.286 09:25:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:25.286 09:25:47 -- scripts/common.sh@367 -- # return 0 00:02:25.286 09:25:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:25.286 09:25:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:25.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:25.286 --rc genhtml_branch_coverage=1 00:02:25.286 --rc genhtml_function_coverage=1 00:02:25.286 --rc genhtml_legend=1 00:02:25.286 --rc geninfo_all_blocks=1 00:02:25.286 --rc geninfo_unexecuted_blocks=1 00:02:25.286 00:02:25.286 ' 00:02:25.286 09:25:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:25.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:25.286 --rc genhtml_branch_coverage=1 00:02:25.286 --rc genhtml_function_coverage=1 00:02:25.286 --rc genhtml_legend=1 00:02:25.286 --rc geninfo_all_blocks=1 00:02:25.286 --rc geninfo_unexecuted_blocks=1 00:02:25.286 00:02:25.286 ' 00:02:25.286 09:25:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:25.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:25.286 --rc genhtml_branch_coverage=1 00:02:25.286 --rc genhtml_function_coverage=1 00:02:25.286 --rc genhtml_legend=1 00:02:25.286 --rc geninfo_all_blocks=1 00:02:25.286 --rc geninfo_unexecuted_blocks=1 00:02:25.286 00:02:25.286 ' 00:02:25.286 09:25:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:25.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:25.286 --rc genhtml_branch_coverage=1 00:02:25.286 --rc genhtml_function_coverage=1 00:02:25.286 --rc genhtml_legend=1 00:02:25.287 --rc geninfo_all_blocks=1 00:02:25.287 --rc geninfo_unexecuted_blocks=1 00:02:25.287 00:02:25.287 ' 00:02:25.287 09:25:47 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:25.287 09:25:47 -- nvmf/common.sh@7 -- # uname -s 00:02:25.287 09:25:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:25.287 09:25:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:25.287 09:25:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:25.287 09:25:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:25.287 09:25:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:25.287 09:25:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:25.287 09:25:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:25.287 09:25:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:25.287 09:25:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:25.287 09:25:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:25.287 09:25:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:25.287 09:25:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:25.287 09:25:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:25.287 09:25:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:25.287 09:25:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:25.287 09:25:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:25.287 09:25:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:25.287 09:25:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:25.287 09:25:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:25.287 09:25:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:25.287 09:25:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:25.287 09:25:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:25.287 09:25:47 -- paths/export.sh@5 -- # export PATH 00:02:25.287 09:25:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:25.287 09:25:47 -- nvmf/common.sh@46 -- # : 0 00:02:25.287 09:25:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:25.287 09:25:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:25.287 09:25:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:25.287 09:25:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:25.287 09:25:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:25.287 09:25:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:25.287 09:25:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:25.287 09:25:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:25.287 09:25:47 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:25.287 09:25:47 -- spdk/autotest.sh@32 -- # uname -s 00:02:25.287 09:25:47 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:25.287 09:25:47 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:25.287 09:25:47 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:25.287 09:25:47 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:25.287 09:25:47 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:25.287 09:25:47 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:25.287 09:25:47 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:25.287 09:25:47 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:25.287 09:25:47 -- spdk/autotest.sh@48 -- # udevadm_pid=4065428 00:02:25.287 09:25:47 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:25.287 09:25:47 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:25.287 09:25:47 -- spdk/autotest.sh@54 -- # echo 4065430 00:02:25.287 09:25:47 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:25.287 09:25:47 -- spdk/autotest.sh@56 -- # echo 4065431 00:02:25.287 09:25:47 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:25.287 09:25:47 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:25.287 09:25:47 -- spdk/autotest.sh@60 -- # echo 4065432 00:02:25.287 09:25:47 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:25.287 09:25:47 -- spdk/autotest.sh@62 -- # echo 4065433 00:02:25.287 09:25:47 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:25.287 09:25:47 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:25.287 09:25:47 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:25.287 09:25:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:25.287 09:25:47 -- common/autotest_common.sh@10 -- # set +x 00:02:25.287 09:25:47 -- spdk/autotest.sh@70 -- # create_test_list 00:02:25.287 09:25:47 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:25.287 09:25:47 -- common/autotest_common.sh@10 -- # set +x 00:02:25.287 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:25.287 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:25.287 09:25:48 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:25.287 09:25:48 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:25.287 09:25:48 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:25.287 09:25:48 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:25.287 09:25:48 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:25.287 09:25:48 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:25.287 09:25:48 -- common/autotest_common.sh@1450 -- # uname 00:02:25.287 09:25:48 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:25.287 09:25:48 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:25.287 09:25:48 -- common/autotest_common.sh@1470 -- # uname 00:02:25.287 09:25:48 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:25.287 09:25:48 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:25.287 09:25:48 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:25.287 lcov: LCOV version 1.15 00:02:25.287 09:25:48 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:29.476 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:29.476 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:29.476 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:29.476 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:29.476 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:29.476 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:01.586 09:26:20 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:03:01.586 09:26:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:01.586 09:26:20 -- common/autotest_common.sh@10 -- # set +x 00:03:01.586 09:26:20 -- spdk/autotest.sh@89 -- # rm -f 00:03:01.586 09:26:20 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:01.586 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:03:01.586 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:03:01.586 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:03:01.586 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:03:01.586 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:03:01.586 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:03:01.586 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:03:01.586 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:03:01.586 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:03:01.586 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:03:01.586 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:03:01.586 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:03:01.586 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:03:01.586 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:03:01.586 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:03:01.586 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:03:01.586 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:03:01.586 09:26:21 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:03:01.586 09:26:21 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:01.586 09:26:21 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:01.586 09:26:21 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:01.586 09:26:21 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:01.586 09:26:21 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:01.586 09:26:21 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:01.586 09:26:21 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:01.586 09:26:21 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:01.586 09:26:21 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:03:01.586 09:26:21 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:03:01.586 09:26:21 -- spdk/autotest.sh@108 -- # grep -v p 00:03:01.586 09:26:21 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:01.586 09:26:21 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:03:01.586 09:26:21 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:03:01.586 09:26:21 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:01.586 09:26:21 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:01.586 No valid GPT data, bailing 00:03:01.586 09:26:21 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:01.587 09:26:21 -- scripts/common.sh@393 -- # pt= 00:03:01.587 09:26:21 -- scripts/common.sh@394 -- # return 1 00:03:01.587 09:26:21 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:01.587 1+0 records in 00:03:01.587 1+0 records out 00:03:01.587 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00163869 s, 640 MB/s 00:03:01.587 09:26:21 -- spdk/autotest.sh@116 -- # sync 00:03:01.587 09:26:21 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:01.587 09:26:21 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:01.587 09:26:21 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:01.587 09:26:23 -- spdk/autotest.sh@122 -- # uname -s 00:03:01.587 09:26:23 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:03:01.587 09:26:23 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:01.587 09:26:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:01.587 09:26:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:01.587 09:26:23 -- common/autotest_common.sh@10 -- # set +x 00:03:01.587 ************************************ 00:03:01.587 START TEST setup.sh 00:03:01.587 ************************************ 00:03:01.587 09:26:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:01.587 * Looking for test storage... 00:03:01.587 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:01.587 09:26:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:01.587 09:26:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:01.587 09:26:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:01.587 09:26:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:01.587 09:26:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:01.587 09:26:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:01.587 09:26:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:01.587 09:26:23 -- scripts/common.sh@335 -- # IFS=.-: 00:03:01.587 09:26:23 -- scripts/common.sh@335 -- # read -ra ver1 00:03:01.587 09:26:23 -- scripts/common.sh@336 -- # IFS=.-: 00:03:01.587 09:26:23 -- scripts/common.sh@336 -- # read -ra ver2 00:03:01.587 09:26:23 -- scripts/common.sh@337 -- # local 'op=<' 00:03:01.587 09:26:23 -- scripts/common.sh@339 -- # ver1_l=2 00:03:01.587 09:26:23 -- scripts/common.sh@340 -- # ver2_l=1 00:03:01.587 09:26:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:01.587 09:26:23 -- scripts/common.sh@343 -- # case "$op" in 00:03:01.587 09:26:23 -- scripts/common.sh@344 -- # : 1 00:03:01.587 09:26:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:01.587 09:26:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:01.587 09:26:23 -- scripts/common.sh@364 -- # decimal 1 00:03:01.587 09:26:23 -- scripts/common.sh@352 -- # local d=1 00:03:01.587 09:26:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:01.587 09:26:23 -- scripts/common.sh@354 -- # echo 1 00:03:01.587 09:26:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:01.587 09:26:23 -- scripts/common.sh@365 -- # decimal 2 00:03:01.587 09:26:23 -- scripts/common.sh@352 -- # local d=2 00:03:01.587 09:26:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:01.587 09:26:23 -- scripts/common.sh@354 -- # echo 2 00:03:01.587 09:26:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:01.587 09:26:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:01.587 09:26:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:01.587 09:26:23 -- scripts/common.sh@367 -- # return 0 00:03:01.587 09:26:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:01.587 09:26:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:01.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.587 --rc genhtml_branch_coverage=1 00:03:01.587 --rc genhtml_function_coverage=1 00:03:01.587 --rc genhtml_legend=1 00:03:01.587 --rc geninfo_all_blocks=1 00:03:01.587 --rc geninfo_unexecuted_blocks=1 00:03:01.587 00:03:01.587 ' 00:03:01.587 09:26:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:01.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.587 --rc genhtml_branch_coverage=1 00:03:01.587 --rc genhtml_function_coverage=1 00:03:01.587 --rc genhtml_legend=1 00:03:01.587 --rc geninfo_all_blocks=1 00:03:01.587 --rc geninfo_unexecuted_blocks=1 00:03:01.587 00:03:01.587 ' 00:03:01.587 09:26:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:01.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.587 --rc genhtml_branch_coverage=1 00:03:01.587 --rc genhtml_function_coverage=1 00:03:01.587 --rc genhtml_legend=1 00:03:01.587 --rc geninfo_all_blocks=1 00:03:01.587 --rc geninfo_unexecuted_blocks=1 00:03:01.587 00:03:01.587 ' 00:03:01.587 09:26:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:01.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.587 --rc genhtml_branch_coverage=1 00:03:01.587 --rc genhtml_function_coverage=1 00:03:01.587 --rc genhtml_legend=1 00:03:01.587 --rc geninfo_all_blocks=1 00:03:01.587 --rc geninfo_unexecuted_blocks=1 00:03:01.587 00:03:01.587 ' 00:03:01.587 09:26:23 -- setup/test-setup.sh@10 -- # uname -s 00:03:01.587 09:26:23 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:01.587 09:26:23 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:01.587 09:26:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:01.587 09:26:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:01.587 09:26:23 -- common/autotest_common.sh@10 -- # set +x 00:03:01.587 ************************************ 00:03:01.587 START TEST acl 00:03:01.587 ************************************ 00:03:01.587 09:26:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:01.587 * Looking for test storage... 00:03:01.587 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:01.587 09:26:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:01.587 09:26:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:01.587 09:26:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:01.587 09:26:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:01.587 09:26:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:01.587 09:26:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:01.587 09:26:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:01.587 09:26:23 -- scripts/common.sh@335 -- # IFS=.-: 00:03:01.587 09:26:23 -- scripts/common.sh@335 -- # read -ra ver1 00:03:01.587 09:26:23 -- scripts/common.sh@336 -- # IFS=.-: 00:03:01.587 09:26:23 -- scripts/common.sh@336 -- # read -ra ver2 00:03:01.587 09:26:23 -- scripts/common.sh@337 -- # local 'op=<' 00:03:01.587 09:26:23 -- scripts/common.sh@339 -- # ver1_l=2 00:03:01.587 09:26:23 -- scripts/common.sh@340 -- # ver2_l=1 00:03:01.587 09:26:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:01.587 09:26:23 -- scripts/common.sh@343 -- # case "$op" in 00:03:01.587 09:26:23 -- scripts/common.sh@344 -- # : 1 00:03:01.587 09:26:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:01.587 09:26:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:01.587 09:26:23 -- scripts/common.sh@364 -- # decimal 1 00:03:01.587 09:26:23 -- scripts/common.sh@352 -- # local d=1 00:03:01.587 09:26:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:01.587 09:26:23 -- scripts/common.sh@354 -- # echo 1 00:03:01.587 09:26:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:01.587 09:26:23 -- scripts/common.sh@365 -- # decimal 2 00:03:01.587 09:26:23 -- scripts/common.sh@352 -- # local d=2 00:03:01.587 09:26:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:01.587 09:26:23 -- scripts/common.sh@354 -- # echo 2 00:03:01.587 09:26:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:01.587 09:26:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:01.587 09:26:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:01.587 09:26:23 -- scripts/common.sh@367 -- # return 0 00:03:01.587 09:26:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:01.587 09:26:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:01.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.587 --rc genhtml_branch_coverage=1 00:03:01.587 --rc genhtml_function_coverage=1 00:03:01.587 --rc genhtml_legend=1 00:03:01.587 --rc geninfo_all_blocks=1 00:03:01.587 --rc geninfo_unexecuted_blocks=1 00:03:01.587 00:03:01.587 ' 00:03:01.587 09:26:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:01.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.587 --rc genhtml_branch_coverage=1 00:03:01.587 --rc genhtml_function_coverage=1 00:03:01.587 --rc genhtml_legend=1 00:03:01.587 --rc geninfo_all_blocks=1 00:03:01.587 --rc geninfo_unexecuted_blocks=1 00:03:01.587 00:03:01.587 ' 00:03:01.587 09:26:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:01.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.587 --rc genhtml_branch_coverage=1 00:03:01.587 --rc genhtml_function_coverage=1 00:03:01.587 --rc genhtml_legend=1 00:03:01.587 --rc geninfo_all_blocks=1 00:03:01.587 --rc geninfo_unexecuted_blocks=1 00:03:01.587 00:03:01.587 ' 00:03:01.587 09:26:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:01.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.587 --rc genhtml_branch_coverage=1 00:03:01.587 --rc genhtml_function_coverage=1 00:03:01.587 --rc genhtml_legend=1 00:03:01.587 --rc geninfo_all_blocks=1 00:03:01.587 --rc geninfo_unexecuted_blocks=1 00:03:01.587 00:03:01.587 ' 00:03:01.587 09:26:23 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:01.587 09:26:23 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:01.587 09:26:23 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:01.587 09:26:23 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:01.587 09:26:23 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:01.587 09:26:23 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:01.587 09:26:23 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:01.587 09:26:23 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:01.587 09:26:23 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:01.587 09:26:23 -- setup/acl.sh@12 -- # devs=() 00:03:01.588 09:26:23 -- setup/acl.sh@12 -- # declare -a devs 00:03:01.588 09:26:23 -- setup/acl.sh@13 -- # drivers=() 00:03:01.588 09:26:23 -- setup/acl.sh@13 -- # declare -A drivers 00:03:01.588 09:26:23 -- setup/acl.sh@51 -- # setup reset 00:03:01.588 09:26:23 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:01.588 09:26:23 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:02.521 09:26:25 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:02.521 09:26:25 -- setup/acl.sh@16 -- # local dev driver 00:03:02.521 09:26:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:02.521 09:26:25 -- setup/acl.sh@15 -- # setup output status 00:03:02.521 09:26:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:02.521 09:26:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:03.897 Hugepages 00:03:03.897 node hugesize free / total 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 00:03:03.897 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # continue 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:03.897 09:26:26 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:03.897 09:26:26 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:03.897 09:26:26 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:03.897 09:26:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:03.897 09:26:26 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:03.897 09:26:26 -- setup/acl.sh@54 -- # run_test denied denied 00:03:03.898 09:26:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:03.898 09:26:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:03.898 09:26:26 -- common/autotest_common.sh@10 -- # set +x 00:03:03.898 ************************************ 00:03:03.898 START TEST denied 00:03:03.898 ************************************ 00:03:03.898 09:26:26 -- common/autotest_common.sh@1114 -- # denied 00:03:03.898 09:26:26 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:03.898 09:26:26 -- setup/acl.sh@38 -- # setup output config 00:03:03.898 09:26:26 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:03.898 09:26:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:03.898 09:26:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:05.274 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:05.274 09:26:28 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:05.274 09:26:28 -- setup/acl.sh@28 -- # local dev driver 00:03:05.274 09:26:28 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:05.274 09:26:28 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:05.274 09:26:28 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:05.274 09:26:28 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:05.274 09:26:28 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:05.274 09:26:28 -- setup/acl.sh@41 -- # setup reset 00:03:05.274 09:26:28 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:05.274 09:26:28 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:07.822 00:03:07.822 real 0m3.957s 00:03:07.822 user 0m1.166s 00:03:07.822 sys 0m1.902s 00:03:07.822 09:26:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:07.822 09:26:30 -- common/autotest_common.sh@10 -- # set +x 00:03:07.822 ************************************ 00:03:07.822 END TEST denied 00:03:07.822 ************************************ 00:03:07.822 09:26:30 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:07.822 09:26:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:07.822 09:26:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:07.822 09:26:30 -- common/autotest_common.sh@10 -- # set +x 00:03:07.822 ************************************ 00:03:07.822 START TEST allowed 00:03:07.822 ************************************ 00:03:07.822 09:26:30 -- common/autotest_common.sh@1114 -- # allowed 00:03:07.822 09:26:30 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:07.822 09:26:30 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:07.822 09:26:30 -- setup/acl.sh@45 -- # setup output config 00:03:07.822 09:26:30 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:07.822 09:26:30 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:10.388 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:10.388 09:26:32 -- setup/acl.sh@47 -- # verify 00:03:10.388 09:26:32 -- setup/acl.sh@28 -- # local dev driver 00:03:10.388 09:26:32 -- setup/acl.sh@48 -- # setup reset 00:03:10.388 09:26:32 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:10.388 09:26:32 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:11.793 00:03:11.793 real 0m3.918s 00:03:11.793 user 0m1.001s 00:03:11.793 sys 0m1.795s 00:03:11.793 09:26:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:11.793 09:26:34 -- common/autotest_common.sh@10 -- # set +x 00:03:11.793 ************************************ 00:03:11.793 END TEST allowed 00:03:11.793 ************************************ 00:03:11.793 00:03:11.793 real 0m10.759s 00:03:11.793 user 0m3.330s 00:03:11.793 sys 0m5.508s 00:03:11.793 09:26:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:11.793 09:26:34 -- common/autotest_common.sh@10 -- # set +x 00:03:11.793 ************************************ 00:03:11.793 END TEST acl 00:03:11.793 ************************************ 00:03:11.793 09:26:34 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:11.793 09:26:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:11.793 09:26:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:11.793 09:26:34 -- common/autotest_common.sh@10 -- # set +x 00:03:11.793 ************************************ 00:03:11.793 START TEST hugepages 00:03:11.793 ************************************ 00:03:11.793 09:26:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:11.793 * Looking for test storage... 00:03:11.793 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:11.793 09:26:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:11.793 09:26:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:11.793 09:26:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:12.052 09:26:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:12.052 09:26:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:12.052 09:26:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:12.052 09:26:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:12.052 09:26:34 -- scripts/common.sh@335 -- # IFS=.-: 00:03:12.052 09:26:34 -- scripts/common.sh@335 -- # read -ra ver1 00:03:12.052 09:26:34 -- scripts/common.sh@336 -- # IFS=.-: 00:03:12.052 09:26:34 -- scripts/common.sh@336 -- # read -ra ver2 00:03:12.052 09:26:34 -- scripts/common.sh@337 -- # local 'op=<' 00:03:12.052 09:26:34 -- scripts/common.sh@339 -- # ver1_l=2 00:03:12.052 09:26:34 -- scripts/common.sh@340 -- # ver2_l=1 00:03:12.052 09:26:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:12.052 09:26:34 -- scripts/common.sh@343 -- # case "$op" in 00:03:12.052 09:26:34 -- scripts/common.sh@344 -- # : 1 00:03:12.052 09:26:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:12.052 09:26:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:12.052 09:26:34 -- scripts/common.sh@364 -- # decimal 1 00:03:12.052 09:26:34 -- scripts/common.sh@352 -- # local d=1 00:03:12.052 09:26:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:12.052 09:26:34 -- scripts/common.sh@354 -- # echo 1 00:03:12.052 09:26:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:12.052 09:26:34 -- scripts/common.sh@365 -- # decimal 2 00:03:12.052 09:26:34 -- scripts/common.sh@352 -- # local d=2 00:03:12.052 09:26:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:12.052 09:26:34 -- scripts/common.sh@354 -- # echo 2 00:03:12.052 09:26:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:12.052 09:26:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:12.052 09:26:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:12.052 09:26:34 -- scripts/common.sh@367 -- # return 0 00:03:12.052 09:26:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:12.052 09:26:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:12.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:12.052 --rc genhtml_branch_coverage=1 00:03:12.052 --rc genhtml_function_coverage=1 00:03:12.052 --rc genhtml_legend=1 00:03:12.052 --rc geninfo_all_blocks=1 00:03:12.052 --rc geninfo_unexecuted_blocks=1 00:03:12.052 00:03:12.052 ' 00:03:12.052 09:26:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:12.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:12.052 --rc genhtml_branch_coverage=1 00:03:12.052 --rc genhtml_function_coverage=1 00:03:12.052 --rc genhtml_legend=1 00:03:12.052 --rc geninfo_all_blocks=1 00:03:12.052 --rc geninfo_unexecuted_blocks=1 00:03:12.052 00:03:12.052 ' 00:03:12.052 09:26:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:12.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:12.052 --rc genhtml_branch_coverage=1 00:03:12.052 --rc genhtml_function_coverage=1 00:03:12.052 --rc genhtml_legend=1 00:03:12.052 --rc geninfo_all_blocks=1 00:03:12.052 --rc geninfo_unexecuted_blocks=1 00:03:12.052 00:03:12.052 ' 00:03:12.052 09:26:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:12.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:12.052 --rc genhtml_branch_coverage=1 00:03:12.052 --rc genhtml_function_coverage=1 00:03:12.052 --rc genhtml_legend=1 00:03:12.052 --rc geninfo_all_blocks=1 00:03:12.052 --rc geninfo_unexecuted_blocks=1 00:03:12.052 00:03:12.052 ' 00:03:12.052 09:26:34 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:12.052 09:26:34 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:12.052 09:26:34 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:12.052 09:26:34 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:12.052 09:26:34 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:12.052 09:26:34 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:12.052 09:26:34 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:12.052 09:26:34 -- setup/common.sh@18 -- # local node= 00:03:12.052 09:26:34 -- setup/common.sh@19 -- # local var val 00:03:12.052 09:26:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.052 09:26:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.052 09:26:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:12.052 09:26:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:12.052 09:26:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.052 09:26:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.052 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.052 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43060316 kB' 'MemAvailable: 46828504 kB' 'Buffers: 2708 kB' 'Cached: 10735888 kB' 'SwapCached: 0 kB' 'Active: 7447668 kB' 'Inactive: 3764480 kB' 'Active(anon): 7046380 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476832 kB' 'Mapped: 209088 kB' 'Shmem: 6572828 kB' 'KReclaimable: 191996 kB' 'Slab: 720376 kB' 'SReclaimable: 191996 kB' 'SUnreclaim: 528380 kB' 'KernelStack: 12720 kB' 'PageTables: 8284 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559284 kB' 'Committed_AS: 8106864 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198184 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.053 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.053 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # continue 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.054 09:26:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.054 09:26:34 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:12.054 09:26:34 -- setup/common.sh@33 -- # echo 2048 00:03:12.054 09:26:34 -- setup/common.sh@33 -- # return 0 00:03:12.054 09:26:34 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:12.054 09:26:34 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:12.054 09:26:34 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:12.054 09:26:34 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:12.054 09:26:34 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:12.054 09:26:34 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:12.054 09:26:34 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:12.054 09:26:34 -- setup/hugepages.sh@207 -- # get_nodes 00:03:12.054 09:26:34 -- setup/hugepages.sh@27 -- # local node 00:03:12.054 09:26:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:12.054 09:26:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:12.054 09:26:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:12.054 09:26:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:12.054 09:26:34 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:12.054 09:26:34 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:12.054 09:26:34 -- setup/hugepages.sh@208 -- # clear_hp 00:03:12.054 09:26:34 -- setup/hugepages.sh@37 -- # local node hp 00:03:12.054 09:26:34 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:12.054 09:26:34 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:12.054 09:26:34 -- setup/hugepages.sh@41 -- # echo 0 00:03:12.054 09:26:34 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:12.054 09:26:34 -- setup/hugepages.sh@41 -- # echo 0 00:03:12.054 09:26:34 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:12.054 09:26:34 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:12.054 09:26:34 -- setup/hugepages.sh@41 -- # echo 0 00:03:12.054 09:26:34 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:12.054 09:26:34 -- setup/hugepages.sh@41 -- # echo 0 00:03:12.054 09:26:34 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:12.054 09:26:34 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:12.054 09:26:34 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:12.054 09:26:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:12.054 09:26:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:12.054 09:26:34 -- common/autotest_common.sh@10 -- # set +x 00:03:12.054 ************************************ 00:03:12.054 START TEST default_setup 00:03:12.054 ************************************ 00:03:12.054 09:26:34 -- common/autotest_common.sh@1114 -- # default_setup 00:03:12.054 09:26:34 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:12.054 09:26:34 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:12.054 09:26:34 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:12.054 09:26:34 -- setup/hugepages.sh@51 -- # shift 00:03:12.054 09:26:34 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:12.054 09:26:34 -- setup/hugepages.sh@52 -- # local node_ids 00:03:12.054 09:26:34 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:12.054 09:26:34 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:12.054 09:26:34 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:12.054 09:26:34 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:12.054 09:26:34 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:12.054 09:26:34 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:12.054 09:26:34 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:12.054 09:26:34 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:12.054 09:26:34 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:12.054 09:26:34 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:12.054 09:26:34 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:12.054 09:26:34 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:12.054 09:26:34 -- setup/hugepages.sh@73 -- # return 0 00:03:12.054 09:26:34 -- setup/hugepages.sh@137 -- # setup output 00:03:12.054 09:26:34 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:12.054 09:26:34 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:13.427 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:13.427 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:13.427 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:13.427 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:13.427 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:13.427 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:13.427 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:13.427 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:13.427 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:13.427 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:13.427 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:13.427 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:13.427 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:13.427 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:13.427 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:13.427 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:14.367 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:14.367 09:26:37 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:14.367 09:26:37 -- setup/hugepages.sh@89 -- # local node 00:03:14.367 09:26:37 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:14.367 09:26:37 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:14.367 09:26:37 -- setup/hugepages.sh@92 -- # local surp 00:03:14.367 09:26:37 -- setup/hugepages.sh@93 -- # local resv 00:03:14.367 09:26:37 -- setup/hugepages.sh@94 -- # local anon 00:03:14.367 09:26:37 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:14.367 09:26:37 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:14.367 09:26:37 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:14.367 09:26:37 -- setup/common.sh@18 -- # local node= 00:03:14.367 09:26:37 -- setup/common.sh@19 -- # local var val 00:03:14.367 09:26:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.367 09:26:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.367 09:26:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.367 09:26:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.367 09:26:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.367 09:26:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45189660 kB' 'MemAvailable: 48957832 kB' 'Buffers: 2708 kB' 'Cached: 10735976 kB' 'SwapCached: 0 kB' 'Active: 7455364 kB' 'Inactive: 3764480 kB' 'Active(anon): 7054076 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484472 kB' 'Mapped: 209912 kB' 'Shmem: 6572916 kB' 'KReclaimable: 191964 kB' 'Slab: 720000 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528036 kB' 'KernelStack: 12672 kB' 'PageTables: 8240 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8115700 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198220 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.367 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.367 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.368 09:26:37 -- setup/common.sh@33 -- # echo 0 00:03:14.368 09:26:37 -- setup/common.sh@33 -- # return 0 00:03:14.368 09:26:37 -- setup/hugepages.sh@97 -- # anon=0 00:03:14.368 09:26:37 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:14.368 09:26:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.368 09:26:37 -- setup/common.sh@18 -- # local node= 00:03:14.368 09:26:37 -- setup/common.sh@19 -- # local var val 00:03:14.368 09:26:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.368 09:26:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.368 09:26:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.368 09:26:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.368 09:26:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.368 09:26:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45202204 kB' 'MemAvailable: 48970376 kB' 'Buffers: 2708 kB' 'Cached: 10735980 kB' 'SwapCached: 0 kB' 'Active: 7450296 kB' 'Inactive: 3764480 kB' 'Active(anon): 7049008 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479352 kB' 'Mapped: 209924 kB' 'Shmem: 6572920 kB' 'KReclaimable: 191964 kB' 'Slab: 720032 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528068 kB' 'KernelStack: 12736 kB' 'PageTables: 8296 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8111212 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198200 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.368 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.368 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.369 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.369 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.370 09:26:37 -- setup/common.sh@33 -- # echo 0 00:03:14.370 09:26:37 -- setup/common.sh@33 -- # return 0 00:03:14.370 09:26:37 -- setup/hugepages.sh@99 -- # surp=0 00:03:14.370 09:26:37 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:14.370 09:26:37 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:14.370 09:26:37 -- setup/common.sh@18 -- # local node= 00:03:14.370 09:26:37 -- setup/common.sh@19 -- # local var val 00:03:14.370 09:26:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.370 09:26:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.370 09:26:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.370 09:26:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.370 09:26:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.370 09:26:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45203020 kB' 'MemAvailable: 48971192 kB' 'Buffers: 2708 kB' 'Cached: 10735984 kB' 'SwapCached: 0 kB' 'Active: 7453228 kB' 'Inactive: 3764480 kB' 'Active(anon): 7051940 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482692 kB' 'Mapped: 209392 kB' 'Shmem: 6572924 kB' 'KReclaimable: 191964 kB' 'Slab: 720060 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528096 kB' 'KernelStack: 12720 kB' 'PageTables: 8156 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8114528 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198200 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.370 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.370 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.371 09:26:37 -- setup/common.sh@33 -- # echo 0 00:03:14.371 09:26:37 -- setup/common.sh@33 -- # return 0 00:03:14.371 09:26:37 -- setup/hugepages.sh@100 -- # resv=0 00:03:14.371 09:26:37 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:14.371 nr_hugepages=1024 00:03:14.371 09:26:37 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:14.371 resv_hugepages=0 00:03:14.371 09:26:37 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:14.371 surplus_hugepages=0 00:03:14.371 09:26:37 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:14.371 anon_hugepages=0 00:03:14.371 09:26:37 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:14.371 09:26:37 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:14.371 09:26:37 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:14.371 09:26:37 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:14.371 09:26:37 -- setup/common.sh@18 -- # local node= 00:03:14.371 09:26:37 -- setup/common.sh@19 -- # local var val 00:03:14.371 09:26:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.371 09:26:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.371 09:26:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.371 09:26:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.371 09:26:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.371 09:26:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.371 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.371 09:26:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45203448 kB' 'MemAvailable: 48971620 kB' 'Buffers: 2708 kB' 'Cached: 10736004 kB' 'SwapCached: 0 kB' 'Active: 7455048 kB' 'Inactive: 3764480 kB' 'Active(anon): 7053760 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484080 kB' 'Mapped: 209872 kB' 'Shmem: 6572944 kB' 'KReclaimable: 191964 kB' 'Slab: 720060 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528096 kB' 'KernelStack: 12736 kB' 'PageTables: 8240 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8115744 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198204 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.372 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.372 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.373 09:26:37 -- setup/common.sh@33 -- # echo 1024 00:03:14.373 09:26:37 -- setup/common.sh@33 -- # return 0 00:03:14.373 09:26:37 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:14.373 09:26:37 -- setup/hugepages.sh@112 -- # get_nodes 00:03:14.373 09:26:37 -- setup/hugepages.sh@27 -- # local node 00:03:14.373 09:26:37 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.373 09:26:37 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:14.373 09:26:37 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.373 09:26:37 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:14.373 09:26:37 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:14.373 09:26:37 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:14.373 09:26:37 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:14.373 09:26:37 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:14.373 09:26:37 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:14.373 09:26:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.373 09:26:37 -- setup/common.sh@18 -- # local node=0 00:03:14.373 09:26:37 -- setup/common.sh@19 -- # local var val 00:03:14.373 09:26:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.373 09:26:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.373 09:26:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:14.373 09:26:37 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:14.373 09:26:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.373 09:26:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27352380 kB' 'MemUsed: 5473476 kB' 'SwapCached: 0 kB' 'Active: 1928864 kB' 'Inactive: 157908 kB' 'Active(anon): 1786364 kB' 'Inactive(anon): 0 kB' 'Active(file): 142500 kB' 'Inactive(file): 157908 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1948600 kB' 'Mapped: 78920 kB' 'AnonPages: 141348 kB' 'Shmem: 1648192 kB' 'KernelStack: 7272 kB' 'PageTables: 4212 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 71688 kB' 'Slab: 390280 kB' 'SReclaimable: 71688 kB' 'SUnreclaim: 318592 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.373 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.373 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # continue 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.374 09:26:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.374 09:26:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.374 09:26:37 -- setup/common.sh@33 -- # echo 0 00:03:14.374 09:26:37 -- setup/common.sh@33 -- # return 0 00:03:14.374 09:26:37 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:14.374 09:26:37 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:14.374 09:26:37 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:14.374 09:26:37 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:14.374 09:26:37 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:14.374 node0=1024 expecting 1024 00:03:14.374 09:26:37 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:14.374 00:03:14.374 real 0m2.452s 00:03:14.374 user 0m0.628s 00:03:14.374 sys 0m0.959s 00:03:14.374 09:26:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:14.374 09:26:37 -- common/autotest_common.sh@10 -- # set +x 00:03:14.374 ************************************ 00:03:14.374 END TEST default_setup 00:03:14.374 ************************************ 00:03:14.374 09:26:37 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:14.374 09:26:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:14.374 09:26:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:14.374 09:26:37 -- common/autotest_common.sh@10 -- # set +x 00:03:14.374 ************************************ 00:03:14.374 START TEST per_node_1G_alloc 00:03:14.374 ************************************ 00:03:14.374 09:26:37 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:14.374 09:26:37 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:14.374 09:26:37 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:14.374 09:26:37 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:14.374 09:26:37 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:14.374 09:26:37 -- setup/hugepages.sh@51 -- # shift 00:03:14.374 09:26:37 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:14.374 09:26:37 -- setup/hugepages.sh@52 -- # local node_ids 00:03:14.374 09:26:37 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:14.374 09:26:37 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:14.374 09:26:37 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:14.374 09:26:37 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:14.374 09:26:37 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:14.374 09:26:37 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:14.374 09:26:37 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:14.374 09:26:37 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:14.374 09:26:37 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:14.374 09:26:37 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:14.374 09:26:37 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:14.374 09:26:37 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:14.374 09:26:37 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:14.374 09:26:37 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:14.374 09:26:37 -- setup/hugepages.sh@73 -- # return 0 00:03:14.374 09:26:37 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:14.374 09:26:37 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:14.374 09:26:37 -- setup/hugepages.sh@146 -- # setup output 00:03:14.374 09:26:37 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:14.374 09:26:37 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:15.753 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:15.753 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:15.753 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:15.753 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:15.753 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:15.753 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:15.753 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:15.753 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:15.753 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:15.753 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:15.753 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:15.753 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:15.753 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:15.753 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:15.753 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:15.753 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:15.753 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:15.753 09:26:38 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:15.753 09:26:38 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:15.753 09:26:38 -- setup/hugepages.sh@89 -- # local node 00:03:15.753 09:26:38 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:15.753 09:26:38 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:15.753 09:26:38 -- setup/hugepages.sh@92 -- # local surp 00:03:15.753 09:26:38 -- setup/hugepages.sh@93 -- # local resv 00:03:15.753 09:26:38 -- setup/hugepages.sh@94 -- # local anon 00:03:15.753 09:26:38 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:15.753 09:26:38 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:15.753 09:26:38 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:15.753 09:26:38 -- setup/common.sh@18 -- # local node= 00:03:15.753 09:26:38 -- setup/common.sh@19 -- # local var val 00:03:15.753 09:26:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.753 09:26:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.753 09:26:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.753 09:26:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.753 09:26:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.753 09:26:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.753 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.753 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.753 09:26:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45194616 kB' 'MemAvailable: 48962788 kB' 'Buffers: 2708 kB' 'Cached: 10736068 kB' 'SwapCached: 0 kB' 'Active: 7449756 kB' 'Inactive: 3764480 kB' 'Active(anon): 7048468 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478692 kB' 'Mapped: 209008 kB' 'Shmem: 6573008 kB' 'KReclaimable: 191964 kB' 'Slab: 720160 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528196 kB' 'KernelStack: 12720 kB' 'PageTables: 8124 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8109804 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:15.753 09:26:38 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.753 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.753 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.753 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.753 09:26:38 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.753 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.753 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.753 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.753 09:26:38 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.753 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.753 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.753 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.753 09:26:38 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.754 09:26:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.754 09:26:38 -- setup/common.sh@33 -- # echo 0 00:03:15.754 09:26:38 -- setup/common.sh@33 -- # return 0 00:03:15.754 09:26:38 -- setup/hugepages.sh@97 -- # anon=0 00:03:15.754 09:26:38 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:15.754 09:26:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:15.754 09:26:38 -- setup/common.sh@18 -- # local node= 00:03:15.754 09:26:38 -- setup/common.sh@19 -- # local var val 00:03:15.754 09:26:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.754 09:26:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.754 09:26:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.754 09:26:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.754 09:26:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.754 09:26:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.754 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45200004 kB' 'MemAvailable: 48968176 kB' 'Buffers: 2708 kB' 'Cached: 10736068 kB' 'SwapCached: 0 kB' 'Active: 7450308 kB' 'Inactive: 3764480 kB' 'Active(anon): 7049020 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479332 kB' 'Mapped: 209008 kB' 'Shmem: 6573008 kB' 'KReclaimable: 191964 kB' 'Slab: 720128 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528164 kB' 'KernelStack: 12720 kB' 'PageTables: 8132 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8109816 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.755 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.755 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.756 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.756 09:26:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.756 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.756 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.756 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.756 09:26:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.756 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.756 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.756 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.756 09:26:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.756 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.756 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.756 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.756 09:26:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.756 09:26:38 -- setup/common.sh@32 -- # continue 00:03:15.756 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.756 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.016 09:26:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.016 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.016 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.016 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.016 09:26:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.016 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.016 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.016 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.016 09:26:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.016 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.016 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.016 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.016 09:26:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.016 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.016 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.016 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.016 09:26:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.016 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.016 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.016 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.016 09:26:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.016 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.016 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.016 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.016 09:26:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.017 09:26:38 -- setup/common.sh@33 -- # echo 0 00:03:16.017 09:26:38 -- setup/common.sh@33 -- # return 0 00:03:16.017 09:26:38 -- setup/hugepages.sh@99 -- # surp=0 00:03:16.017 09:26:38 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:16.017 09:26:38 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:16.017 09:26:38 -- setup/common.sh@18 -- # local node= 00:03:16.017 09:26:38 -- setup/common.sh@19 -- # local var val 00:03:16.017 09:26:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.017 09:26:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.017 09:26:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.017 09:26:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.017 09:26:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.017 09:26:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45199364 kB' 'MemAvailable: 48967536 kB' 'Buffers: 2708 kB' 'Cached: 10736080 kB' 'SwapCached: 0 kB' 'Active: 7449300 kB' 'Inactive: 3764480 kB' 'Active(anon): 7048012 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478244 kB' 'Mapped: 208960 kB' 'Shmem: 6573020 kB' 'KReclaimable: 191964 kB' 'Slab: 720128 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528164 kB' 'KernelStack: 12752 kB' 'PageTables: 8208 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8109828 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.017 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.017 09:26:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.018 09:26:38 -- setup/common.sh@33 -- # echo 0 00:03:16.018 09:26:38 -- setup/common.sh@33 -- # return 0 00:03:16.018 09:26:38 -- setup/hugepages.sh@100 -- # resv=0 00:03:16.018 09:26:38 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:16.018 nr_hugepages=1024 00:03:16.018 09:26:38 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:16.018 resv_hugepages=0 00:03:16.018 09:26:38 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:16.018 surplus_hugepages=0 00:03:16.018 09:26:38 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:16.018 anon_hugepages=0 00:03:16.018 09:26:38 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:16.018 09:26:38 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:16.018 09:26:38 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:16.018 09:26:38 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:16.018 09:26:38 -- setup/common.sh@18 -- # local node= 00:03:16.018 09:26:38 -- setup/common.sh@19 -- # local var val 00:03:16.018 09:26:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.018 09:26:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.018 09:26:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.018 09:26:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.018 09:26:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.018 09:26:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45199364 kB' 'MemAvailable: 48967536 kB' 'Buffers: 2708 kB' 'Cached: 10736092 kB' 'SwapCached: 0 kB' 'Active: 7449968 kB' 'Inactive: 3764480 kB' 'Active(anon): 7048680 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478912 kB' 'Mapped: 208960 kB' 'Shmem: 6573032 kB' 'KReclaimable: 191964 kB' 'Slab: 720184 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528220 kB' 'KernelStack: 12768 kB' 'PageTables: 8268 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8109844 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.018 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.018 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.019 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.019 09:26:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.020 09:26:38 -- setup/common.sh@33 -- # echo 1024 00:03:16.020 09:26:38 -- setup/common.sh@33 -- # return 0 00:03:16.020 09:26:38 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:16.020 09:26:38 -- setup/hugepages.sh@112 -- # get_nodes 00:03:16.020 09:26:38 -- setup/hugepages.sh@27 -- # local node 00:03:16.020 09:26:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.020 09:26:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:16.020 09:26:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.020 09:26:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:16.020 09:26:38 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:16.020 09:26:38 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:16.020 09:26:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.020 09:26:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.020 09:26:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:16.020 09:26:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.020 09:26:38 -- setup/common.sh@18 -- # local node=0 00:03:16.020 09:26:38 -- setup/common.sh@19 -- # local var val 00:03:16.020 09:26:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.020 09:26:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.020 09:26:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:16.020 09:26:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:16.020 09:26:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.020 09:26:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28409124 kB' 'MemUsed: 4416732 kB' 'SwapCached: 0 kB' 'Active: 1929368 kB' 'Inactive: 157908 kB' 'Active(anon): 1786868 kB' 'Inactive(anon): 0 kB' 'Active(file): 142500 kB' 'Inactive(file): 157908 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1948616 kB' 'Mapped: 78924 kB' 'AnonPages: 141892 kB' 'Shmem: 1648208 kB' 'KernelStack: 7336 kB' 'PageTables: 4364 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 71688 kB' 'Slab: 390468 kB' 'SReclaimable: 71688 kB' 'SUnreclaim: 318780 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.020 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.020 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@33 -- # echo 0 00:03:16.021 09:26:38 -- setup/common.sh@33 -- # return 0 00:03:16.021 09:26:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.021 09:26:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.021 09:26:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.021 09:26:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:16.021 09:26:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.021 09:26:38 -- setup/common.sh@18 -- # local node=1 00:03:16.021 09:26:38 -- setup/common.sh@19 -- # local var val 00:03:16.021 09:26:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.021 09:26:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.021 09:26:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:16.021 09:26:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:16.021 09:26:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.021 09:26:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 16799060 kB' 'MemUsed: 10910748 kB' 'SwapCached: 0 kB' 'Active: 5520712 kB' 'Inactive: 3606572 kB' 'Active(anon): 5261924 kB' 'Inactive(anon): 0 kB' 'Active(file): 258788 kB' 'Inactive(file): 3606572 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8790212 kB' 'Mapped: 130036 kB' 'AnonPages: 337212 kB' 'Shmem: 4924852 kB' 'KernelStack: 5432 kB' 'PageTables: 3900 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 120276 kB' 'Slab: 329708 kB' 'SReclaimable: 120276 kB' 'SUnreclaim: 209432 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.021 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.021 09:26:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # continue 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.022 09:26:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.022 09:26:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.022 09:26:38 -- setup/common.sh@33 -- # echo 0 00:03:16.022 09:26:38 -- setup/common.sh@33 -- # return 0 00:03:16.022 09:26:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.022 09:26:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.022 09:26:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.022 09:26:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.022 09:26:38 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:16.022 node0=512 expecting 512 00:03:16.022 09:26:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.022 09:26:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.022 09:26:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.022 09:26:38 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:16.022 node1=512 expecting 512 00:03:16.022 09:26:38 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:16.022 00:03:16.022 real 0m1.507s 00:03:16.022 user 0m0.641s 00:03:16.022 sys 0m0.829s 00:03:16.022 09:26:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:16.022 09:26:38 -- common/autotest_common.sh@10 -- # set +x 00:03:16.022 ************************************ 00:03:16.022 END TEST per_node_1G_alloc 00:03:16.022 ************************************ 00:03:16.022 09:26:38 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:16.022 09:26:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:16.022 09:26:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:16.022 09:26:38 -- common/autotest_common.sh@10 -- # set +x 00:03:16.022 ************************************ 00:03:16.022 START TEST even_2G_alloc 00:03:16.022 ************************************ 00:03:16.022 09:26:38 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:16.022 09:26:38 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:16.022 09:26:38 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:16.022 09:26:38 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:16.022 09:26:38 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:16.022 09:26:38 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:16.022 09:26:38 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:16.022 09:26:38 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:16.022 09:26:38 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:16.022 09:26:38 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:16.022 09:26:38 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:16.022 09:26:38 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:16.022 09:26:38 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:16.022 09:26:38 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:16.022 09:26:38 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:16.022 09:26:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:16.022 09:26:38 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:16.022 09:26:38 -- setup/hugepages.sh@83 -- # : 512 00:03:16.022 09:26:38 -- setup/hugepages.sh@84 -- # : 1 00:03:16.022 09:26:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:16.022 09:26:38 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:16.022 09:26:38 -- setup/hugepages.sh@83 -- # : 0 00:03:16.022 09:26:38 -- setup/hugepages.sh@84 -- # : 0 00:03:16.022 09:26:38 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:16.022 09:26:38 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:16.022 09:26:38 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:16.022 09:26:38 -- setup/hugepages.sh@153 -- # setup output 00:03:16.022 09:26:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:16.022 09:26:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:17.401 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:17.401 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:17.401 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:17.401 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:17.401 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:17.401 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:17.401 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:17.401 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:17.401 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:17.401 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:17.401 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:17.401 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:17.401 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:17.401 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:17.401 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:17.401 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:17.401 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:17.401 09:26:40 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:17.401 09:26:40 -- setup/hugepages.sh@89 -- # local node 00:03:17.401 09:26:40 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:17.401 09:26:40 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:17.401 09:26:40 -- setup/hugepages.sh@92 -- # local surp 00:03:17.401 09:26:40 -- setup/hugepages.sh@93 -- # local resv 00:03:17.401 09:26:40 -- setup/hugepages.sh@94 -- # local anon 00:03:17.401 09:26:40 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:17.401 09:26:40 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:17.401 09:26:40 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:17.401 09:26:40 -- setup/common.sh@18 -- # local node= 00:03:17.401 09:26:40 -- setup/common.sh@19 -- # local var val 00:03:17.401 09:26:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.401 09:26:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.401 09:26:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.401 09:26:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.402 09:26:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.402 09:26:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45188940 kB' 'MemAvailable: 48957112 kB' 'Buffers: 2708 kB' 'Cached: 10736156 kB' 'SwapCached: 0 kB' 'Active: 7451140 kB' 'Inactive: 3764480 kB' 'Active(anon): 7049852 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480296 kB' 'Mapped: 208976 kB' 'Shmem: 6573096 kB' 'KReclaimable: 191964 kB' 'Slab: 720296 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528332 kB' 'KernelStack: 12784 kB' 'PageTables: 8252 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8109892 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.402 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.402 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.403 09:26:40 -- setup/common.sh@33 -- # echo 0 00:03:17.403 09:26:40 -- setup/common.sh@33 -- # return 0 00:03:17.403 09:26:40 -- setup/hugepages.sh@97 -- # anon=0 00:03:17.403 09:26:40 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:17.403 09:26:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.403 09:26:40 -- setup/common.sh@18 -- # local node= 00:03:17.403 09:26:40 -- setup/common.sh@19 -- # local var val 00:03:17.403 09:26:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.403 09:26:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.403 09:26:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.403 09:26:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.403 09:26:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.403 09:26:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45196096 kB' 'MemAvailable: 48964268 kB' 'Buffers: 2708 kB' 'Cached: 10736160 kB' 'SwapCached: 0 kB' 'Active: 7452448 kB' 'Inactive: 3764480 kB' 'Active(anon): 7051160 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481644 kB' 'Mapped: 208976 kB' 'Shmem: 6573100 kB' 'KReclaimable: 191964 kB' 'Slab: 720292 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528328 kB' 'KernelStack: 12800 kB' 'PageTables: 8304 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8109904 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.403 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.403 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.404 09:26:40 -- setup/common.sh@33 -- # echo 0 00:03:17.404 09:26:40 -- setup/common.sh@33 -- # return 0 00:03:17.404 09:26:40 -- setup/hugepages.sh@99 -- # surp=0 00:03:17.404 09:26:40 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:17.404 09:26:40 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:17.404 09:26:40 -- setup/common.sh@18 -- # local node= 00:03:17.404 09:26:40 -- setup/common.sh@19 -- # local var val 00:03:17.404 09:26:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.404 09:26:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.404 09:26:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.404 09:26:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.404 09:26:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.404 09:26:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45196188 kB' 'MemAvailable: 48964360 kB' 'Buffers: 2708 kB' 'Cached: 10736168 kB' 'SwapCached: 0 kB' 'Active: 7452772 kB' 'Inactive: 3764480 kB' 'Active(anon): 7051484 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481956 kB' 'Mapped: 208968 kB' 'Shmem: 6573108 kB' 'KReclaimable: 191964 kB' 'Slab: 720360 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528396 kB' 'KernelStack: 12784 kB' 'PageTables: 8256 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8109920 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.404 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.404 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.405 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.405 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.406 09:26:40 -- setup/common.sh@33 -- # echo 0 00:03:17.406 09:26:40 -- setup/common.sh@33 -- # return 0 00:03:17.406 09:26:40 -- setup/hugepages.sh@100 -- # resv=0 00:03:17.406 09:26:40 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:17.406 nr_hugepages=1024 00:03:17.406 09:26:40 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:17.406 resv_hugepages=0 00:03:17.406 09:26:40 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:17.406 surplus_hugepages=0 00:03:17.406 09:26:40 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:17.406 anon_hugepages=0 00:03:17.406 09:26:40 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.406 09:26:40 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:17.406 09:26:40 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:17.406 09:26:40 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:17.406 09:26:40 -- setup/common.sh@18 -- # local node= 00:03:17.406 09:26:40 -- setup/common.sh@19 -- # local var val 00:03:17.406 09:26:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.406 09:26:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.406 09:26:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.406 09:26:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.406 09:26:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.406 09:26:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45195992 kB' 'MemAvailable: 48964164 kB' 'Buffers: 2708 kB' 'Cached: 10736184 kB' 'SwapCached: 0 kB' 'Active: 7452528 kB' 'Inactive: 3764480 kB' 'Active(anon): 7051240 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481652 kB' 'Mapped: 208968 kB' 'Shmem: 6573124 kB' 'KReclaimable: 191964 kB' 'Slab: 720360 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528396 kB' 'KernelStack: 12768 kB' 'PageTables: 8204 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8109932 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.406 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.406 09:26:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.407 09:26:40 -- setup/common.sh@33 -- # echo 1024 00:03:17.407 09:26:40 -- setup/common.sh@33 -- # return 0 00:03:17.407 09:26:40 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.407 09:26:40 -- setup/hugepages.sh@112 -- # get_nodes 00:03:17.407 09:26:40 -- setup/hugepages.sh@27 -- # local node 00:03:17.407 09:26:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.407 09:26:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:17.407 09:26:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.407 09:26:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:17.407 09:26:40 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:17.407 09:26:40 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:17.407 09:26:40 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.407 09:26:40 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.407 09:26:40 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:17.407 09:26:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.407 09:26:40 -- setup/common.sh@18 -- # local node=0 00:03:17.407 09:26:40 -- setup/common.sh@19 -- # local var val 00:03:17.407 09:26:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.407 09:26:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.407 09:26:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:17.407 09:26:40 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:17.407 09:26:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.407 09:26:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28393784 kB' 'MemUsed: 4432072 kB' 'SwapCached: 0 kB' 'Active: 1930996 kB' 'Inactive: 157908 kB' 'Active(anon): 1788496 kB' 'Inactive(anon): 0 kB' 'Active(file): 142500 kB' 'Inactive(file): 157908 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1948628 kB' 'Mapped: 78932 kB' 'AnonPages: 143556 kB' 'Shmem: 1648220 kB' 'KernelStack: 7304 kB' 'PageTables: 4200 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 71688 kB' 'Slab: 390400 kB' 'SReclaimable: 71688 kB' 'SUnreclaim: 318712 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.407 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.407 09:26:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@33 -- # echo 0 00:03:17.408 09:26:40 -- setup/common.sh@33 -- # return 0 00:03:17.408 09:26:40 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:17.408 09:26:40 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.408 09:26:40 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.408 09:26:40 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:17.408 09:26:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.408 09:26:40 -- setup/common.sh@18 -- # local node=1 00:03:17.408 09:26:40 -- setup/common.sh@19 -- # local var val 00:03:17.408 09:26:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.408 09:26:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.408 09:26:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:17.408 09:26:40 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:17.408 09:26:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.408 09:26:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 16802520 kB' 'MemUsed: 10907288 kB' 'SwapCached: 0 kB' 'Active: 5521548 kB' 'Inactive: 3606572 kB' 'Active(anon): 5262760 kB' 'Inactive(anon): 0 kB' 'Active(file): 258788 kB' 'Inactive(file): 3606572 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8790292 kB' 'Mapped: 130036 kB' 'AnonPages: 338104 kB' 'Shmem: 4924932 kB' 'KernelStack: 5464 kB' 'PageTables: 4004 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 120276 kB' 'Slab: 329960 kB' 'SReclaimable: 120276 kB' 'SUnreclaim: 209684 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.408 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.408 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # continue 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.409 09:26:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.409 09:26:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.409 09:26:40 -- setup/common.sh@33 -- # echo 0 00:03:17.409 09:26:40 -- setup/common.sh@33 -- # return 0 00:03:17.409 09:26:40 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:17.409 09:26:40 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:17.409 09:26:40 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:17.409 09:26:40 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:17.409 09:26:40 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:17.409 node0=512 expecting 512 00:03:17.409 09:26:40 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:17.409 09:26:40 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:17.409 09:26:40 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:17.409 09:26:40 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:17.409 node1=512 expecting 512 00:03:17.409 09:26:40 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:17.409 00:03:17.409 real 0m1.482s 00:03:17.409 user 0m0.630s 00:03:17.409 sys 0m0.810s 00:03:17.409 09:26:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:17.409 09:26:40 -- common/autotest_common.sh@10 -- # set +x 00:03:17.409 ************************************ 00:03:17.409 END TEST even_2G_alloc 00:03:17.409 ************************************ 00:03:17.409 09:26:40 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:17.409 09:26:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:17.409 09:26:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:17.409 09:26:40 -- common/autotest_common.sh@10 -- # set +x 00:03:17.409 ************************************ 00:03:17.409 START TEST odd_alloc 00:03:17.409 ************************************ 00:03:17.409 09:26:40 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:17.409 09:26:40 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:17.409 09:26:40 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:17.409 09:26:40 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:17.409 09:26:40 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:17.409 09:26:40 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:17.409 09:26:40 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:17.410 09:26:40 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:17.410 09:26:40 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:17.410 09:26:40 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:17.410 09:26:40 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:17.410 09:26:40 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:17.410 09:26:40 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:17.410 09:26:40 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:17.410 09:26:40 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:17.410 09:26:40 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.410 09:26:40 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:17.410 09:26:40 -- setup/hugepages.sh@83 -- # : 513 00:03:17.410 09:26:40 -- setup/hugepages.sh@84 -- # : 1 00:03:17.410 09:26:40 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.410 09:26:40 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:17.410 09:26:40 -- setup/hugepages.sh@83 -- # : 0 00:03:17.410 09:26:40 -- setup/hugepages.sh@84 -- # : 0 00:03:17.410 09:26:40 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.410 09:26:40 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:17.410 09:26:40 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:17.410 09:26:40 -- setup/hugepages.sh@160 -- # setup output 00:03:17.410 09:26:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:17.410 09:26:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:18.793 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.794 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:18.794 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.794 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.794 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.794 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.794 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.794 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.794 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.794 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.794 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.794 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.794 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.794 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.794 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.794 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.794 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.794 09:26:41 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:18.794 09:26:41 -- setup/hugepages.sh@89 -- # local node 00:03:18.794 09:26:41 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:18.794 09:26:41 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:18.794 09:26:41 -- setup/hugepages.sh@92 -- # local surp 00:03:18.794 09:26:41 -- setup/hugepages.sh@93 -- # local resv 00:03:18.794 09:26:41 -- setup/hugepages.sh@94 -- # local anon 00:03:18.794 09:26:41 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:18.794 09:26:41 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:18.794 09:26:41 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:18.794 09:26:41 -- setup/common.sh@18 -- # local node= 00:03:18.794 09:26:41 -- setup/common.sh@19 -- # local var val 00:03:18.794 09:26:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.794 09:26:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.794 09:26:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.794 09:26:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.794 09:26:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.794 09:26:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45203188 kB' 'MemAvailable: 48971360 kB' 'Buffers: 2708 kB' 'Cached: 10736244 kB' 'SwapCached: 0 kB' 'Active: 7451812 kB' 'Inactive: 3764480 kB' 'Active(anon): 7050524 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480600 kB' 'Mapped: 207924 kB' 'Shmem: 6573184 kB' 'KReclaimable: 191964 kB' 'Slab: 720060 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528096 kB' 'KernelStack: 12928 kB' 'PageTables: 9020 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8098796 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.794 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.794 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.795 09:26:41 -- setup/common.sh@33 -- # echo 0 00:03:18.795 09:26:41 -- setup/common.sh@33 -- # return 0 00:03:18.795 09:26:41 -- setup/hugepages.sh@97 -- # anon=0 00:03:18.795 09:26:41 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:18.795 09:26:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.795 09:26:41 -- setup/common.sh@18 -- # local node= 00:03:18.795 09:26:41 -- setup/common.sh@19 -- # local var val 00:03:18.795 09:26:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.795 09:26:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.795 09:26:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.795 09:26:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.795 09:26:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.795 09:26:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45205072 kB' 'MemAvailable: 48973244 kB' 'Buffers: 2708 kB' 'Cached: 10736252 kB' 'SwapCached: 0 kB' 'Active: 7452216 kB' 'Inactive: 3764480 kB' 'Active(anon): 7050928 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481012 kB' 'Mapped: 207928 kB' 'Shmem: 6573192 kB' 'KReclaimable: 191964 kB' 'Slab: 720124 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528160 kB' 'KernelStack: 13120 kB' 'PageTables: 9152 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8098812 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.795 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.795 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.796 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.796 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.797 09:26:41 -- setup/common.sh@33 -- # echo 0 00:03:18.797 09:26:41 -- setup/common.sh@33 -- # return 0 00:03:18.797 09:26:41 -- setup/hugepages.sh@99 -- # surp=0 00:03:18.797 09:26:41 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:18.797 09:26:41 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:18.797 09:26:41 -- setup/common.sh@18 -- # local node= 00:03:18.797 09:26:41 -- setup/common.sh@19 -- # local var val 00:03:18.797 09:26:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.797 09:26:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.797 09:26:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.797 09:26:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.797 09:26:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.797 09:26:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45204008 kB' 'MemAvailable: 48972180 kB' 'Buffers: 2708 kB' 'Cached: 10736264 kB' 'SwapCached: 0 kB' 'Active: 7452480 kB' 'Inactive: 3764480 kB' 'Active(anon): 7051192 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481244 kB' 'Mapped: 207924 kB' 'Shmem: 6573204 kB' 'KReclaimable: 191964 kB' 'Slab: 720208 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528244 kB' 'KernelStack: 13104 kB' 'PageTables: 10524 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8098828 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.797 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.797 09:26:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.798 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.798 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.799 09:26:41 -- setup/common.sh@33 -- # echo 0 00:03:18.799 09:26:41 -- setup/common.sh@33 -- # return 0 00:03:18.799 09:26:41 -- setup/hugepages.sh@100 -- # resv=0 00:03:18.799 09:26:41 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:18.799 nr_hugepages=1025 00:03:18.799 09:26:41 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:18.799 resv_hugepages=0 00:03:18.799 09:26:41 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:18.799 surplus_hugepages=0 00:03:18.799 09:26:41 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:18.799 anon_hugepages=0 00:03:18.799 09:26:41 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:18.799 09:26:41 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:18.799 09:26:41 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:18.799 09:26:41 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:18.799 09:26:41 -- setup/common.sh@18 -- # local node= 00:03:18.799 09:26:41 -- setup/common.sh@19 -- # local var val 00:03:18.799 09:26:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.799 09:26:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.799 09:26:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.799 09:26:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.799 09:26:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.799 09:26:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45206836 kB' 'MemAvailable: 48975008 kB' 'Buffers: 2708 kB' 'Cached: 10736276 kB' 'SwapCached: 0 kB' 'Active: 7454188 kB' 'Inactive: 3764480 kB' 'Active(anon): 7052900 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482828 kB' 'Mapped: 208360 kB' 'Shmem: 6573216 kB' 'KReclaimable: 191964 kB' 'Slab: 720184 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 528220 kB' 'KernelStack: 12752 kB' 'PageTables: 8056 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8097648 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198216 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.799 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.799 09:26:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.800 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.800 09:26:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.800 09:26:41 -- setup/common.sh@33 -- # echo 1025 00:03:18.800 09:26:41 -- setup/common.sh@33 -- # return 0 00:03:18.800 09:26:41 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:18.800 09:26:41 -- setup/hugepages.sh@112 -- # get_nodes 00:03:18.800 09:26:41 -- setup/hugepages.sh@27 -- # local node 00:03:18.800 09:26:41 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.800 09:26:41 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:18.800 09:26:41 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.800 09:26:41 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:18.800 09:26:41 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:18.801 09:26:41 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:18.801 09:26:41 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:18.801 09:26:41 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.801 09:26:41 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:18.801 09:26:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.801 09:26:41 -- setup/common.sh@18 -- # local node=0 00:03:18.801 09:26:41 -- setup/common.sh@19 -- # local var val 00:03:18.801 09:26:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.801 09:26:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.801 09:26:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:18.801 09:26:41 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:18.801 09:26:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.801 09:26:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28407692 kB' 'MemUsed: 4418164 kB' 'SwapCached: 0 kB' 'Active: 1934632 kB' 'Inactive: 157908 kB' 'Active(anon): 1792132 kB' 'Inactive(anon): 0 kB' 'Active(file): 142500 kB' 'Inactive(file): 157908 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1948636 kB' 'Mapped: 78696 kB' 'AnonPages: 147016 kB' 'Shmem: 1648228 kB' 'KernelStack: 7240 kB' 'PageTables: 3924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 71688 kB' 'Slab: 390168 kB' 'SReclaimable: 71688 kB' 'SUnreclaim: 318480 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.801 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.801 09:26:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@33 -- # echo 0 00:03:18.802 09:26:41 -- setup/common.sh@33 -- # return 0 00:03:18.802 09:26:41 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:18.802 09:26:41 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:18.802 09:26:41 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.802 09:26:41 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:18.802 09:26:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.802 09:26:41 -- setup/common.sh@18 -- # local node=1 00:03:18.802 09:26:41 -- setup/common.sh@19 -- # local var val 00:03:18.802 09:26:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.802 09:26:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.802 09:26:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:18.802 09:26:41 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:18.802 09:26:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.802 09:26:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 16802092 kB' 'MemUsed: 10907716 kB' 'SwapCached: 0 kB' 'Active: 5520932 kB' 'Inactive: 3606572 kB' 'Active(anon): 5262144 kB' 'Inactive(anon): 0 kB' 'Active(file): 258788 kB' 'Inactive(file): 3606572 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8790380 kB' 'Mapped: 130012 kB' 'AnonPages: 337196 kB' 'Shmem: 4925020 kB' 'KernelStack: 5432 kB' 'PageTables: 3844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 120276 kB' 'Slab: 330088 kB' 'SReclaimable: 120276 kB' 'SUnreclaim: 209812 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.802 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.802 09:26:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # continue 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.803 09:26:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.803 09:26:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.803 09:26:41 -- setup/common.sh@33 -- # echo 0 00:03:18.803 09:26:41 -- setup/common.sh@33 -- # return 0 00:03:18.803 09:26:41 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:18.803 09:26:41 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:18.803 09:26:41 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:18.803 09:26:41 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:18.803 09:26:41 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:18.803 node0=512 expecting 513 00:03:18.803 09:26:41 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:18.803 09:26:41 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:18.803 09:26:41 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:18.803 09:26:41 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:18.803 node1=513 expecting 512 00:03:18.803 09:26:41 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:18.803 00:03:18.803 real 0m1.395s 00:03:18.803 user 0m0.595s 00:03:18.803 sys 0m0.762s 00:03:18.803 09:26:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:18.803 09:26:41 -- common/autotest_common.sh@10 -- # set +x 00:03:18.803 ************************************ 00:03:18.803 END TEST odd_alloc 00:03:18.803 ************************************ 00:03:19.063 09:26:41 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:19.063 09:26:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.063 09:26:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.063 09:26:41 -- common/autotest_common.sh@10 -- # set +x 00:03:19.063 ************************************ 00:03:19.063 START TEST custom_alloc 00:03:19.063 ************************************ 00:03:19.063 09:26:41 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:19.063 09:26:41 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:19.063 09:26:41 -- setup/hugepages.sh@169 -- # local node 00:03:19.063 09:26:41 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:19.063 09:26:41 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:19.063 09:26:41 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:19.063 09:26:41 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:19.063 09:26:41 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:19.063 09:26:41 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:19.063 09:26:41 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:19.063 09:26:41 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:19.063 09:26:41 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:19.063 09:26:41 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:19.063 09:26:41 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:19.063 09:26:41 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:19.063 09:26:41 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:19.063 09:26:41 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:19.063 09:26:41 -- setup/hugepages.sh@83 -- # : 256 00:03:19.063 09:26:41 -- setup/hugepages.sh@84 -- # : 1 00:03:19.063 09:26:41 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:19.063 09:26:41 -- setup/hugepages.sh@83 -- # : 0 00:03:19.063 09:26:41 -- setup/hugepages.sh@84 -- # : 0 00:03:19.063 09:26:41 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:19.063 09:26:41 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:19.063 09:26:41 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:19.063 09:26:41 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:19.063 09:26:41 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:19.063 09:26:41 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:19.063 09:26:41 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:19.063 09:26:41 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:19.063 09:26:41 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:19.063 09:26:41 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:19.063 09:26:41 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:19.063 09:26:41 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:19.063 09:26:41 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:19.063 09:26:41 -- setup/hugepages.sh@78 -- # return 0 00:03:19.063 09:26:41 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:19.063 09:26:41 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:19.063 09:26:41 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:19.063 09:26:41 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:19.063 09:26:41 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:19.063 09:26:41 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:19.063 09:26:41 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:19.063 09:26:41 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:19.063 09:26:41 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:19.063 09:26:41 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:19.063 09:26:41 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:19.063 09:26:41 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:19.063 09:26:41 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:19.063 09:26:41 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:19.063 09:26:41 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:19.063 09:26:41 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:19.063 09:26:41 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:19.063 09:26:41 -- setup/hugepages.sh@78 -- # return 0 00:03:19.063 09:26:41 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:19.063 09:26:41 -- setup/hugepages.sh@187 -- # setup output 00:03:19.063 09:26:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:19.063 09:26:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:20.001 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:20.001 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:20.001 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:20.001 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:20.001 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:20.001 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:20.001 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:20.001 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:20.001 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:20.001 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:20.001 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:20.001 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:20.001 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:20.001 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:20.001 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:20.001 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:20.001 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:20.263 09:26:42 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:20.263 09:26:42 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:20.263 09:26:42 -- setup/hugepages.sh@89 -- # local node 00:03:20.263 09:26:42 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:20.263 09:26:42 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:20.263 09:26:42 -- setup/hugepages.sh@92 -- # local surp 00:03:20.263 09:26:42 -- setup/hugepages.sh@93 -- # local resv 00:03:20.263 09:26:42 -- setup/hugepages.sh@94 -- # local anon 00:03:20.263 09:26:42 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:20.263 09:26:42 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:20.263 09:26:42 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:20.263 09:26:42 -- setup/common.sh@18 -- # local node= 00:03:20.263 09:26:42 -- setup/common.sh@19 -- # local var val 00:03:20.263 09:26:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.263 09:26:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.263 09:26:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.263 09:26:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.263 09:26:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.263 09:26:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.263 09:26:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.263 09:26:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44150340 kB' 'MemAvailable: 47918512 kB' 'Buffers: 2708 kB' 'Cached: 10736348 kB' 'SwapCached: 0 kB' 'Active: 7450676 kB' 'Inactive: 3764480 kB' 'Active(anon): 7049388 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479408 kB' 'Mapped: 208032 kB' 'Shmem: 6573288 kB' 'KReclaimable: 191964 kB' 'Slab: 719772 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 527808 kB' 'KernelStack: 12768 kB' 'PageTables: 8004 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8095000 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.263 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.263 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.264 09:26:43 -- setup/common.sh@33 -- # echo 0 00:03:20.264 09:26:43 -- setup/common.sh@33 -- # return 0 00:03:20.264 09:26:43 -- setup/hugepages.sh@97 -- # anon=0 00:03:20.264 09:26:43 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:20.264 09:26:43 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.264 09:26:43 -- setup/common.sh@18 -- # local node= 00:03:20.264 09:26:43 -- setup/common.sh@19 -- # local var val 00:03:20.264 09:26:43 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.264 09:26:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.264 09:26:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.264 09:26:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.264 09:26:43 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.264 09:26:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44149868 kB' 'MemAvailable: 47918040 kB' 'Buffers: 2708 kB' 'Cached: 10736352 kB' 'SwapCached: 0 kB' 'Active: 7450744 kB' 'Inactive: 3764480 kB' 'Active(anon): 7049456 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479472 kB' 'Mapped: 208000 kB' 'Shmem: 6573292 kB' 'KReclaimable: 191964 kB' 'Slab: 719748 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 527784 kB' 'KernelStack: 12736 kB' 'PageTables: 7904 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8095012 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.264 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.264 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.265 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.265 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.266 09:26:43 -- setup/common.sh@33 -- # echo 0 00:03:20.266 09:26:43 -- setup/common.sh@33 -- # return 0 00:03:20.266 09:26:43 -- setup/hugepages.sh@99 -- # surp=0 00:03:20.266 09:26:43 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:20.266 09:26:43 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:20.266 09:26:43 -- setup/common.sh@18 -- # local node= 00:03:20.266 09:26:43 -- setup/common.sh@19 -- # local var val 00:03:20.266 09:26:43 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.266 09:26:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.266 09:26:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.266 09:26:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.266 09:26:43 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.266 09:26:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44149616 kB' 'MemAvailable: 47917788 kB' 'Buffers: 2708 kB' 'Cached: 10736364 kB' 'SwapCached: 0 kB' 'Active: 7450652 kB' 'Inactive: 3764480 kB' 'Active(anon): 7049364 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479312 kB' 'Mapped: 207924 kB' 'Shmem: 6573304 kB' 'KReclaimable: 191964 kB' 'Slab: 719776 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 527812 kB' 'KernelStack: 12736 kB' 'PageTables: 7888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8095028 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.266 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.266 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.267 09:26:43 -- setup/common.sh@33 -- # echo 0 00:03:20.267 09:26:43 -- setup/common.sh@33 -- # return 0 00:03:20.267 09:26:43 -- setup/hugepages.sh@100 -- # resv=0 00:03:20.267 09:26:43 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:20.267 nr_hugepages=1536 00:03:20.267 09:26:43 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:20.267 resv_hugepages=0 00:03:20.267 09:26:43 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:20.267 surplus_hugepages=0 00:03:20.267 09:26:43 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:20.267 anon_hugepages=0 00:03:20.267 09:26:43 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:20.267 09:26:43 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:20.267 09:26:43 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:20.267 09:26:43 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:20.267 09:26:43 -- setup/common.sh@18 -- # local node= 00:03:20.267 09:26:43 -- setup/common.sh@19 -- # local var val 00:03:20.267 09:26:43 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.267 09:26:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.267 09:26:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.267 09:26:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.267 09:26:43 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.267 09:26:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44150220 kB' 'MemAvailable: 47918392 kB' 'Buffers: 2708 kB' 'Cached: 10736376 kB' 'SwapCached: 0 kB' 'Active: 7450640 kB' 'Inactive: 3764480 kB' 'Active(anon): 7049352 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479320 kB' 'Mapped: 207924 kB' 'Shmem: 6573316 kB' 'KReclaimable: 191964 kB' 'Slab: 719776 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 527812 kB' 'KernelStack: 12736 kB' 'PageTables: 7888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8095040 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.267 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.267 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.268 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.268 09:26:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.269 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.269 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.269 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.269 09:26:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.269 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.269 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.269 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.269 09:26:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.269 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.269 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.269 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.269 09:26:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.269 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.269 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.269 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.269 09:26:43 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.269 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.269 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.269 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.269 09:26:43 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.269 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.269 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.269 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.269 09:26:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.269 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.269 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.269 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.269 09:26:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.269 09:26:43 -- setup/common.sh@33 -- # echo 1536 00:03:20.269 09:26:43 -- setup/common.sh@33 -- # return 0 00:03:20.269 09:26:43 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:20.528 09:26:43 -- setup/hugepages.sh@112 -- # get_nodes 00:03:20.528 09:26:43 -- setup/hugepages.sh@27 -- # local node 00:03:20.528 09:26:43 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:20.528 09:26:43 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:20.528 09:26:43 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:20.528 09:26:43 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:20.528 09:26:43 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:20.528 09:26:43 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:20.528 09:26:43 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:20.528 09:26:43 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:20.528 09:26:43 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:20.528 09:26:43 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.528 09:26:43 -- setup/common.sh@18 -- # local node=0 00:03:20.528 09:26:43 -- setup/common.sh@19 -- # local var val 00:03:20.528 09:26:43 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.528 09:26:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.528 09:26:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:20.528 09:26:43 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:20.528 09:26:43 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.528 09:26:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.528 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.528 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28409056 kB' 'MemUsed: 4416800 kB' 'SwapCached: 0 kB' 'Active: 1929136 kB' 'Inactive: 157908 kB' 'Active(anon): 1786636 kB' 'Inactive(anon): 0 kB' 'Active(file): 142500 kB' 'Inactive(file): 157908 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1948648 kB' 'Mapped: 78548 kB' 'AnonPages: 141604 kB' 'Shmem: 1648240 kB' 'KernelStack: 7240 kB' 'PageTables: 3936 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 71688 kB' 'Slab: 390048 kB' 'SReclaimable: 71688 kB' 'SUnreclaim: 318360 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.529 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.529 09:26:43 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.529 09:26:43 -- setup/common.sh@33 -- # echo 0 00:03:20.529 09:26:43 -- setup/common.sh@33 -- # return 0 00:03:20.529 09:26:43 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:20.529 09:26:43 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:20.529 09:26:43 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:20.529 09:26:43 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:20.529 09:26:43 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.530 09:26:43 -- setup/common.sh@18 -- # local node=1 00:03:20.530 09:26:43 -- setup/common.sh@19 -- # local var val 00:03:20.530 09:26:43 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.530 09:26:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.530 09:26:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:20.530 09:26:43 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:20.530 09:26:43 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.530 09:26:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 15740940 kB' 'MemUsed: 11968868 kB' 'SwapCached: 0 kB' 'Active: 5521568 kB' 'Inactive: 3606572 kB' 'Active(anon): 5262780 kB' 'Inactive(anon): 0 kB' 'Active(file): 258788 kB' 'Inactive(file): 3606572 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8790464 kB' 'Mapped: 129376 kB' 'AnonPages: 337716 kB' 'Shmem: 4925104 kB' 'KernelStack: 5496 kB' 'PageTables: 3952 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 120276 kB' 'Slab: 329728 kB' 'SReclaimable: 120276 kB' 'SUnreclaim: 209452 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.530 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.530 09:26:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.531 09:26:43 -- setup/common.sh@32 -- # continue 00:03:20.531 09:26:43 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.531 09:26:43 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.531 09:26:43 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.531 09:26:43 -- setup/common.sh@33 -- # echo 0 00:03:20.531 09:26:43 -- setup/common.sh@33 -- # return 0 00:03:20.531 09:26:43 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:20.531 09:26:43 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.531 09:26:43 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.531 09:26:43 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.531 09:26:43 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:20.531 node0=512 expecting 512 00:03:20.531 09:26:43 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.531 09:26:43 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.531 09:26:43 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.531 09:26:43 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:20.531 node1=1024 expecting 1024 00:03:20.531 09:26:43 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:20.531 00:03:20.531 real 0m1.496s 00:03:20.531 user 0m0.640s 00:03:20.531 sys 0m0.813s 00:03:20.531 09:26:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:20.531 09:26:43 -- common/autotest_common.sh@10 -- # set +x 00:03:20.531 ************************************ 00:03:20.531 END TEST custom_alloc 00:03:20.531 ************************************ 00:03:20.531 09:26:43 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:20.531 09:26:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:20.531 09:26:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:20.531 09:26:43 -- common/autotest_common.sh@10 -- # set +x 00:03:20.531 ************************************ 00:03:20.531 START TEST no_shrink_alloc 00:03:20.531 ************************************ 00:03:20.531 09:26:43 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:20.531 09:26:43 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:20.531 09:26:43 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:20.531 09:26:43 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:20.531 09:26:43 -- setup/hugepages.sh@51 -- # shift 00:03:20.531 09:26:43 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:20.531 09:26:43 -- setup/hugepages.sh@52 -- # local node_ids 00:03:20.531 09:26:43 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:20.531 09:26:43 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:20.531 09:26:43 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:20.531 09:26:43 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:20.531 09:26:43 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:20.531 09:26:43 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:20.531 09:26:43 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:20.531 09:26:43 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:20.531 09:26:43 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:20.531 09:26:43 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:20.531 09:26:43 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:20.531 09:26:43 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:20.531 09:26:43 -- setup/hugepages.sh@73 -- # return 0 00:03:20.531 09:26:43 -- setup/hugepages.sh@198 -- # setup output 00:03:20.531 09:26:43 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:20.531 09:26:43 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:21.907 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:21.907 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:21.907 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:21.907 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:21.907 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:21.907 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:21.907 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:21.907 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:21.907 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:21.907 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:21.907 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:21.907 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:21.907 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:21.908 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:21.908 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:21.908 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:21.908 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:21.908 09:26:44 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:21.908 09:26:44 -- setup/hugepages.sh@89 -- # local node 00:03:21.908 09:26:44 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:21.908 09:26:44 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:21.908 09:26:44 -- setup/hugepages.sh@92 -- # local surp 00:03:21.908 09:26:44 -- setup/hugepages.sh@93 -- # local resv 00:03:21.908 09:26:44 -- setup/hugepages.sh@94 -- # local anon 00:03:21.908 09:26:44 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:21.908 09:26:44 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:21.908 09:26:44 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:21.908 09:26:44 -- setup/common.sh@18 -- # local node= 00:03:21.908 09:26:44 -- setup/common.sh@19 -- # local var val 00:03:21.908 09:26:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.908 09:26:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.908 09:26:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.908 09:26:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.908 09:26:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.908 09:26:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45155344 kB' 'MemAvailable: 48923516 kB' 'Buffers: 2708 kB' 'Cached: 10736440 kB' 'SwapCached: 0 kB' 'Active: 7451172 kB' 'Inactive: 3764480 kB' 'Active(anon): 7049884 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479732 kB' 'Mapped: 207968 kB' 'Shmem: 6573380 kB' 'KReclaimable: 191964 kB' 'Slab: 719820 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 527856 kB' 'KernelStack: 12752 kB' 'PageTables: 7944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8095224 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.908 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.908 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.909 09:26:44 -- setup/common.sh@33 -- # echo 0 00:03:21.909 09:26:44 -- setup/common.sh@33 -- # return 0 00:03:21.909 09:26:44 -- setup/hugepages.sh@97 -- # anon=0 00:03:21.909 09:26:44 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:21.909 09:26:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.909 09:26:44 -- setup/common.sh@18 -- # local node= 00:03:21.909 09:26:44 -- setup/common.sh@19 -- # local var val 00:03:21.909 09:26:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.909 09:26:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.909 09:26:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.909 09:26:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.909 09:26:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.909 09:26:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45158180 kB' 'MemAvailable: 48926352 kB' 'Buffers: 2708 kB' 'Cached: 10736444 kB' 'SwapCached: 0 kB' 'Active: 7451268 kB' 'Inactive: 3764480 kB' 'Active(anon): 7049980 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479796 kB' 'Mapped: 207968 kB' 'Shmem: 6573384 kB' 'KReclaimable: 191964 kB' 'Slab: 719820 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 527856 kB' 'KernelStack: 12736 kB' 'PageTables: 7848 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8095236 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.909 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.909 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.910 09:26:44 -- setup/common.sh@33 -- # echo 0 00:03:21.910 09:26:44 -- setup/common.sh@33 -- # return 0 00:03:21.910 09:26:44 -- setup/hugepages.sh@99 -- # surp=0 00:03:21.910 09:26:44 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:21.910 09:26:44 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:21.910 09:26:44 -- setup/common.sh@18 -- # local node= 00:03:21.910 09:26:44 -- setup/common.sh@19 -- # local var val 00:03:21.910 09:26:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.910 09:26:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.910 09:26:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.910 09:26:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.910 09:26:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.910 09:26:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45158728 kB' 'MemAvailable: 48926900 kB' 'Buffers: 2708 kB' 'Cached: 10736452 kB' 'SwapCached: 0 kB' 'Active: 7451112 kB' 'Inactive: 3764480 kB' 'Active(anon): 7049824 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479660 kB' 'Mapped: 207932 kB' 'Shmem: 6573392 kB' 'KReclaimable: 191964 kB' 'Slab: 719836 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 527872 kB' 'KernelStack: 12736 kB' 'PageTables: 7848 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8095252 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.910 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.910 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.911 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.911 09:26:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.912 09:26:44 -- setup/common.sh@33 -- # echo 0 00:03:21.912 09:26:44 -- setup/common.sh@33 -- # return 0 00:03:21.912 09:26:44 -- setup/hugepages.sh@100 -- # resv=0 00:03:21.912 09:26:44 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:21.912 nr_hugepages=1024 00:03:21.912 09:26:44 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:21.912 resv_hugepages=0 00:03:21.912 09:26:44 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:21.912 surplus_hugepages=0 00:03:21.912 09:26:44 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:21.912 anon_hugepages=0 00:03:21.912 09:26:44 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:21.912 09:26:44 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:21.912 09:26:44 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:21.912 09:26:44 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:21.912 09:26:44 -- setup/common.sh@18 -- # local node= 00:03:21.912 09:26:44 -- setup/common.sh@19 -- # local var val 00:03:21.912 09:26:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.912 09:26:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.912 09:26:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.912 09:26:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.912 09:26:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.912 09:26:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45158736 kB' 'MemAvailable: 48926908 kB' 'Buffers: 2708 kB' 'Cached: 10736468 kB' 'SwapCached: 0 kB' 'Active: 7450876 kB' 'Inactive: 3764480 kB' 'Active(anon): 7049588 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479400 kB' 'Mapped: 207932 kB' 'Shmem: 6573408 kB' 'KReclaimable: 191964 kB' 'Slab: 719836 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 527872 kB' 'KernelStack: 12752 kB' 'PageTables: 7900 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8095268 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.912 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.912 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.913 09:26:44 -- setup/common.sh@33 -- # echo 1024 00:03:21.913 09:26:44 -- setup/common.sh@33 -- # return 0 00:03:21.913 09:26:44 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:21.913 09:26:44 -- setup/hugepages.sh@112 -- # get_nodes 00:03:21.913 09:26:44 -- setup/hugepages.sh@27 -- # local node 00:03:21.913 09:26:44 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.913 09:26:44 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:21.913 09:26:44 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.913 09:26:44 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:21.913 09:26:44 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:21.913 09:26:44 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:21.913 09:26:44 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:21.913 09:26:44 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:21.913 09:26:44 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:21.913 09:26:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.913 09:26:44 -- setup/common.sh@18 -- # local node=0 00:03:21.913 09:26:44 -- setup/common.sh@19 -- # local var val 00:03:21.913 09:26:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.913 09:26:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.913 09:26:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:21.913 09:26:44 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:21.913 09:26:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.913 09:26:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27350912 kB' 'MemUsed: 5474944 kB' 'SwapCached: 0 kB' 'Active: 1929196 kB' 'Inactive: 157908 kB' 'Active(anon): 1786696 kB' 'Inactive(anon): 0 kB' 'Active(file): 142500 kB' 'Inactive(file): 157908 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1948660 kB' 'Mapped: 78556 kB' 'AnonPages: 141588 kB' 'Shmem: 1648252 kB' 'KernelStack: 7256 kB' 'PageTables: 3896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 71688 kB' 'Slab: 390136 kB' 'SReclaimable: 71688 kB' 'SUnreclaim: 318448 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.913 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.913 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # continue 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.914 09:26:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.914 09:26:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.914 09:26:44 -- setup/common.sh@33 -- # echo 0 00:03:21.914 09:26:44 -- setup/common.sh@33 -- # return 0 00:03:21.914 09:26:44 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:21.914 09:26:44 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:21.914 09:26:44 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:21.914 09:26:44 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:21.914 09:26:44 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:21.914 node0=1024 expecting 1024 00:03:21.914 09:26:44 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:21.914 09:26:44 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:21.914 09:26:44 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:21.914 09:26:44 -- setup/hugepages.sh@202 -- # setup output 00:03:21.914 09:26:44 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:21.914 09:26:44 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:23.288 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:23.288 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:23.288 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:23.288 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:23.288 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:23.288 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:23.288 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:23.288 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:23.288 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:23.288 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:23.288 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:23.288 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:23.288 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:23.288 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:23.288 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:23.288 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:23.288 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:23.288 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:23.288 09:26:45 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:23.288 09:26:45 -- setup/hugepages.sh@89 -- # local node 00:03:23.288 09:26:45 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:23.288 09:26:45 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:23.288 09:26:45 -- setup/hugepages.sh@92 -- # local surp 00:03:23.288 09:26:45 -- setup/hugepages.sh@93 -- # local resv 00:03:23.288 09:26:45 -- setup/hugepages.sh@94 -- # local anon 00:03:23.288 09:26:45 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:23.288 09:26:45 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:23.288 09:26:45 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:23.288 09:26:45 -- setup/common.sh@18 -- # local node= 00:03:23.288 09:26:45 -- setup/common.sh@19 -- # local var val 00:03:23.288 09:26:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.288 09:26:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.288 09:26:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.288 09:26:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.288 09:26:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.288 09:26:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45170236 kB' 'MemAvailable: 48938408 kB' 'Buffers: 2708 kB' 'Cached: 10736512 kB' 'SwapCached: 0 kB' 'Active: 7451320 kB' 'Inactive: 3764480 kB' 'Active(anon): 7050032 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479820 kB' 'Mapped: 208016 kB' 'Shmem: 6573452 kB' 'KReclaimable: 191964 kB' 'Slab: 719840 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 527876 kB' 'KernelStack: 12752 kB' 'PageTables: 7864 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8094928 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.288 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.288 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.289 09:26:45 -- setup/common.sh@33 -- # echo 0 00:03:23.289 09:26:45 -- setup/common.sh@33 -- # return 0 00:03:23.289 09:26:45 -- setup/hugepages.sh@97 -- # anon=0 00:03:23.289 09:26:45 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:23.289 09:26:45 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.289 09:26:45 -- setup/common.sh@18 -- # local node= 00:03:23.289 09:26:45 -- setup/common.sh@19 -- # local var val 00:03:23.289 09:26:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.289 09:26:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.289 09:26:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.289 09:26:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.289 09:26:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.289 09:26:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45171980 kB' 'MemAvailable: 48940152 kB' 'Buffers: 2708 kB' 'Cached: 10736512 kB' 'SwapCached: 0 kB' 'Active: 7451960 kB' 'Inactive: 3764480 kB' 'Active(anon): 7050672 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480492 kB' 'Mapped: 208068 kB' 'Shmem: 6573452 kB' 'KReclaimable: 191964 kB' 'Slab: 719840 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 527876 kB' 'KernelStack: 12768 kB' 'PageTables: 7924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8094940 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.289 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.289 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.290 09:26:45 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.290 09:26:45 -- setup/common.sh@33 -- # echo 0 00:03:23.290 09:26:45 -- setup/common.sh@33 -- # return 0 00:03:23.290 09:26:45 -- setup/hugepages.sh@99 -- # surp=0 00:03:23.290 09:26:45 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:23.290 09:26:45 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:23.290 09:26:45 -- setup/common.sh@18 -- # local node= 00:03:23.290 09:26:45 -- setup/common.sh@19 -- # local var val 00:03:23.290 09:26:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.290 09:26:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.290 09:26:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.290 09:26:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.290 09:26:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.290 09:26:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.290 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45172900 kB' 'MemAvailable: 48941072 kB' 'Buffers: 2708 kB' 'Cached: 10736528 kB' 'SwapCached: 0 kB' 'Active: 7451324 kB' 'Inactive: 3764480 kB' 'Active(anon): 7050036 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479800 kB' 'Mapped: 207940 kB' 'Shmem: 6573468 kB' 'KReclaimable: 191964 kB' 'Slab: 719840 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 527876 kB' 'KernelStack: 12768 kB' 'PageTables: 7856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8098896 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.291 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.291 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.292 09:26:45 -- setup/common.sh@33 -- # echo 0 00:03:23.292 09:26:45 -- setup/common.sh@33 -- # return 0 00:03:23.292 09:26:45 -- setup/hugepages.sh@100 -- # resv=0 00:03:23.292 09:26:45 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:23.292 nr_hugepages=1024 00:03:23.292 09:26:45 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:23.292 resv_hugepages=0 00:03:23.292 09:26:45 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:23.292 surplus_hugepages=0 00:03:23.292 09:26:45 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:23.292 anon_hugepages=0 00:03:23.292 09:26:45 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.292 09:26:45 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:23.292 09:26:45 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:23.292 09:26:45 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:23.292 09:26:45 -- setup/common.sh@18 -- # local node= 00:03:23.292 09:26:45 -- setup/common.sh@19 -- # local var val 00:03:23.292 09:26:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.292 09:26:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.292 09:26:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.292 09:26:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.292 09:26:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.292 09:26:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45187968 kB' 'MemAvailable: 48956140 kB' 'Buffers: 2708 kB' 'Cached: 10736528 kB' 'SwapCached: 0 kB' 'Active: 7451552 kB' 'Inactive: 3764480 kB' 'Active(anon): 7050264 kB' 'Inactive(anon): 0 kB' 'Active(file): 401288 kB' 'Inactive(file): 3764480 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480084 kB' 'Mapped: 207940 kB' 'Shmem: 6573468 kB' 'KReclaimable: 191964 kB' 'Slab: 719832 kB' 'SReclaimable: 191964 kB' 'SUnreclaim: 527868 kB' 'KernelStack: 12896 kB' 'PageTables: 8356 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8099520 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 35520 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1990236 kB' 'DirectMap2M: 15755264 kB' 'DirectMap1G: 52428800 kB' 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.292 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.292 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.293 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.293 09:26:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.293 09:26:45 -- setup/common.sh@33 -- # echo 1024 00:03:23.293 09:26:45 -- setup/common.sh@33 -- # return 0 00:03:23.293 09:26:45 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.293 09:26:45 -- setup/hugepages.sh@112 -- # get_nodes 00:03:23.293 09:26:45 -- setup/hugepages.sh@27 -- # local node 00:03:23.293 09:26:45 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.293 09:26:45 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:23.293 09:26:45 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.294 09:26:45 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:23.294 09:26:45 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:23.294 09:26:45 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:23.294 09:26:45 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.294 09:26:45 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.294 09:26:45 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:23.294 09:26:45 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.294 09:26:45 -- setup/common.sh@18 -- # local node=0 00:03:23.294 09:26:45 -- setup/common.sh@19 -- # local var val 00:03:23.294 09:26:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.294 09:26:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.294 09:26:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:23.294 09:26:45 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:23.294 09:26:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.294 09:26:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27370368 kB' 'MemUsed: 5455488 kB' 'SwapCached: 0 kB' 'Active: 1931028 kB' 'Inactive: 157908 kB' 'Active(anon): 1788528 kB' 'Inactive(anon): 0 kB' 'Active(file): 142500 kB' 'Inactive(file): 157908 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1948668 kB' 'Mapped: 78568 kB' 'AnonPages: 143416 kB' 'Shmem: 1648260 kB' 'KernelStack: 7544 kB' 'PageTables: 5020 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 71688 kB' 'Slab: 390056 kB' 'SReclaimable: 71688 kB' 'SUnreclaim: 318368 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:45 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:46 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:46 -- setup/common.sh@32 -- # continue 00:03:23.294 09:26:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.294 09:26:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.294 09:26:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.294 09:26:46 -- setup/common.sh@32 -- # continue 00:03:23.295 09:26:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.295 09:26:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.295 09:26:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.295 09:26:46 -- setup/common.sh@32 -- # continue 00:03:23.295 09:26:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.295 09:26:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.295 09:26:46 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.295 09:26:46 -- setup/common.sh@32 -- # continue 00:03:23.295 09:26:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.295 09:26:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.295 09:26:46 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.295 09:26:46 -- setup/common.sh@33 -- # echo 0 00:03:23.295 09:26:46 -- setup/common.sh@33 -- # return 0 00:03:23.295 09:26:46 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:23.295 09:26:46 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:23.295 09:26:46 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:23.295 09:26:46 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:23.295 09:26:46 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:23.295 node0=1024 expecting 1024 00:03:23.295 09:26:46 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:23.295 00:03:23.295 real 0m2.830s 00:03:23.295 user 0m1.168s 00:03:23.295 sys 0m1.589s 00:03:23.295 09:26:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:23.295 09:26:46 -- common/autotest_common.sh@10 -- # set +x 00:03:23.295 ************************************ 00:03:23.295 END TEST no_shrink_alloc 00:03:23.295 ************************************ 00:03:23.295 09:26:46 -- setup/hugepages.sh@217 -- # clear_hp 00:03:23.295 09:26:46 -- setup/hugepages.sh@37 -- # local node hp 00:03:23.295 09:26:46 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:23.295 09:26:46 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.295 09:26:46 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.295 09:26:46 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.295 09:26:46 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.295 09:26:46 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:23.295 09:26:46 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.295 09:26:46 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.295 09:26:46 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:23.295 09:26:46 -- setup/hugepages.sh@41 -- # echo 0 00:03:23.295 09:26:46 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:23.295 09:26:46 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:23.295 00:03:23.295 real 0m11.531s 00:03:23.295 user 0m4.501s 00:03:23.295 sys 0m5.968s 00:03:23.295 09:26:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:23.295 09:26:46 -- common/autotest_common.sh@10 -- # set +x 00:03:23.295 ************************************ 00:03:23.295 END TEST hugepages 00:03:23.295 ************************************ 00:03:23.295 09:26:46 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:23.295 09:26:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:23.295 09:26:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:23.295 09:26:46 -- common/autotest_common.sh@10 -- # set +x 00:03:23.295 ************************************ 00:03:23.295 START TEST driver 00:03:23.295 ************************************ 00:03:23.295 09:26:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:23.295 * Looking for test storage... 00:03:23.295 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:23.295 09:26:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:23.295 09:26:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:23.295 09:26:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:23.553 09:26:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:23.553 09:26:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:23.553 09:26:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:23.553 09:26:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:23.553 09:26:46 -- scripts/common.sh@335 -- # IFS=.-: 00:03:23.553 09:26:46 -- scripts/common.sh@335 -- # read -ra ver1 00:03:23.553 09:26:46 -- scripts/common.sh@336 -- # IFS=.-: 00:03:23.553 09:26:46 -- scripts/common.sh@336 -- # read -ra ver2 00:03:23.553 09:26:46 -- scripts/common.sh@337 -- # local 'op=<' 00:03:23.553 09:26:46 -- scripts/common.sh@339 -- # ver1_l=2 00:03:23.553 09:26:46 -- scripts/common.sh@340 -- # ver2_l=1 00:03:23.553 09:26:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:23.553 09:26:46 -- scripts/common.sh@343 -- # case "$op" in 00:03:23.553 09:26:46 -- scripts/common.sh@344 -- # : 1 00:03:23.553 09:26:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:23.553 09:26:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:23.553 09:26:46 -- scripts/common.sh@364 -- # decimal 1 00:03:23.553 09:26:46 -- scripts/common.sh@352 -- # local d=1 00:03:23.553 09:26:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:23.553 09:26:46 -- scripts/common.sh@354 -- # echo 1 00:03:23.553 09:26:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:23.553 09:26:46 -- scripts/common.sh@365 -- # decimal 2 00:03:23.553 09:26:46 -- scripts/common.sh@352 -- # local d=2 00:03:23.553 09:26:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:23.553 09:26:46 -- scripts/common.sh@354 -- # echo 2 00:03:23.553 09:26:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:23.553 09:26:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:23.553 09:26:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:23.553 09:26:46 -- scripts/common.sh@367 -- # return 0 00:03:23.553 09:26:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:23.553 09:26:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:23.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:23.553 --rc genhtml_branch_coverage=1 00:03:23.553 --rc genhtml_function_coverage=1 00:03:23.553 --rc genhtml_legend=1 00:03:23.553 --rc geninfo_all_blocks=1 00:03:23.553 --rc geninfo_unexecuted_blocks=1 00:03:23.553 00:03:23.553 ' 00:03:23.553 09:26:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:23.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:23.553 --rc genhtml_branch_coverage=1 00:03:23.553 --rc genhtml_function_coverage=1 00:03:23.553 --rc genhtml_legend=1 00:03:23.553 --rc geninfo_all_blocks=1 00:03:23.553 --rc geninfo_unexecuted_blocks=1 00:03:23.553 00:03:23.553 ' 00:03:23.553 09:26:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:23.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:23.553 --rc genhtml_branch_coverage=1 00:03:23.553 --rc genhtml_function_coverage=1 00:03:23.553 --rc genhtml_legend=1 00:03:23.553 --rc geninfo_all_blocks=1 00:03:23.553 --rc geninfo_unexecuted_blocks=1 00:03:23.553 00:03:23.553 ' 00:03:23.553 09:26:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:23.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:23.553 --rc genhtml_branch_coverage=1 00:03:23.553 --rc genhtml_function_coverage=1 00:03:23.553 --rc genhtml_legend=1 00:03:23.553 --rc geninfo_all_blocks=1 00:03:23.553 --rc geninfo_unexecuted_blocks=1 00:03:23.553 00:03:23.553 ' 00:03:23.553 09:26:46 -- setup/driver.sh@68 -- # setup reset 00:03:23.553 09:26:46 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:23.553 09:26:46 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:26.087 09:26:48 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:26.087 09:26:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:26.087 09:26:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:26.087 09:26:48 -- common/autotest_common.sh@10 -- # set +x 00:03:26.087 ************************************ 00:03:26.087 START TEST guess_driver 00:03:26.087 ************************************ 00:03:26.087 09:26:48 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:26.087 09:26:48 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:26.087 09:26:48 -- setup/driver.sh@47 -- # local fail=0 00:03:26.087 09:26:48 -- setup/driver.sh@49 -- # pick_driver 00:03:26.087 09:26:48 -- setup/driver.sh@36 -- # vfio 00:03:26.087 09:26:48 -- setup/driver.sh@21 -- # local iommu_grups 00:03:26.087 09:26:48 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:26.087 09:26:48 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:26.087 09:26:48 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:26.087 09:26:48 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:26.087 09:26:48 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:26.087 09:26:48 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:26.087 09:26:48 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:26.087 09:26:48 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:26.087 09:26:48 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:26.087 09:26:48 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:26.087 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:26.087 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:26.087 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:26.087 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:26.087 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:26.087 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:26.087 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:26.087 09:26:48 -- setup/driver.sh@30 -- # return 0 00:03:26.087 09:26:48 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:26.087 09:26:48 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:26.087 09:26:48 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:26.087 09:26:48 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:26.087 Looking for driver=vfio-pci 00:03:26.087 09:26:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:26.087 09:26:48 -- setup/driver.sh@45 -- # setup output config 00:03:26.087 09:26:48 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:26.087 09:26:48 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:27.461 09:26:49 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.461 09:26:49 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.461 09:26:49 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.461 09:26:49 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.461 09:26:49 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.461 09:26:49 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.461 09:26:49 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.461 09:26:49 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.461 09:26:49 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.461 09:26:49 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.461 09:26:49 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.461 09:26:49 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.461 09:26:49 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.461 09:26:49 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.461 09:26:49 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.461 09:26:49 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.461 09:26:49 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.461 09:26:49 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.461 09:26:49 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.461 09:26:49 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.461 09:26:49 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.461 09:26:49 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.461 09:26:49 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.461 09:26:49 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.461 09:26:49 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.461 09:26:49 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.461 09:26:49 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.461 09:26:50 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.461 09:26:50 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.461 09:26:50 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.461 09:26:50 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.461 09:26:50 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.461 09:26:50 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.461 09:26:50 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.461 09:26:50 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.461 09:26:50 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.462 09:26:50 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.462 09:26:50 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.462 09:26:50 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.462 09:26:50 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.462 09:26:50 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.462 09:26:50 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.462 09:26:50 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.462 09:26:50 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.462 09:26:50 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.462 09:26:50 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:27.462 09:26:50 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:27.462 09:26:50 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.397 09:26:50 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.397 09:26:50 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.397 09:26:50 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.397 09:26:51 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:28.397 09:26:51 -- setup/driver.sh@65 -- # setup reset 00:03:28.397 09:26:51 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:28.397 09:26:51 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:30.930 00:03:30.930 real 0m4.857s 00:03:30.930 user 0m1.100s 00:03:30.930 sys 0m1.980s 00:03:30.930 09:26:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:30.930 09:26:53 -- common/autotest_common.sh@10 -- # set +x 00:03:30.930 ************************************ 00:03:30.930 END TEST guess_driver 00:03:30.930 ************************************ 00:03:30.930 00:03:30.930 real 0m7.494s 00:03:30.930 user 0m1.735s 00:03:30.930 sys 0m3.053s 00:03:30.930 09:26:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:30.930 09:26:53 -- common/autotest_common.sh@10 -- # set +x 00:03:30.930 ************************************ 00:03:30.930 END TEST driver 00:03:30.930 ************************************ 00:03:30.930 09:26:53 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:30.930 09:26:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:30.930 09:26:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:30.930 09:26:53 -- common/autotest_common.sh@10 -- # set +x 00:03:30.930 ************************************ 00:03:30.930 START TEST devices 00:03:30.930 ************************************ 00:03:30.930 09:26:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:30.930 * Looking for test storage... 00:03:30.930 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:30.930 09:26:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:30.930 09:26:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:30.930 09:26:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:30.930 09:26:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:30.930 09:26:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:30.930 09:26:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:30.930 09:26:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:30.930 09:26:53 -- scripts/common.sh@335 -- # IFS=.-: 00:03:30.930 09:26:53 -- scripts/common.sh@335 -- # read -ra ver1 00:03:30.930 09:26:53 -- scripts/common.sh@336 -- # IFS=.-: 00:03:30.930 09:26:53 -- scripts/common.sh@336 -- # read -ra ver2 00:03:30.930 09:26:53 -- scripts/common.sh@337 -- # local 'op=<' 00:03:30.930 09:26:53 -- scripts/common.sh@339 -- # ver1_l=2 00:03:30.930 09:26:53 -- scripts/common.sh@340 -- # ver2_l=1 00:03:30.930 09:26:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:30.930 09:26:53 -- scripts/common.sh@343 -- # case "$op" in 00:03:30.930 09:26:53 -- scripts/common.sh@344 -- # : 1 00:03:30.930 09:26:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:30.930 09:26:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:30.930 09:26:53 -- scripts/common.sh@364 -- # decimal 1 00:03:30.930 09:26:53 -- scripts/common.sh@352 -- # local d=1 00:03:30.930 09:26:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:30.930 09:26:53 -- scripts/common.sh@354 -- # echo 1 00:03:30.930 09:26:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:30.930 09:26:53 -- scripts/common.sh@365 -- # decimal 2 00:03:30.930 09:26:53 -- scripts/common.sh@352 -- # local d=2 00:03:30.930 09:26:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:30.930 09:26:53 -- scripts/common.sh@354 -- # echo 2 00:03:30.930 09:26:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:30.930 09:26:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:30.930 09:26:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:30.930 09:26:53 -- scripts/common.sh@367 -- # return 0 00:03:30.930 09:26:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:30.930 09:26:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:30.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.930 --rc genhtml_branch_coverage=1 00:03:30.930 --rc genhtml_function_coverage=1 00:03:30.930 --rc genhtml_legend=1 00:03:30.930 --rc geninfo_all_blocks=1 00:03:30.930 --rc geninfo_unexecuted_blocks=1 00:03:30.930 00:03:30.930 ' 00:03:30.930 09:26:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:30.930 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.930 --rc genhtml_branch_coverage=1 00:03:30.930 --rc genhtml_function_coverage=1 00:03:30.930 --rc genhtml_legend=1 00:03:30.930 --rc geninfo_all_blocks=1 00:03:30.930 --rc geninfo_unexecuted_blocks=1 00:03:30.930 00:03:30.930 ' 00:03:30.930 09:26:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:30.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.931 --rc genhtml_branch_coverage=1 00:03:30.931 --rc genhtml_function_coverage=1 00:03:30.931 --rc genhtml_legend=1 00:03:30.931 --rc geninfo_all_blocks=1 00:03:30.931 --rc geninfo_unexecuted_blocks=1 00:03:30.931 00:03:30.931 ' 00:03:30.931 09:26:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:30.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.931 --rc genhtml_branch_coverage=1 00:03:30.931 --rc genhtml_function_coverage=1 00:03:30.931 --rc genhtml_legend=1 00:03:30.931 --rc geninfo_all_blocks=1 00:03:30.931 --rc geninfo_unexecuted_blocks=1 00:03:30.931 00:03:30.931 ' 00:03:30.931 09:26:53 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:30.931 09:26:53 -- setup/devices.sh@192 -- # setup reset 00:03:30.931 09:26:53 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:30.931 09:26:53 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:32.833 09:26:55 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:32.833 09:26:55 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:32.833 09:26:55 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:32.833 09:26:55 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:32.833 09:26:55 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:32.833 09:26:55 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:32.833 09:26:55 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:32.833 09:26:55 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:32.833 09:26:55 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:32.833 09:26:55 -- setup/devices.sh@196 -- # blocks=() 00:03:32.833 09:26:55 -- setup/devices.sh@196 -- # declare -a blocks 00:03:32.833 09:26:55 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:32.833 09:26:55 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:32.833 09:26:55 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:32.833 09:26:55 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:32.833 09:26:55 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:32.833 09:26:55 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:32.833 09:26:55 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:32.833 09:26:55 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:32.833 09:26:55 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:32.833 09:26:55 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:32.833 09:26:55 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:32.833 No valid GPT data, bailing 00:03:32.833 09:26:55 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:32.833 09:26:55 -- scripts/common.sh@393 -- # pt= 00:03:32.833 09:26:55 -- scripts/common.sh@394 -- # return 1 00:03:32.833 09:26:55 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:32.833 09:26:55 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:32.833 09:26:55 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:32.833 09:26:55 -- setup/common.sh@80 -- # echo 1000204886016 00:03:32.833 09:26:55 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:32.833 09:26:55 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:32.833 09:26:55 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:32.833 09:26:55 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:32.833 09:26:55 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:32.833 09:26:55 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:32.833 09:26:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:32.833 09:26:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:32.833 09:26:55 -- common/autotest_common.sh@10 -- # set +x 00:03:32.833 ************************************ 00:03:32.833 START TEST nvme_mount 00:03:32.833 ************************************ 00:03:32.833 09:26:55 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:32.833 09:26:55 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:32.833 09:26:55 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:32.833 09:26:55 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.833 09:26:55 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:32.833 09:26:55 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:32.833 09:26:55 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:32.833 09:26:55 -- setup/common.sh@40 -- # local part_no=1 00:03:32.833 09:26:55 -- setup/common.sh@41 -- # local size=1073741824 00:03:32.833 09:26:55 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:32.833 09:26:55 -- setup/common.sh@44 -- # parts=() 00:03:32.833 09:26:55 -- setup/common.sh@44 -- # local parts 00:03:32.833 09:26:55 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:32.833 09:26:55 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:32.833 09:26:55 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:32.833 09:26:55 -- setup/common.sh@46 -- # (( part++ )) 00:03:32.833 09:26:55 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:32.833 09:26:55 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:32.833 09:26:55 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:32.833 09:26:55 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:33.772 Creating new GPT entries in memory. 00:03:33.772 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:33.772 other utilities. 00:03:33.772 09:26:56 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:33.772 09:26:56 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:33.772 09:26:56 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:33.772 09:26:56 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:33.772 09:26:56 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:34.708 Creating new GPT entries in memory. 00:03:34.708 The operation has completed successfully. 00:03:34.708 09:26:57 -- setup/common.sh@57 -- # (( part++ )) 00:03:34.708 09:26:57 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:34.708 09:26:57 -- setup/common.sh@62 -- # wait 4085335 00:03:34.708 09:26:57 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.708 09:26:57 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:34.708 09:26:57 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.708 09:26:57 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:34.708 09:26:57 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:34.708 09:26:57 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.708 09:26:57 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:34.708 09:26:57 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:34.708 09:26:57 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:34.708 09:26:57 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.708 09:26:57 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:34.708 09:26:57 -- setup/devices.sh@53 -- # local found=0 00:03:34.709 09:26:57 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:34.709 09:26:57 -- setup/devices.sh@56 -- # : 00:03:34.709 09:26:57 -- setup/devices.sh@59 -- # local pci status 00:03:34.709 09:26:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.709 09:26:57 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:34.709 09:26:57 -- setup/devices.sh@47 -- # setup output config 00:03:34.709 09:26:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:34.709 09:26:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:36.085 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.085 09:26:58 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:36.085 09:26:58 -- setup/devices.sh@63 -- # found=1 00:03:36.085 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.085 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.085 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.085 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.085 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.085 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.086 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.086 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.086 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.086 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.086 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.086 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.086 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.086 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.086 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.086 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.086 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.086 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.086 09:26:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.086 09:26:58 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:36.086 09:26:58 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:36.086 09:26:58 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:36.086 09:26:58 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:36.086 09:26:58 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:36.086 09:26:58 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:36.086 09:26:58 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:36.086 09:26:58 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:36.086 09:26:58 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:36.086 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:36.086 09:26:58 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:36.086 09:26:58 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:36.345 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:36.345 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:36.345 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:36.345 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:36.345 09:26:59 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:36.345 09:26:59 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:36.345 09:26:59 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:36.345 09:26:59 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:36.345 09:26:59 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:36.345 09:26:59 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:36.345 09:26:59 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:36.345 09:26:59 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:36.345 09:26:59 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:36.345 09:26:59 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:36.345 09:26:59 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:36.345 09:26:59 -- setup/devices.sh@53 -- # local found=0 00:03:36.345 09:26:59 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:36.345 09:26:59 -- setup/devices.sh@56 -- # : 00:03:36.345 09:26:59 -- setup/devices.sh@59 -- # local pci status 00:03:36.345 09:26:59 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.345 09:26:59 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:36.345 09:26:59 -- setup/devices.sh@47 -- # setup output config 00:03:36.345 09:26:59 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:36.345 09:26:59 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:37.720 09:27:00 -- setup/devices.sh@63 -- # found=1 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.720 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.720 09:27:00 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:37.720 09:27:00 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:37.720 09:27:00 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.720 09:27:00 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:37.720 09:27:00 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:37.720 09:27:00 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.721 09:27:00 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:37.721 09:27:00 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:37.721 09:27:00 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:37.721 09:27:00 -- setup/devices.sh@50 -- # local mount_point= 00:03:37.721 09:27:00 -- setup/devices.sh@51 -- # local test_file= 00:03:37.721 09:27:00 -- setup/devices.sh@53 -- # local found=0 00:03:37.721 09:27:00 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:37.721 09:27:00 -- setup/devices.sh@59 -- # local pci status 00:03:37.721 09:27:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.721 09:27:00 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:37.721 09:27:00 -- setup/devices.sh@47 -- # setup output config 00:03:37.721 09:27:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:37.721 09:27:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:38.655 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.655 09:27:01 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:38.655 09:27:01 -- setup/devices.sh@63 -- # found=1 00:03:38.655 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.655 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.655 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.655 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.655 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.655 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.655 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.913 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.913 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.913 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.913 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.913 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.913 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.913 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.913 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.913 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.913 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.913 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.913 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.913 09:27:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.913 09:27:01 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:38.913 09:27:01 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:38.913 09:27:01 -- setup/devices.sh@68 -- # return 0 00:03:38.913 09:27:01 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:38.913 09:27:01 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:38.913 09:27:01 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:38.913 09:27:01 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:38.913 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:38.913 00:03:38.913 real 0m6.447s 00:03:38.913 user 0m1.464s 00:03:38.913 sys 0m2.558s 00:03:38.913 09:27:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:38.913 09:27:01 -- common/autotest_common.sh@10 -- # set +x 00:03:38.913 ************************************ 00:03:38.913 END TEST nvme_mount 00:03:38.913 ************************************ 00:03:38.913 09:27:01 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:38.913 09:27:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:38.913 09:27:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:38.913 09:27:01 -- common/autotest_common.sh@10 -- # set +x 00:03:38.913 ************************************ 00:03:38.913 START TEST dm_mount 00:03:38.913 ************************************ 00:03:38.913 09:27:01 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:38.913 09:27:01 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:38.913 09:27:01 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:38.913 09:27:01 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:38.913 09:27:01 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:38.913 09:27:01 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:38.913 09:27:01 -- setup/common.sh@40 -- # local part_no=2 00:03:38.913 09:27:01 -- setup/common.sh@41 -- # local size=1073741824 00:03:38.913 09:27:01 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:39.171 09:27:01 -- setup/common.sh@44 -- # parts=() 00:03:39.171 09:27:01 -- setup/common.sh@44 -- # local parts 00:03:39.171 09:27:01 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:39.171 09:27:01 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:39.171 09:27:01 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:39.171 09:27:01 -- setup/common.sh@46 -- # (( part++ )) 00:03:39.172 09:27:01 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:39.172 09:27:01 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:39.172 09:27:01 -- setup/common.sh@46 -- # (( part++ )) 00:03:39.172 09:27:01 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:39.172 09:27:01 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:39.172 09:27:01 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:39.172 09:27:01 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:40.102 Creating new GPT entries in memory. 00:03:40.102 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:40.102 other utilities. 00:03:40.102 09:27:02 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:40.102 09:27:02 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:40.102 09:27:02 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:40.102 09:27:02 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:40.102 09:27:02 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:41.035 Creating new GPT entries in memory. 00:03:41.036 The operation has completed successfully. 00:03:41.036 09:27:03 -- setup/common.sh@57 -- # (( part++ )) 00:03:41.036 09:27:03 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:41.036 09:27:03 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:41.036 09:27:03 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:41.036 09:27:03 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:41.969 The operation has completed successfully. 00:03:41.969 09:27:04 -- setup/common.sh@57 -- # (( part++ )) 00:03:41.969 09:27:04 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:41.969 09:27:04 -- setup/common.sh@62 -- # wait 4087900 00:03:42.228 09:27:04 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:42.228 09:27:04 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:42.228 09:27:04 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:42.228 09:27:04 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:42.228 09:27:04 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:42.228 09:27:04 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:42.228 09:27:04 -- setup/devices.sh@161 -- # break 00:03:42.228 09:27:04 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:42.228 09:27:04 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:42.228 09:27:04 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:42.228 09:27:04 -- setup/devices.sh@166 -- # dm=dm-0 00:03:42.228 09:27:04 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:42.228 09:27:04 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:42.228 09:27:04 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:42.228 09:27:04 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:42.228 09:27:04 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:42.228 09:27:04 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:42.228 09:27:04 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:42.228 09:27:04 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:42.228 09:27:04 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:42.228 09:27:04 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:42.228 09:27:04 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:42.228 09:27:04 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:42.228 09:27:04 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:42.228 09:27:04 -- setup/devices.sh@53 -- # local found=0 00:03:42.228 09:27:04 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:42.228 09:27:04 -- setup/devices.sh@56 -- # : 00:03:42.228 09:27:04 -- setup/devices.sh@59 -- # local pci status 00:03:42.228 09:27:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.228 09:27:04 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:42.228 09:27:04 -- setup/devices.sh@47 -- # setup output config 00:03:42.228 09:27:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:42.228 09:27:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:43.162 09:27:05 -- setup/devices.sh@63 -- # found=1 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.162 09:27:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:43.162 09:27:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.420 09:27:06 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:43.420 09:27:06 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:43.420 09:27:06 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:43.420 09:27:06 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:43.420 09:27:06 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:43.420 09:27:06 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:43.420 09:27:06 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:43.420 09:27:06 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:43.420 09:27:06 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:43.420 09:27:06 -- setup/devices.sh@50 -- # local mount_point= 00:03:43.420 09:27:06 -- setup/devices.sh@51 -- # local test_file= 00:03:43.420 09:27:06 -- setup/devices.sh@53 -- # local found=0 00:03:43.420 09:27:06 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:43.420 09:27:06 -- setup/devices.sh@59 -- # local pci status 00:03:43.420 09:27:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.420 09:27:06 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:43.420 09:27:06 -- setup/devices.sh@47 -- # setup output config 00:03:43.420 09:27:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:43.420 09:27:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:44.356 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.356 09:27:07 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:44.356 09:27:07 -- setup/devices.sh@63 -- # found=1 00:03:44.356 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.356 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.356 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.356 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.356 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.356 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.356 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.356 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.356 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.356 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.356 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.356 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.356 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.356 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.356 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.356 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.356 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.636 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.636 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.636 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.636 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.636 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.636 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.636 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.636 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.636 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.636 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.636 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.636 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.636 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.636 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.636 09:27:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.636 09:27:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.636 09:27:07 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:44.636 09:27:07 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:44.636 09:27:07 -- setup/devices.sh@68 -- # return 0 00:03:44.636 09:27:07 -- setup/devices.sh@187 -- # cleanup_dm 00:03:44.636 09:27:07 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.636 09:27:07 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:44.636 09:27:07 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:44.636 09:27:07 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:44.636 09:27:07 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:44.636 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:44.636 09:27:07 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:44.636 09:27:07 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:44.636 00:03:44.636 real 0m5.697s 00:03:44.636 user 0m0.953s 00:03:44.636 sys 0m1.602s 00:03:44.636 09:27:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:44.636 09:27:07 -- common/autotest_common.sh@10 -- # set +x 00:03:44.636 ************************************ 00:03:44.636 END TEST dm_mount 00:03:44.636 ************************************ 00:03:44.931 09:27:07 -- setup/devices.sh@1 -- # cleanup 00:03:44.931 09:27:07 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:44.931 09:27:07 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.931 09:27:07 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:44.931 09:27:07 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:44.931 09:27:07 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:44.931 09:27:07 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:44.931 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:44.931 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:44.931 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:44.931 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:44.931 09:27:07 -- setup/devices.sh@12 -- # cleanup_dm 00:03:44.931 09:27:07 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.931 09:27:07 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:44.931 09:27:07 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:44.931 09:27:07 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:44.931 09:27:07 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:44.931 09:27:07 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:44.931 00:03:44.931 real 0m14.171s 00:03:44.931 user 0m3.164s 00:03:44.931 sys 0m5.209s 00:03:44.931 09:27:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:44.931 09:27:07 -- common/autotest_common.sh@10 -- # set +x 00:03:44.931 ************************************ 00:03:44.931 END TEST devices 00:03:44.931 ************************************ 00:03:44.931 00:03:44.931 real 0m44.191s 00:03:44.931 user 0m12.866s 00:03:44.931 sys 0m19.863s 00:03:44.931 09:27:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:44.931 09:27:07 -- common/autotest_common.sh@10 -- # set +x 00:03:44.931 ************************************ 00:03:44.931 END TEST setup.sh 00:03:44.931 ************************************ 00:03:45.189 09:27:07 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:46.127 Hugepages 00:03:46.127 node hugesize free / total 00:03:46.127 node0 1048576kB 0 / 0 00:03:46.127 node0 2048kB 2048 / 2048 00:03:46.127 node1 1048576kB 0 / 0 00:03:46.127 node1 2048kB 0 / 0 00:03:46.127 00:03:46.128 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:46.128 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:46.128 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:46.128 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:46.128 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:46.128 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:46.128 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:46.128 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:46.128 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:46.128 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:46.128 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:46.128 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:46.128 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:46.128 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:46.128 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:46.128 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:46.128 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:46.128 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:46.128 09:27:08 -- spdk/autotest.sh@128 -- # uname -s 00:03:46.128 09:27:08 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:46.128 09:27:08 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:46.128 09:27:08 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:47.506 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:47.507 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:47.507 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:47.507 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:47.507 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:47.507 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:47.507 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:47.507 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:47.507 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:47.507 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:47.507 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:47.507 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:47.507 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:47.507 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:47.507 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:47.507 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:48.446 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:48.446 09:27:11 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:49.382 09:27:12 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:49.382 09:27:12 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:49.382 09:27:12 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:49.382 09:27:12 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:49.382 09:27:12 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:49.382 09:27:12 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:49.382 09:27:12 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:49.382 09:27:12 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:49.382 09:27:12 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:49.640 09:27:12 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:49.640 09:27:12 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:49.640 09:27:12 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:50.577 Waiting for block devices as requested 00:03:50.577 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:50.836 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:50.836 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:51.094 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:51.095 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:51.095 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:51.095 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:51.354 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:51.354 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:51.354 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:51.354 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:51.613 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:51.613 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:51.613 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:51.613 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:51.872 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:51.872 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:51.872 09:27:14 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:03:51.872 09:27:14 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:51.872 09:27:14 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:03:51.872 09:27:14 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:03:51.872 09:27:14 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:51.872 09:27:14 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:51.872 09:27:14 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:51.872 09:27:14 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:03:51.872 09:27:14 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:03:51.872 09:27:14 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:03:51.872 09:27:14 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:51.872 09:27:14 -- common/autotest_common.sh@1540 -- # grep oacs 00:03:51.872 09:27:14 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:51.872 09:27:14 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:03:51.872 09:27:14 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:03:51.872 09:27:14 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:03:51.872 09:27:14 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:03:51.872 09:27:14 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:03:51.872 09:27:14 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:03:51.872 09:27:14 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:03:51.872 09:27:14 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:03:51.872 09:27:14 -- common/autotest_common.sh@1552 -- # continue 00:03:51.872 09:27:14 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:03:51.872 09:27:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:51.872 09:27:14 -- common/autotest_common.sh@10 -- # set +x 00:03:52.131 09:27:14 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:03:52.131 09:27:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:52.131 09:27:14 -- common/autotest_common.sh@10 -- # set +x 00:03:52.131 09:27:14 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:53.087 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:53.087 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:53.345 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:53.345 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:53.345 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:53.345 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:53.345 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:53.345 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:53.345 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:53.345 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:53.345 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:53.345 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:53.345 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:53.345 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:53.345 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:53.345 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:54.283 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:54.283 09:27:17 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:03:54.283 09:27:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:54.283 09:27:17 -- common/autotest_common.sh@10 -- # set +x 00:03:54.283 09:27:17 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:03:54.283 09:27:17 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:03:54.283 09:27:17 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:03:54.283 09:27:17 -- common/autotest_common.sh@1572 -- # bdfs=() 00:03:54.283 09:27:17 -- common/autotest_common.sh@1572 -- # local bdfs 00:03:54.283 09:27:17 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:03:54.283 09:27:17 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:54.283 09:27:17 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:54.283 09:27:17 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:54.283 09:27:17 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:54.283 09:27:17 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:54.541 09:27:17 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:54.541 09:27:17 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:54.541 09:27:17 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:03:54.541 09:27:17 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:54.541 09:27:17 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:03:54.541 09:27:17 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:54.541 09:27:17 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:03:54.541 09:27:17 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:03:54.541 09:27:17 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:03:54.541 09:27:17 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=4093717 00:03:54.541 09:27:17 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:54.541 09:27:17 -- common/autotest_common.sh@1593 -- # waitforlisten 4093717 00:03:54.541 09:27:17 -- common/autotest_common.sh@829 -- # '[' -z 4093717 ']' 00:03:54.541 09:27:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:54.541 09:27:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:54.541 09:27:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:54.541 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:54.541 09:27:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:54.541 09:27:17 -- common/autotest_common.sh@10 -- # set +x 00:03:54.541 [2024-11-29 09:27:17.247754] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:54.542 [2024-11-29 09:27:17.247850] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4093717 ] 00:03:54.542 EAL: No free 2048 kB hugepages reported on node 1 00:03:54.542 [2024-11-29 09:27:17.305340] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:54.800 [2024-11-29 09:27:17.414947] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:54.800 [2024-11-29 09:27:17.415103] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:55.736 09:27:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:55.737 09:27:18 -- common/autotest_common.sh@862 -- # return 0 00:03:55.737 09:27:18 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:03:55.737 09:27:18 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:03:55.737 09:27:18 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:03:59.021 nvme0n1 00:03:59.021 09:27:21 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:03:59.021 [2024-11-29 09:27:21.538754] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:03:59.021 [2024-11-29 09:27:21.538798] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:03:59.021 request: 00:03:59.021 { 00:03:59.021 "nvme_ctrlr_name": "nvme0", 00:03:59.021 "password": "test", 00:03:59.021 "method": "bdev_nvme_opal_revert", 00:03:59.021 "req_id": 1 00:03:59.021 } 00:03:59.021 Got JSON-RPC error response 00:03:59.021 response: 00:03:59.021 { 00:03:59.021 "code": -32603, 00:03:59.021 "message": "Internal error" 00:03:59.021 } 00:03:59.021 09:27:21 -- common/autotest_common.sh@1599 -- # true 00:03:59.021 09:27:21 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:03:59.021 09:27:21 -- common/autotest_common.sh@1603 -- # killprocess 4093717 00:03:59.021 09:27:21 -- common/autotest_common.sh@936 -- # '[' -z 4093717 ']' 00:03:59.021 09:27:21 -- common/autotest_common.sh@940 -- # kill -0 4093717 00:03:59.021 09:27:21 -- common/autotest_common.sh@941 -- # uname 00:03:59.021 09:27:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:59.021 09:27:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4093717 00:03:59.021 09:27:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:59.021 09:27:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:59.021 09:27:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4093717' 00:03:59.021 killing process with pid 4093717 00:03:59.021 09:27:21 -- common/autotest_common.sh@955 -- # kill 4093717 00:03:59.021 09:27:21 -- common/autotest_common.sh@960 -- # wait 4093717 00:04:00.925 09:27:23 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:04:00.925 09:27:23 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:04:00.925 09:27:23 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:00.925 09:27:23 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:00.925 09:27:23 -- spdk/autotest.sh@160 -- # timing_enter lib 00:04:00.925 09:27:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:00.925 09:27:23 -- common/autotest_common.sh@10 -- # set +x 00:04:00.925 09:27:23 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:00.925 09:27:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:00.925 09:27:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:00.925 09:27:23 -- common/autotest_common.sh@10 -- # set +x 00:04:00.925 ************************************ 00:04:00.925 START TEST env 00:04:00.925 ************************************ 00:04:00.925 09:27:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:00.925 * Looking for test storage... 00:04:00.925 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:00.925 09:27:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:00.925 09:27:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:00.925 09:27:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:00.925 09:27:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:00.925 09:27:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:00.925 09:27:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:00.925 09:27:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:00.925 09:27:23 -- scripts/common.sh@335 -- # IFS=.-: 00:04:00.925 09:27:23 -- scripts/common.sh@335 -- # read -ra ver1 00:04:00.925 09:27:23 -- scripts/common.sh@336 -- # IFS=.-: 00:04:00.925 09:27:23 -- scripts/common.sh@336 -- # read -ra ver2 00:04:00.925 09:27:23 -- scripts/common.sh@337 -- # local 'op=<' 00:04:00.925 09:27:23 -- scripts/common.sh@339 -- # ver1_l=2 00:04:00.925 09:27:23 -- scripts/common.sh@340 -- # ver2_l=1 00:04:00.925 09:27:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:00.925 09:27:23 -- scripts/common.sh@343 -- # case "$op" in 00:04:00.925 09:27:23 -- scripts/common.sh@344 -- # : 1 00:04:00.925 09:27:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:00.925 09:27:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:00.925 09:27:23 -- scripts/common.sh@364 -- # decimal 1 00:04:00.925 09:27:23 -- scripts/common.sh@352 -- # local d=1 00:04:00.925 09:27:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:00.925 09:27:23 -- scripts/common.sh@354 -- # echo 1 00:04:00.925 09:27:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:00.925 09:27:23 -- scripts/common.sh@365 -- # decimal 2 00:04:00.925 09:27:23 -- scripts/common.sh@352 -- # local d=2 00:04:00.925 09:27:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:00.925 09:27:23 -- scripts/common.sh@354 -- # echo 2 00:04:00.925 09:27:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:00.925 09:27:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:00.925 09:27:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:00.925 09:27:23 -- scripts/common.sh@367 -- # return 0 00:04:00.925 09:27:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:00.925 09:27:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:00.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:00.925 --rc genhtml_branch_coverage=1 00:04:00.925 --rc genhtml_function_coverage=1 00:04:00.925 --rc genhtml_legend=1 00:04:00.925 --rc geninfo_all_blocks=1 00:04:00.925 --rc geninfo_unexecuted_blocks=1 00:04:00.925 00:04:00.925 ' 00:04:00.925 09:27:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:00.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:00.925 --rc genhtml_branch_coverage=1 00:04:00.925 --rc genhtml_function_coverage=1 00:04:00.925 --rc genhtml_legend=1 00:04:00.925 --rc geninfo_all_blocks=1 00:04:00.925 --rc geninfo_unexecuted_blocks=1 00:04:00.925 00:04:00.925 ' 00:04:00.925 09:27:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:00.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:00.925 --rc genhtml_branch_coverage=1 00:04:00.925 --rc genhtml_function_coverage=1 00:04:00.925 --rc genhtml_legend=1 00:04:00.925 --rc geninfo_all_blocks=1 00:04:00.925 --rc geninfo_unexecuted_blocks=1 00:04:00.925 00:04:00.925 ' 00:04:00.925 09:27:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:00.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:00.925 --rc genhtml_branch_coverage=1 00:04:00.925 --rc genhtml_function_coverage=1 00:04:00.925 --rc genhtml_legend=1 00:04:00.925 --rc geninfo_all_blocks=1 00:04:00.925 --rc geninfo_unexecuted_blocks=1 00:04:00.925 00:04:00.925 ' 00:04:00.925 09:27:23 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:00.925 09:27:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:00.925 09:27:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:00.925 09:27:23 -- common/autotest_common.sh@10 -- # set +x 00:04:00.925 ************************************ 00:04:00.925 START TEST env_memory 00:04:00.925 ************************************ 00:04:00.925 09:27:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:00.925 00:04:00.925 00:04:00.925 CUnit - A unit testing framework for C - Version 2.1-3 00:04:00.925 http://cunit.sourceforge.net/ 00:04:00.925 00:04:00.925 00:04:00.925 Suite: memory 00:04:00.925 Test: alloc and free memory map ...[2024-11-29 09:27:23.589085] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:00.925 passed 00:04:00.925 Test: mem map translation ...[2024-11-29 09:27:23.608888] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:00.925 [2024-11-29 09:27:23.608910] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:00.925 [2024-11-29 09:27:23.608960] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:00.925 [2024-11-29 09:27:23.608972] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:00.925 passed 00:04:00.925 Test: mem map registration ...[2024-11-29 09:27:23.649611] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:00.925 [2024-11-29 09:27:23.649631] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:00.925 passed 00:04:00.925 Test: mem map adjacent registrations ...passed 00:04:00.925 00:04:00.925 Run Summary: Type Total Ran Passed Failed Inactive 00:04:00.925 suites 1 1 n/a 0 0 00:04:00.925 tests 4 4 4 0 0 00:04:00.925 asserts 152 152 152 0 n/a 00:04:00.925 00:04:00.925 Elapsed time = 0.143 seconds 00:04:00.925 00:04:00.925 real 0m0.151s 00:04:00.925 user 0m0.144s 00:04:00.925 sys 0m0.006s 00:04:00.925 09:27:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:00.925 09:27:23 -- common/autotest_common.sh@10 -- # set +x 00:04:00.925 ************************************ 00:04:00.925 END TEST env_memory 00:04:00.925 ************************************ 00:04:00.925 09:27:23 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:00.925 09:27:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:00.925 09:27:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:00.925 09:27:23 -- common/autotest_common.sh@10 -- # set +x 00:04:00.925 ************************************ 00:04:00.925 START TEST env_vtophys 00:04:00.926 ************************************ 00:04:00.926 09:27:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:00.926 EAL: lib.eal log level changed from notice to debug 00:04:00.926 EAL: Detected lcore 0 as core 0 on socket 0 00:04:00.926 EAL: Detected lcore 1 as core 1 on socket 0 00:04:00.926 EAL: Detected lcore 2 as core 2 on socket 0 00:04:00.926 EAL: Detected lcore 3 as core 3 on socket 0 00:04:00.926 EAL: Detected lcore 4 as core 4 on socket 0 00:04:00.926 EAL: Detected lcore 5 as core 5 on socket 0 00:04:00.926 EAL: Detected lcore 6 as core 8 on socket 0 00:04:00.926 EAL: Detected lcore 7 as core 9 on socket 0 00:04:00.926 EAL: Detected lcore 8 as core 10 on socket 0 00:04:00.926 EAL: Detected lcore 9 as core 11 on socket 0 00:04:00.926 EAL: Detected lcore 10 as core 12 on socket 0 00:04:00.926 EAL: Detected lcore 11 as core 13 on socket 0 00:04:00.926 EAL: Detected lcore 12 as core 0 on socket 1 00:04:00.926 EAL: Detected lcore 13 as core 1 on socket 1 00:04:00.926 EAL: Detected lcore 14 as core 2 on socket 1 00:04:00.926 EAL: Detected lcore 15 as core 3 on socket 1 00:04:00.926 EAL: Detected lcore 16 as core 4 on socket 1 00:04:00.926 EAL: Detected lcore 17 as core 5 on socket 1 00:04:00.926 EAL: Detected lcore 18 as core 8 on socket 1 00:04:00.926 EAL: Detected lcore 19 as core 9 on socket 1 00:04:00.926 EAL: Detected lcore 20 as core 10 on socket 1 00:04:00.926 EAL: Detected lcore 21 as core 11 on socket 1 00:04:00.926 EAL: Detected lcore 22 as core 12 on socket 1 00:04:00.926 EAL: Detected lcore 23 as core 13 on socket 1 00:04:00.926 EAL: Detected lcore 24 as core 0 on socket 0 00:04:00.926 EAL: Detected lcore 25 as core 1 on socket 0 00:04:00.926 EAL: Detected lcore 26 as core 2 on socket 0 00:04:00.926 EAL: Detected lcore 27 as core 3 on socket 0 00:04:00.926 EAL: Detected lcore 28 as core 4 on socket 0 00:04:00.926 EAL: Detected lcore 29 as core 5 on socket 0 00:04:00.926 EAL: Detected lcore 30 as core 8 on socket 0 00:04:00.926 EAL: Detected lcore 31 as core 9 on socket 0 00:04:00.926 EAL: Detected lcore 32 as core 10 on socket 0 00:04:00.926 EAL: Detected lcore 33 as core 11 on socket 0 00:04:00.926 EAL: Detected lcore 34 as core 12 on socket 0 00:04:00.926 EAL: Detected lcore 35 as core 13 on socket 0 00:04:00.926 EAL: Detected lcore 36 as core 0 on socket 1 00:04:00.926 EAL: Detected lcore 37 as core 1 on socket 1 00:04:00.926 EAL: Detected lcore 38 as core 2 on socket 1 00:04:00.926 EAL: Detected lcore 39 as core 3 on socket 1 00:04:00.926 EAL: Detected lcore 40 as core 4 on socket 1 00:04:00.926 EAL: Detected lcore 41 as core 5 on socket 1 00:04:00.926 EAL: Detected lcore 42 as core 8 on socket 1 00:04:00.926 EAL: Detected lcore 43 as core 9 on socket 1 00:04:00.926 EAL: Detected lcore 44 as core 10 on socket 1 00:04:00.926 EAL: Detected lcore 45 as core 11 on socket 1 00:04:00.926 EAL: Detected lcore 46 as core 12 on socket 1 00:04:00.926 EAL: Detected lcore 47 as core 13 on socket 1 00:04:00.926 EAL: Maximum logical cores by configuration: 128 00:04:00.926 EAL: Detected CPU lcores: 48 00:04:00.926 EAL: Detected NUMA nodes: 2 00:04:00.926 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:00.926 EAL: Detected shared linkage of DPDK 00:04:00.926 EAL: No shared files mode enabled, IPC will be disabled 00:04:01.185 EAL: Bus pci wants IOVA as 'DC' 00:04:01.185 EAL: Buses did not request a specific IOVA mode. 00:04:01.185 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:01.185 EAL: Selected IOVA mode 'VA' 00:04:01.185 EAL: No free 2048 kB hugepages reported on node 1 00:04:01.185 EAL: Probing VFIO support... 00:04:01.185 EAL: IOMMU type 1 (Type 1) is supported 00:04:01.185 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:01.185 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:01.185 EAL: VFIO support initialized 00:04:01.185 EAL: Ask a virtual area of 0x2e000 bytes 00:04:01.185 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:01.185 EAL: Setting up physically contiguous memory... 00:04:01.185 EAL: Setting maximum number of open files to 524288 00:04:01.185 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:01.185 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:01.185 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:01.185 EAL: Ask a virtual area of 0x61000 bytes 00:04:01.185 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:01.185 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:01.185 EAL: Ask a virtual area of 0x400000000 bytes 00:04:01.185 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:01.185 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:01.185 EAL: Ask a virtual area of 0x61000 bytes 00:04:01.185 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:01.185 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:01.185 EAL: Ask a virtual area of 0x400000000 bytes 00:04:01.185 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:01.185 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:01.185 EAL: Ask a virtual area of 0x61000 bytes 00:04:01.185 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:01.185 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:01.185 EAL: Ask a virtual area of 0x400000000 bytes 00:04:01.185 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:01.185 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:01.185 EAL: Ask a virtual area of 0x61000 bytes 00:04:01.185 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:01.185 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:01.185 EAL: Ask a virtual area of 0x400000000 bytes 00:04:01.185 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:01.185 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:01.185 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:01.185 EAL: Ask a virtual area of 0x61000 bytes 00:04:01.185 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:01.185 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:01.185 EAL: Ask a virtual area of 0x400000000 bytes 00:04:01.185 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:01.185 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:01.185 EAL: Ask a virtual area of 0x61000 bytes 00:04:01.185 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:01.185 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:01.185 EAL: Ask a virtual area of 0x400000000 bytes 00:04:01.185 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:01.185 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:01.185 EAL: Ask a virtual area of 0x61000 bytes 00:04:01.185 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:01.185 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:01.185 EAL: Ask a virtual area of 0x400000000 bytes 00:04:01.185 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:01.185 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:01.185 EAL: Ask a virtual area of 0x61000 bytes 00:04:01.185 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:01.185 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:01.185 EAL: Ask a virtual area of 0x400000000 bytes 00:04:01.185 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:01.185 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:01.185 EAL: Hugepages will be freed exactly as allocated. 00:04:01.185 EAL: No shared files mode enabled, IPC is disabled 00:04:01.185 EAL: No shared files mode enabled, IPC is disabled 00:04:01.185 EAL: TSC frequency is ~2700000 KHz 00:04:01.185 EAL: Main lcore 0 is ready (tid=7f25b810da00;cpuset=[0]) 00:04:01.185 EAL: Trying to obtain current memory policy. 00:04:01.185 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.185 EAL: Restoring previous memory policy: 0 00:04:01.185 EAL: request: mp_malloc_sync 00:04:01.185 EAL: No shared files mode enabled, IPC is disabled 00:04:01.185 EAL: Heap on socket 0 was expanded by 2MB 00:04:01.185 EAL: No shared files mode enabled, IPC is disabled 00:04:01.185 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:01.185 EAL: Mem event callback 'spdk:(nil)' registered 00:04:01.185 00:04:01.185 00:04:01.185 CUnit - A unit testing framework for C - Version 2.1-3 00:04:01.185 http://cunit.sourceforge.net/ 00:04:01.185 00:04:01.186 00:04:01.186 Suite: components_suite 00:04:01.186 Test: vtophys_malloc_test ...passed 00:04:01.186 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:01.186 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.186 EAL: Restoring previous memory policy: 4 00:04:01.186 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.186 EAL: request: mp_malloc_sync 00:04:01.186 EAL: No shared files mode enabled, IPC is disabled 00:04:01.186 EAL: Heap on socket 0 was expanded by 4MB 00:04:01.186 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.186 EAL: request: mp_malloc_sync 00:04:01.186 EAL: No shared files mode enabled, IPC is disabled 00:04:01.186 EAL: Heap on socket 0 was shrunk by 4MB 00:04:01.186 EAL: Trying to obtain current memory policy. 00:04:01.186 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.186 EAL: Restoring previous memory policy: 4 00:04:01.186 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.186 EAL: request: mp_malloc_sync 00:04:01.186 EAL: No shared files mode enabled, IPC is disabled 00:04:01.186 EAL: Heap on socket 0 was expanded by 6MB 00:04:01.186 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.186 EAL: request: mp_malloc_sync 00:04:01.186 EAL: No shared files mode enabled, IPC is disabled 00:04:01.186 EAL: Heap on socket 0 was shrunk by 6MB 00:04:01.186 EAL: Trying to obtain current memory policy. 00:04:01.186 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.186 EAL: Restoring previous memory policy: 4 00:04:01.186 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.186 EAL: request: mp_malloc_sync 00:04:01.186 EAL: No shared files mode enabled, IPC is disabled 00:04:01.186 EAL: Heap on socket 0 was expanded by 10MB 00:04:01.186 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.186 EAL: request: mp_malloc_sync 00:04:01.186 EAL: No shared files mode enabled, IPC is disabled 00:04:01.186 EAL: Heap on socket 0 was shrunk by 10MB 00:04:01.186 EAL: Trying to obtain current memory policy. 00:04:01.186 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.186 EAL: Restoring previous memory policy: 4 00:04:01.186 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.186 EAL: request: mp_malloc_sync 00:04:01.186 EAL: No shared files mode enabled, IPC is disabled 00:04:01.186 EAL: Heap on socket 0 was expanded by 18MB 00:04:01.186 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.186 EAL: request: mp_malloc_sync 00:04:01.186 EAL: No shared files mode enabled, IPC is disabled 00:04:01.186 EAL: Heap on socket 0 was shrunk by 18MB 00:04:01.186 EAL: Trying to obtain current memory policy. 00:04:01.186 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.186 EAL: Restoring previous memory policy: 4 00:04:01.186 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.186 EAL: request: mp_malloc_sync 00:04:01.186 EAL: No shared files mode enabled, IPC is disabled 00:04:01.186 EAL: Heap on socket 0 was expanded by 34MB 00:04:01.186 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.186 EAL: request: mp_malloc_sync 00:04:01.186 EAL: No shared files mode enabled, IPC is disabled 00:04:01.186 EAL: Heap on socket 0 was shrunk by 34MB 00:04:01.186 EAL: Trying to obtain current memory policy. 00:04:01.186 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.186 EAL: Restoring previous memory policy: 4 00:04:01.186 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.186 EAL: request: mp_malloc_sync 00:04:01.186 EAL: No shared files mode enabled, IPC is disabled 00:04:01.186 EAL: Heap on socket 0 was expanded by 66MB 00:04:01.186 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.186 EAL: request: mp_malloc_sync 00:04:01.186 EAL: No shared files mode enabled, IPC is disabled 00:04:01.186 EAL: Heap on socket 0 was shrunk by 66MB 00:04:01.186 EAL: Trying to obtain current memory policy. 00:04:01.186 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.186 EAL: Restoring previous memory policy: 4 00:04:01.186 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.186 EAL: request: mp_malloc_sync 00:04:01.186 EAL: No shared files mode enabled, IPC is disabled 00:04:01.186 EAL: Heap on socket 0 was expanded by 130MB 00:04:01.186 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.186 EAL: request: mp_malloc_sync 00:04:01.186 EAL: No shared files mode enabled, IPC is disabled 00:04:01.186 EAL: Heap on socket 0 was shrunk by 130MB 00:04:01.186 EAL: Trying to obtain current memory policy. 00:04:01.186 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.445 EAL: Restoring previous memory policy: 4 00:04:01.445 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.445 EAL: request: mp_malloc_sync 00:04:01.445 EAL: No shared files mode enabled, IPC is disabled 00:04:01.445 EAL: Heap on socket 0 was expanded by 258MB 00:04:01.445 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.445 EAL: request: mp_malloc_sync 00:04:01.445 EAL: No shared files mode enabled, IPC is disabled 00:04:01.445 EAL: Heap on socket 0 was shrunk by 258MB 00:04:01.445 EAL: Trying to obtain current memory policy. 00:04:01.445 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.445 EAL: Restoring previous memory policy: 4 00:04:01.445 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.445 EAL: request: mp_malloc_sync 00:04:01.445 EAL: No shared files mode enabled, IPC is disabled 00:04:01.445 EAL: Heap on socket 0 was expanded by 514MB 00:04:01.704 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.704 EAL: request: mp_malloc_sync 00:04:01.704 EAL: No shared files mode enabled, IPC is disabled 00:04:01.704 EAL: Heap on socket 0 was shrunk by 514MB 00:04:01.704 EAL: Trying to obtain current memory policy. 00:04:01.704 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:01.963 EAL: Restoring previous memory policy: 4 00:04:01.963 EAL: Calling mem event callback 'spdk:(nil)' 00:04:01.963 EAL: request: mp_malloc_sync 00:04:01.963 EAL: No shared files mode enabled, IPC is disabled 00:04:01.963 EAL: Heap on socket 0 was expanded by 1026MB 00:04:02.221 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.480 EAL: request: mp_malloc_sync 00:04:02.480 EAL: No shared files mode enabled, IPC is disabled 00:04:02.480 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:02.480 passed 00:04:02.480 00:04:02.480 Run Summary: Type Total Ran Passed Failed Inactive 00:04:02.480 suites 1 1 n/a 0 0 00:04:02.480 tests 2 2 2 0 0 00:04:02.480 asserts 497 497 497 0 n/a 00:04:02.480 00:04:02.480 Elapsed time = 1.364 seconds 00:04:02.480 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.480 EAL: request: mp_malloc_sync 00:04:02.480 EAL: No shared files mode enabled, IPC is disabled 00:04:02.480 EAL: Heap on socket 0 was shrunk by 2MB 00:04:02.480 EAL: No shared files mode enabled, IPC is disabled 00:04:02.480 EAL: No shared files mode enabled, IPC is disabled 00:04:02.480 EAL: No shared files mode enabled, IPC is disabled 00:04:02.480 00:04:02.480 real 0m1.483s 00:04:02.480 user 0m0.843s 00:04:02.480 sys 0m0.607s 00:04:02.480 09:27:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:02.480 09:27:25 -- common/autotest_common.sh@10 -- # set +x 00:04:02.480 ************************************ 00:04:02.480 END TEST env_vtophys 00:04:02.480 ************************************ 00:04:02.480 09:27:25 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:02.480 09:27:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:02.480 09:27:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:02.480 09:27:25 -- common/autotest_common.sh@10 -- # set +x 00:04:02.480 ************************************ 00:04:02.480 START TEST env_pci 00:04:02.480 ************************************ 00:04:02.480 09:27:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:02.480 00:04:02.480 00:04:02.480 CUnit - A unit testing framework for C - Version 2.1-3 00:04:02.480 http://cunit.sourceforge.net/ 00:04:02.480 00:04:02.480 00:04:02.480 Suite: pci 00:04:02.480 Test: pci_hook ...[2024-11-29 09:27:25.255826] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 4094754 has claimed it 00:04:02.480 EAL: Cannot find device (10000:00:01.0) 00:04:02.480 EAL: Failed to attach device on primary process 00:04:02.480 passed 00:04:02.480 00:04:02.480 Run Summary: Type Total Ran Passed Failed Inactive 00:04:02.480 suites 1 1 n/a 0 0 00:04:02.480 tests 1 1 1 0 0 00:04:02.480 asserts 25 25 25 0 n/a 00:04:02.480 00:04:02.480 Elapsed time = 0.022 seconds 00:04:02.480 00:04:02.480 real 0m0.037s 00:04:02.480 user 0m0.009s 00:04:02.480 sys 0m0.027s 00:04:02.480 09:27:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:02.480 09:27:25 -- common/autotest_common.sh@10 -- # set +x 00:04:02.480 ************************************ 00:04:02.480 END TEST env_pci 00:04:02.480 ************************************ 00:04:02.480 09:27:25 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:02.480 09:27:25 -- env/env.sh@15 -- # uname 00:04:02.480 09:27:25 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:02.480 09:27:25 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:02.480 09:27:25 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:02.480 09:27:25 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:02.480 09:27:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:02.480 09:27:25 -- common/autotest_common.sh@10 -- # set +x 00:04:02.480 ************************************ 00:04:02.480 START TEST env_dpdk_post_init 00:04:02.480 ************************************ 00:04:02.480 09:27:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:02.739 EAL: Detected CPU lcores: 48 00:04:02.739 EAL: Detected NUMA nodes: 2 00:04:02.739 EAL: Detected shared linkage of DPDK 00:04:02.739 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:02.739 EAL: Selected IOVA mode 'VA' 00:04:02.739 EAL: No free 2048 kB hugepages reported on node 1 00:04:02.739 EAL: VFIO support initialized 00:04:02.739 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:02.739 EAL: Using IOMMU type 1 (Type 1) 00:04:02.739 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:02.739 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:02.739 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:02.739 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:02.739 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:02.739 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:02.739 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:02.739 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:02.739 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:02.739 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:02.739 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:02.739 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:02.739 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:03.006 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:03.006 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:03.006 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:03.582 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:06.860 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:06.860 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:07.117 Starting DPDK initialization... 00:04:07.117 Starting SPDK post initialization... 00:04:07.117 SPDK NVMe probe 00:04:07.117 Attaching to 0000:88:00.0 00:04:07.117 Attached to 0000:88:00.0 00:04:07.117 Cleaning up... 00:04:07.117 00:04:07.117 real 0m4.400s 00:04:07.117 user 0m3.306s 00:04:07.117 sys 0m0.157s 00:04:07.117 09:27:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:07.117 09:27:29 -- common/autotest_common.sh@10 -- # set +x 00:04:07.117 ************************************ 00:04:07.117 END TEST env_dpdk_post_init 00:04:07.117 ************************************ 00:04:07.117 09:27:29 -- env/env.sh@26 -- # uname 00:04:07.117 09:27:29 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:07.117 09:27:29 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:07.117 09:27:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.117 09:27:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.117 09:27:29 -- common/autotest_common.sh@10 -- # set +x 00:04:07.117 ************************************ 00:04:07.117 START TEST env_mem_callbacks 00:04:07.117 ************************************ 00:04:07.117 09:27:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:07.117 EAL: Detected CPU lcores: 48 00:04:07.117 EAL: Detected NUMA nodes: 2 00:04:07.117 EAL: Detected shared linkage of DPDK 00:04:07.117 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:07.117 EAL: Selected IOVA mode 'VA' 00:04:07.117 EAL: No free 2048 kB hugepages reported on node 1 00:04:07.117 EAL: VFIO support initialized 00:04:07.117 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:07.117 00:04:07.117 00:04:07.117 CUnit - A unit testing framework for C - Version 2.1-3 00:04:07.117 http://cunit.sourceforge.net/ 00:04:07.117 00:04:07.117 00:04:07.117 Suite: memory 00:04:07.117 Test: test ... 00:04:07.117 register 0x200000200000 2097152 00:04:07.117 malloc 3145728 00:04:07.117 register 0x200000400000 4194304 00:04:07.117 buf 0x200000500000 len 3145728 PASSED 00:04:07.117 malloc 64 00:04:07.117 buf 0x2000004fff40 len 64 PASSED 00:04:07.117 malloc 4194304 00:04:07.117 register 0x200000800000 6291456 00:04:07.117 buf 0x200000a00000 len 4194304 PASSED 00:04:07.117 free 0x200000500000 3145728 00:04:07.117 free 0x2000004fff40 64 00:04:07.117 unregister 0x200000400000 4194304 PASSED 00:04:07.117 free 0x200000a00000 4194304 00:04:07.117 unregister 0x200000800000 6291456 PASSED 00:04:07.117 malloc 8388608 00:04:07.117 register 0x200000400000 10485760 00:04:07.117 buf 0x200000600000 len 8388608 PASSED 00:04:07.117 free 0x200000600000 8388608 00:04:07.117 unregister 0x200000400000 10485760 PASSED 00:04:07.117 passed 00:04:07.117 00:04:07.117 Run Summary: Type Total Ran Passed Failed Inactive 00:04:07.117 suites 1 1 n/a 0 0 00:04:07.117 tests 1 1 1 0 0 00:04:07.117 asserts 15 15 15 0 n/a 00:04:07.117 00:04:07.117 Elapsed time = 0.005 seconds 00:04:07.117 00:04:07.117 real 0m0.048s 00:04:07.117 user 0m0.014s 00:04:07.117 sys 0m0.034s 00:04:07.117 09:27:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:07.117 09:27:29 -- common/autotest_common.sh@10 -- # set +x 00:04:07.117 ************************************ 00:04:07.117 END TEST env_mem_callbacks 00:04:07.117 ************************************ 00:04:07.117 00:04:07.117 real 0m6.394s 00:04:07.117 user 0m4.481s 00:04:07.117 sys 0m0.972s 00:04:07.117 09:27:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:07.117 09:27:29 -- common/autotest_common.sh@10 -- # set +x 00:04:07.117 ************************************ 00:04:07.117 END TEST env 00:04:07.117 ************************************ 00:04:07.117 09:27:29 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:07.117 09:27:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.117 09:27:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.117 09:27:29 -- common/autotest_common.sh@10 -- # set +x 00:04:07.117 ************************************ 00:04:07.117 START TEST rpc 00:04:07.117 ************************************ 00:04:07.117 09:27:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:07.117 * Looking for test storage... 00:04:07.117 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:07.117 09:27:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:07.117 09:27:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:07.117 09:27:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:07.375 09:27:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:07.375 09:27:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:07.375 09:27:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:07.375 09:27:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:07.375 09:27:29 -- scripts/common.sh@335 -- # IFS=.-: 00:04:07.375 09:27:29 -- scripts/common.sh@335 -- # read -ra ver1 00:04:07.375 09:27:29 -- scripts/common.sh@336 -- # IFS=.-: 00:04:07.375 09:27:29 -- scripts/common.sh@336 -- # read -ra ver2 00:04:07.375 09:27:29 -- scripts/common.sh@337 -- # local 'op=<' 00:04:07.375 09:27:29 -- scripts/common.sh@339 -- # ver1_l=2 00:04:07.375 09:27:29 -- scripts/common.sh@340 -- # ver2_l=1 00:04:07.375 09:27:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:07.375 09:27:29 -- scripts/common.sh@343 -- # case "$op" in 00:04:07.375 09:27:29 -- scripts/common.sh@344 -- # : 1 00:04:07.375 09:27:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:07.375 09:27:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:07.375 09:27:29 -- scripts/common.sh@364 -- # decimal 1 00:04:07.375 09:27:29 -- scripts/common.sh@352 -- # local d=1 00:04:07.375 09:27:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:07.375 09:27:29 -- scripts/common.sh@354 -- # echo 1 00:04:07.375 09:27:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:07.375 09:27:29 -- scripts/common.sh@365 -- # decimal 2 00:04:07.375 09:27:29 -- scripts/common.sh@352 -- # local d=2 00:04:07.375 09:27:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:07.375 09:27:29 -- scripts/common.sh@354 -- # echo 2 00:04:07.375 09:27:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:07.375 09:27:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:07.375 09:27:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:07.375 09:27:29 -- scripts/common.sh@367 -- # return 0 00:04:07.375 09:27:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:07.375 09:27:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:07.375 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.375 --rc genhtml_branch_coverage=1 00:04:07.375 --rc genhtml_function_coverage=1 00:04:07.375 --rc genhtml_legend=1 00:04:07.375 --rc geninfo_all_blocks=1 00:04:07.375 --rc geninfo_unexecuted_blocks=1 00:04:07.375 00:04:07.375 ' 00:04:07.375 09:27:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:07.375 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.375 --rc genhtml_branch_coverage=1 00:04:07.375 --rc genhtml_function_coverage=1 00:04:07.375 --rc genhtml_legend=1 00:04:07.375 --rc geninfo_all_blocks=1 00:04:07.375 --rc geninfo_unexecuted_blocks=1 00:04:07.375 00:04:07.375 ' 00:04:07.375 09:27:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:07.375 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.375 --rc genhtml_branch_coverage=1 00:04:07.375 --rc genhtml_function_coverage=1 00:04:07.375 --rc genhtml_legend=1 00:04:07.375 --rc geninfo_all_blocks=1 00:04:07.375 --rc geninfo_unexecuted_blocks=1 00:04:07.375 00:04:07.375 ' 00:04:07.375 09:27:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:07.375 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.375 --rc genhtml_branch_coverage=1 00:04:07.375 --rc genhtml_function_coverage=1 00:04:07.375 --rc genhtml_legend=1 00:04:07.375 --rc geninfo_all_blocks=1 00:04:07.375 --rc geninfo_unexecuted_blocks=1 00:04:07.375 00:04:07.375 ' 00:04:07.375 09:27:29 -- rpc/rpc.sh@65 -- # spdk_pid=4095431 00:04:07.375 09:27:29 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:07.375 09:27:29 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:07.375 09:27:29 -- rpc/rpc.sh@67 -- # waitforlisten 4095431 00:04:07.375 09:27:29 -- common/autotest_common.sh@829 -- # '[' -z 4095431 ']' 00:04:07.375 09:27:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:07.375 09:27:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:07.375 09:27:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:07.375 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:07.375 09:27:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:07.375 09:27:29 -- common/autotest_common.sh@10 -- # set +x 00:04:07.375 [2024-11-29 09:27:30.019654] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:07.376 [2024-11-29 09:27:30.019754] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4095431 ] 00:04:07.376 EAL: No free 2048 kB hugepages reported on node 1 00:04:07.376 [2024-11-29 09:27:30.081287] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:07.376 [2024-11-29 09:27:30.195058] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:07.376 [2024-11-29 09:27:30.195235] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:07.376 [2024-11-29 09:27:30.195256] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 4095431' to capture a snapshot of events at runtime. 00:04:07.376 [2024-11-29 09:27:30.195269] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid4095431 for offline analysis/debug. 00:04:07.376 [2024-11-29 09:27:30.195301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:08.306 09:27:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:08.306 09:27:30 -- common/autotest_common.sh@862 -- # return 0 00:04:08.306 09:27:30 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:08.306 09:27:30 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:08.306 09:27:30 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:08.306 09:27:30 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:08.307 09:27:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.307 09:27:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.307 09:27:30 -- common/autotest_common.sh@10 -- # set +x 00:04:08.307 ************************************ 00:04:08.307 START TEST rpc_integrity 00:04:08.307 ************************************ 00:04:08.307 09:27:30 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:08.307 09:27:30 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:08.307 09:27:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.307 09:27:30 -- common/autotest_common.sh@10 -- # set +x 00:04:08.307 09:27:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.307 09:27:30 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:08.307 09:27:30 -- rpc/rpc.sh@13 -- # jq length 00:04:08.307 09:27:31 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:08.307 09:27:31 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:08.307 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.307 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.307 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.307 09:27:31 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:08.307 09:27:31 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:08.307 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.307 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.307 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.307 09:27:31 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:08.307 { 00:04:08.307 "name": "Malloc0", 00:04:08.307 "aliases": [ 00:04:08.307 "18312207-dc9d-4ee2-a771-3838d2b7607f" 00:04:08.307 ], 00:04:08.307 "product_name": "Malloc disk", 00:04:08.307 "block_size": 512, 00:04:08.307 "num_blocks": 16384, 00:04:08.307 "uuid": "18312207-dc9d-4ee2-a771-3838d2b7607f", 00:04:08.307 "assigned_rate_limits": { 00:04:08.307 "rw_ios_per_sec": 0, 00:04:08.307 "rw_mbytes_per_sec": 0, 00:04:08.307 "r_mbytes_per_sec": 0, 00:04:08.307 "w_mbytes_per_sec": 0 00:04:08.307 }, 00:04:08.307 "claimed": false, 00:04:08.307 "zoned": false, 00:04:08.307 "supported_io_types": { 00:04:08.307 "read": true, 00:04:08.307 "write": true, 00:04:08.307 "unmap": true, 00:04:08.307 "write_zeroes": true, 00:04:08.307 "flush": true, 00:04:08.307 "reset": true, 00:04:08.307 "compare": false, 00:04:08.307 "compare_and_write": false, 00:04:08.307 "abort": true, 00:04:08.307 "nvme_admin": false, 00:04:08.307 "nvme_io": false 00:04:08.307 }, 00:04:08.307 "memory_domains": [ 00:04:08.307 { 00:04:08.307 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:08.307 "dma_device_type": 2 00:04:08.307 } 00:04:08.307 ], 00:04:08.307 "driver_specific": {} 00:04:08.307 } 00:04:08.307 ]' 00:04:08.307 09:27:31 -- rpc/rpc.sh@17 -- # jq length 00:04:08.307 09:27:31 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:08.307 09:27:31 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:08.307 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.307 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.307 [2024-11-29 09:27:31.083212] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:08.307 [2024-11-29 09:27:31.083268] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:08.307 [2024-11-29 09:27:31.083293] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1c74cb0 00:04:08.307 [2024-11-29 09:27:31.083309] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:08.307 [2024-11-29 09:27:31.084675] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:08.307 [2024-11-29 09:27:31.084716] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:08.307 Passthru0 00:04:08.307 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.307 09:27:31 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:08.307 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.307 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.307 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.307 09:27:31 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:08.307 { 00:04:08.307 "name": "Malloc0", 00:04:08.307 "aliases": [ 00:04:08.307 "18312207-dc9d-4ee2-a771-3838d2b7607f" 00:04:08.307 ], 00:04:08.307 "product_name": "Malloc disk", 00:04:08.307 "block_size": 512, 00:04:08.307 "num_blocks": 16384, 00:04:08.307 "uuid": "18312207-dc9d-4ee2-a771-3838d2b7607f", 00:04:08.307 "assigned_rate_limits": { 00:04:08.307 "rw_ios_per_sec": 0, 00:04:08.307 "rw_mbytes_per_sec": 0, 00:04:08.307 "r_mbytes_per_sec": 0, 00:04:08.307 "w_mbytes_per_sec": 0 00:04:08.307 }, 00:04:08.307 "claimed": true, 00:04:08.307 "claim_type": "exclusive_write", 00:04:08.307 "zoned": false, 00:04:08.307 "supported_io_types": { 00:04:08.307 "read": true, 00:04:08.307 "write": true, 00:04:08.307 "unmap": true, 00:04:08.307 "write_zeroes": true, 00:04:08.307 "flush": true, 00:04:08.307 "reset": true, 00:04:08.307 "compare": false, 00:04:08.307 "compare_and_write": false, 00:04:08.307 "abort": true, 00:04:08.307 "nvme_admin": false, 00:04:08.307 "nvme_io": false 00:04:08.307 }, 00:04:08.307 "memory_domains": [ 00:04:08.307 { 00:04:08.307 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:08.307 "dma_device_type": 2 00:04:08.307 } 00:04:08.307 ], 00:04:08.307 "driver_specific": {} 00:04:08.307 }, 00:04:08.307 { 00:04:08.307 "name": "Passthru0", 00:04:08.307 "aliases": [ 00:04:08.307 "5b48a195-c86d-5463-bdca-0ebbe3899e36" 00:04:08.307 ], 00:04:08.307 "product_name": "passthru", 00:04:08.307 "block_size": 512, 00:04:08.307 "num_blocks": 16384, 00:04:08.307 "uuid": "5b48a195-c86d-5463-bdca-0ebbe3899e36", 00:04:08.307 "assigned_rate_limits": { 00:04:08.307 "rw_ios_per_sec": 0, 00:04:08.307 "rw_mbytes_per_sec": 0, 00:04:08.307 "r_mbytes_per_sec": 0, 00:04:08.307 "w_mbytes_per_sec": 0 00:04:08.307 }, 00:04:08.307 "claimed": false, 00:04:08.307 "zoned": false, 00:04:08.307 "supported_io_types": { 00:04:08.307 "read": true, 00:04:08.307 "write": true, 00:04:08.307 "unmap": true, 00:04:08.307 "write_zeroes": true, 00:04:08.307 "flush": true, 00:04:08.307 "reset": true, 00:04:08.307 "compare": false, 00:04:08.307 "compare_and_write": false, 00:04:08.307 "abort": true, 00:04:08.307 "nvme_admin": false, 00:04:08.307 "nvme_io": false 00:04:08.307 }, 00:04:08.307 "memory_domains": [ 00:04:08.307 { 00:04:08.307 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:08.307 "dma_device_type": 2 00:04:08.307 } 00:04:08.307 ], 00:04:08.307 "driver_specific": { 00:04:08.307 "passthru": { 00:04:08.307 "name": "Passthru0", 00:04:08.307 "base_bdev_name": "Malloc0" 00:04:08.307 } 00:04:08.307 } 00:04:08.307 } 00:04:08.307 ]' 00:04:08.307 09:27:31 -- rpc/rpc.sh@21 -- # jq length 00:04:08.307 09:27:31 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:08.307 09:27:31 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:08.307 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.307 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.307 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.307 09:27:31 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:08.307 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.307 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.564 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.564 09:27:31 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:08.564 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.564 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.564 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.564 09:27:31 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:08.564 09:27:31 -- rpc/rpc.sh@26 -- # jq length 00:04:08.564 09:27:31 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:08.564 00:04:08.564 real 0m0.226s 00:04:08.564 user 0m0.146s 00:04:08.564 sys 0m0.018s 00:04:08.564 09:27:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:08.564 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.564 ************************************ 00:04:08.564 END TEST rpc_integrity 00:04:08.564 ************************************ 00:04:08.564 09:27:31 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:08.564 09:27:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.564 09:27:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.564 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.564 ************************************ 00:04:08.564 START TEST rpc_plugins 00:04:08.564 ************************************ 00:04:08.564 09:27:31 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:08.564 09:27:31 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:08.564 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.564 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.564 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.564 09:27:31 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:08.564 09:27:31 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:08.564 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.564 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.564 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.564 09:27:31 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:08.564 { 00:04:08.564 "name": "Malloc1", 00:04:08.564 "aliases": [ 00:04:08.564 "4264bca8-6aa2-4043-bc62-2563f1893004" 00:04:08.564 ], 00:04:08.564 "product_name": "Malloc disk", 00:04:08.564 "block_size": 4096, 00:04:08.564 "num_blocks": 256, 00:04:08.564 "uuid": "4264bca8-6aa2-4043-bc62-2563f1893004", 00:04:08.564 "assigned_rate_limits": { 00:04:08.564 "rw_ios_per_sec": 0, 00:04:08.564 "rw_mbytes_per_sec": 0, 00:04:08.564 "r_mbytes_per_sec": 0, 00:04:08.564 "w_mbytes_per_sec": 0 00:04:08.564 }, 00:04:08.564 "claimed": false, 00:04:08.564 "zoned": false, 00:04:08.564 "supported_io_types": { 00:04:08.564 "read": true, 00:04:08.564 "write": true, 00:04:08.564 "unmap": true, 00:04:08.564 "write_zeroes": true, 00:04:08.564 "flush": true, 00:04:08.564 "reset": true, 00:04:08.564 "compare": false, 00:04:08.564 "compare_and_write": false, 00:04:08.564 "abort": true, 00:04:08.564 "nvme_admin": false, 00:04:08.564 "nvme_io": false 00:04:08.564 }, 00:04:08.564 "memory_domains": [ 00:04:08.564 { 00:04:08.564 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:08.564 "dma_device_type": 2 00:04:08.564 } 00:04:08.564 ], 00:04:08.564 "driver_specific": {} 00:04:08.564 } 00:04:08.564 ]' 00:04:08.564 09:27:31 -- rpc/rpc.sh@32 -- # jq length 00:04:08.564 09:27:31 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:08.564 09:27:31 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:08.564 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.564 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.564 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.564 09:27:31 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:08.564 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.564 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.564 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.564 09:27:31 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:08.564 09:27:31 -- rpc/rpc.sh@36 -- # jq length 00:04:08.564 09:27:31 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:08.564 00:04:08.564 real 0m0.112s 00:04:08.564 user 0m0.075s 00:04:08.564 sys 0m0.009s 00:04:08.564 09:27:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:08.564 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.564 ************************************ 00:04:08.564 END TEST rpc_plugins 00:04:08.564 ************************************ 00:04:08.564 09:27:31 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:08.564 09:27:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.564 09:27:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.564 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.564 ************************************ 00:04:08.564 START TEST rpc_trace_cmd_test 00:04:08.564 ************************************ 00:04:08.564 09:27:31 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:08.564 09:27:31 -- rpc/rpc.sh@40 -- # local info 00:04:08.564 09:27:31 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:08.564 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.564 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.564 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.564 09:27:31 -- rpc/rpc.sh@42 -- # info='{ 00:04:08.564 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid4095431", 00:04:08.564 "tpoint_group_mask": "0x8", 00:04:08.564 "iscsi_conn": { 00:04:08.564 "mask": "0x2", 00:04:08.564 "tpoint_mask": "0x0" 00:04:08.564 }, 00:04:08.564 "scsi": { 00:04:08.564 "mask": "0x4", 00:04:08.564 "tpoint_mask": "0x0" 00:04:08.564 }, 00:04:08.564 "bdev": { 00:04:08.564 "mask": "0x8", 00:04:08.564 "tpoint_mask": "0xffffffffffffffff" 00:04:08.564 }, 00:04:08.564 "nvmf_rdma": { 00:04:08.564 "mask": "0x10", 00:04:08.564 "tpoint_mask": "0x0" 00:04:08.564 }, 00:04:08.564 "nvmf_tcp": { 00:04:08.564 "mask": "0x20", 00:04:08.564 "tpoint_mask": "0x0" 00:04:08.564 }, 00:04:08.564 "ftl": { 00:04:08.564 "mask": "0x40", 00:04:08.564 "tpoint_mask": "0x0" 00:04:08.564 }, 00:04:08.564 "blobfs": { 00:04:08.564 "mask": "0x80", 00:04:08.564 "tpoint_mask": "0x0" 00:04:08.564 }, 00:04:08.564 "dsa": { 00:04:08.564 "mask": "0x200", 00:04:08.564 "tpoint_mask": "0x0" 00:04:08.564 }, 00:04:08.564 "thread": { 00:04:08.564 "mask": "0x400", 00:04:08.564 "tpoint_mask": "0x0" 00:04:08.564 }, 00:04:08.564 "nvme_pcie": { 00:04:08.564 "mask": "0x800", 00:04:08.564 "tpoint_mask": "0x0" 00:04:08.564 }, 00:04:08.564 "iaa": { 00:04:08.564 "mask": "0x1000", 00:04:08.564 "tpoint_mask": "0x0" 00:04:08.564 }, 00:04:08.564 "nvme_tcp": { 00:04:08.564 "mask": "0x2000", 00:04:08.564 "tpoint_mask": "0x0" 00:04:08.564 }, 00:04:08.564 "bdev_nvme": { 00:04:08.564 "mask": "0x4000", 00:04:08.564 "tpoint_mask": "0x0" 00:04:08.564 } 00:04:08.564 }' 00:04:08.564 09:27:31 -- rpc/rpc.sh@43 -- # jq length 00:04:08.822 09:27:31 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:08.822 09:27:31 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:08.822 09:27:31 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:08.822 09:27:31 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:08.822 09:27:31 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:08.822 09:27:31 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:08.822 09:27:31 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:08.822 09:27:31 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:08.822 09:27:31 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:08.822 00:04:08.822 real 0m0.190s 00:04:08.822 user 0m0.171s 00:04:08.822 sys 0m0.012s 00:04:08.822 09:27:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:08.822 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.822 ************************************ 00:04:08.822 END TEST rpc_trace_cmd_test 00:04:08.822 ************************************ 00:04:08.822 09:27:31 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:08.822 09:27:31 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:08.822 09:27:31 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:08.822 09:27:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.822 09:27:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.822 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.822 ************************************ 00:04:08.822 START TEST rpc_daemon_integrity 00:04:08.822 ************************************ 00:04:08.822 09:27:31 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:08.822 09:27:31 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:08.822 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.822 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.822 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.822 09:27:31 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:08.822 09:27:31 -- rpc/rpc.sh@13 -- # jq length 00:04:08.822 09:27:31 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:08.822 09:27:31 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:08.822 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.822 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.822 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.822 09:27:31 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:08.822 09:27:31 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:08.822 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:08.822 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:08.822 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:08.822 09:27:31 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:08.822 { 00:04:08.822 "name": "Malloc2", 00:04:08.822 "aliases": [ 00:04:08.822 "8ece531a-3587-4a78-81c1-0595d8975fc2" 00:04:08.822 ], 00:04:08.822 "product_name": "Malloc disk", 00:04:08.822 "block_size": 512, 00:04:08.822 "num_blocks": 16384, 00:04:08.822 "uuid": "8ece531a-3587-4a78-81c1-0595d8975fc2", 00:04:08.822 "assigned_rate_limits": { 00:04:08.822 "rw_ios_per_sec": 0, 00:04:08.822 "rw_mbytes_per_sec": 0, 00:04:08.822 "r_mbytes_per_sec": 0, 00:04:08.822 "w_mbytes_per_sec": 0 00:04:08.822 }, 00:04:08.822 "claimed": false, 00:04:08.822 "zoned": false, 00:04:08.822 "supported_io_types": { 00:04:08.822 "read": true, 00:04:08.822 "write": true, 00:04:08.822 "unmap": true, 00:04:08.822 "write_zeroes": true, 00:04:08.822 "flush": true, 00:04:08.822 "reset": true, 00:04:08.822 "compare": false, 00:04:08.822 "compare_and_write": false, 00:04:08.822 "abort": true, 00:04:08.822 "nvme_admin": false, 00:04:08.822 "nvme_io": false 00:04:08.822 }, 00:04:08.822 "memory_domains": [ 00:04:08.822 { 00:04:08.822 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:08.822 "dma_device_type": 2 00:04:08.822 } 00:04:08.822 ], 00:04:08.822 "driver_specific": {} 00:04:08.822 } 00:04:08.822 ]' 00:04:08.822 09:27:31 -- rpc/rpc.sh@17 -- # jq length 00:04:09.080 09:27:31 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:09.080 09:27:31 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:09.080 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.080 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:09.080 [2024-11-29 09:27:31.688961] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:09.080 [2024-11-29 09:27:31.689014] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:09.080 [2024-11-29 09:27:31.689040] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1c76590 00:04:09.080 [2024-11-29 09:27:31.689055] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:09.080 [2024-11-29 09:27:31.690350] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:09.080 [2024-11-29 09:27:31.690378] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:09.080 Passthru0 00:04:09.080 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.080 09:27:31 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:09.080 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.080 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:09.080 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.080 09:27:31 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:09.080 { 00:04:09.080 "name": "Malloc2", 00:04:09.080 "aliases": [ 00:04:09.080 "8ece531a-3587-4a78-81c1-0595d8975fc2" 00:04:09.080 ], 00:04:09.080 "product_name": "Malloc disk", 00:04:09.080 "block_size": 512, 00:04:09.080 "num_blocks": 16384, 00:04:09.080 "uuid": "8ece531a-3587-4a78-81c1-0595d8975fc2", 00:04:09.080 "assigned_rate_limits": { 00:04:09.080 "rw_ios_per_sec": 0, 00:04:09.080 "rw_mbytes_per_sec": 0, 00:04:09.080 "r_mbytes_per_sec": 0, 00:04:09.080 "w_mbytes_per_sec": 0 00:04:09.080 }, 00:04:09.080 "claimed": true, 00:04:09.080 "claim_type": "exclusive_write", 00:04:09.080 "zoned": false, 00:04:09.080 "supported_io_types": { 00:04:09.080 "read": true, 00:04:09.080 "write": true, 00:04:09.080 "unmap": true, 00:04:09.080 "write_zeroes": true, 00:04:09.080 "flush": true, 00:04:09.080 "reset": true, 00:04:09.081 "compare": false, 00:04:09.081 "compare_and_write": false, 00:04:09.081 "abort": true, 00:04:09.081 "nvme_admin": false, 00:04:09.081 "nvme_io": false 00:04:09.081 }, 00:04:09.081 "memory_domains": [ 00:04:09.081 { 00:04:09.081 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:09.081 "dma_device_type": 2 00:04:09.081 } 00:04:09.081 ], 00:04:09.081 "driver_specific": {} 00:04:09.081 }, 00:04:09.081 { 00:04:09.081 "name": "Passthru0", 00:04:09.081 "aliases": [ 00:04:09.081 "c3e64022-fa41-5428-9652-038d7c38363a" 00:04:09.081 ], 00:04:09.081 "product_name": "passthru", 00:04:09.081 "block_size": 512, 00:04:09.081 "num_blocks": 16384, 00:04:09.081 "uuid": "c3e64022-fa41-5428-9652-038d7c38363a", 00:04:09.081 "assigned_rate_limits": { 00:04:09.081 "rw_ios_per_sec": 0, 00:04:09.081 "rw_mbytes_per_sec": 0, 00:04:09.081 "r_mbytes_per_sec": 0, 00:04:09.081 "w_mbytes_per_sec": 0 00:04:09.081 }, 00:04:09.081 "claimed": false, 00:04:09.081 "zoned": false, 00:04:09.081 "supported_io_types": { 00:04:09.081 "read": true, 00:04:09.081 "write": true, 00:04:09.081 "unmap": true, 00:04:09.081 "write_zeroes": true, 00:04:09.081 "flush": true, 00:04:09.081 "reset": true, 00:04:09.081 "compare": false, 00:04:09.081 "compare_and_write": false, 00:04:09.081 "abort": true, 00:04:09.081 "nvme_admin": false, 00:04:09.081 "nvme_io": false 00:04:09.081 }, 00:04:09.081 "memory_domains": [ 00:04:09.081 { 00:04:09.081 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:09.081 "dma_device_type": 2 00:04:09.081 } 00:04:09.081 ], 00:04:09.081 "driver_specific": { 00:04:09.081 "passthru": { 00:04:09.081 "name": "Passthru0", 00:04:09.081 "base_bdev_name": "Malloc2" 00:04:09.081 } 00:04:09.081 } 00:04:09.081 } 00:04:09.081 ]' 00:04:09.081 09:27:31 -- rpc/rpc.sh@21 -- # jq length 00:04:09.081 09:27:31 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:09.081 09:27:31 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:09.081 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.081 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:09.081 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.081 09:27:31 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:09.081 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.081 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:09.081 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.081 09:27:31 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:09.081 09:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:09.081 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:09.081 09:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:09.081 09:27:31 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:09.081 09:27:31 -- rpc/rpc.sh@26 -- # jq length 00:04:09.081 09:27:31 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:09.081 00:04:09.081 real 0m0.230s 00:04:09.081 user 0m0.154s 00:04:09.081 sys 0m0.018s 00:04:09.081 09:27:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:09.081 09:27:31 -- common/autotest_common.sh@10 -- # set +x 00:04:09.081 ************************************ 00:04:09.081 END TEST rpc_daemon_integrity 00:04:09.081 ************************************ 00:04:09.081 09:27:31 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:09.081 09:27:31 -- rpc/rpc.sh@84 -- # killprocess 4095431 00:04:09.081 09:27:31 -- common/autotest_common.sh@936 -- # '[' -z 4095431 ']' 00:04:09.081 09:27:31 -- common/autotest_common.sh@940 -- # kill -0 4095431 00:04:09.081 09:27:31 -- common/autotest_common.sh@941 -- # uname 00:04:09.081 09:27:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:09.081 09:27:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4095431 00:04:09.081 09:27:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:09.081 09:27:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:09.081 09:27:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4095431' 00:04:09.081 killing process with pid 4095431 00:04:09.081 09:27:31 -- common/autotest_common.sh@955 -- # kill 4095431 00:04:09.081 09:27:31 -- common/autotest_common.sh@960 -- # wait 4095431 00:04:09.646 00:04:09.646 real 0m2.502s 00:04:09.646 user 0m3.140s 00:04:09.646 sys 0m0.594s 00:04:09.646 09:27:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:09.646 09:27:32 -- common/autotest_common.sh@10 -- # set +x 00:04:09.646 ************************************ 00:04:09.646 END TEST rpc 00:04:09.646 ************************************ 00:04:09.646 09:27:32 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:09.646 09:27:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:09.646 09:27:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.646 09:27:32 -- common/autotest_common.sh@10 -- # set +x 00:04:09.646 ************************************ 00:04:09.646 START TEST rpc_client 00:04:09.646 ************************************ 00:04:09.646 09:27:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:09.646 * Looking for test storage... 00:04:09.646 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:09.646 09:27:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:09.646 09:27:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:09.646 09:27:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:09.646 09:27:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:09.905 09:27:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:09.905 09:27:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:09.905 09:27:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:09.905 09:27:32 -- scripts/common.sh@335 -- # IFS=.-: 00:04:09.905 09:27:32 -- scripts/common.sh@335 -- # read -ra ver1 00:04:09.905 09:27:32 -- scripts/common.sh@336 -- # IFS=.-: 00:04:09.905 09:27:32 -- scripts/common.sh@336 -- # read -ra ver2 00:04:09.905 09:27:32 -- scripts/common.sh@337 -- # local 'op=<' 00:04:09.905 09:27:32 -- scripts/common.sh@339 -- # ver1_l=2 00:04:09.905 09:27:32 -- scripts/common.sh@340 -- # ver2_l=1 00:04:09.905 09:27:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:09.905 09:27:32 -- scripts/common.sh@343 -- # case "$op" in 00:04:09.905 09:27:32 -- scripts/common.sh@344 -- # : 1 00:04:09.905 09:27:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:09.905 09:27:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:09.906 09:27:32 -- scripts/common.sh@364 -- # decimal 1 00:04:09.906 09:27:32 -- scripts/common.sh@352 -- # local d=1 00:04:09.906 09:27:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:09.906 09:27:32 -- scripts/common.sh@354 -- # echo 1 00:04:09.906 09:27:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:09.906 09:27:32 -- scripts/common.sh@365 -- # decimal 2 00:04:09.906 09:27:32 -- scripts/common.sh@352 -- # local d=2 00:04:09.906 09:27:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:09.906 09:27:32 -- scripts/common.sh@354 -- # echo 2 00:04:09.906 09:27:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:09.906 09:27:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:09.906 09:27:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:09.906 09:27:32 -- scripts/common.sh@367 -- # return 0 00:04:09.906 09:27:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:09.906 09:27:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:09.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.906 --rc genhtml_branch_coverage=1 00:04:09.906 --rc genhtml_function_coverage=1 00:04:09.906 --rc genhtml_legend=1 00:04:09.906 --rc geninfo_all_blocks=1 00:04:09.906 --rc geninfo_unexecuted_blocks=1 00:04:09.906 00:04:09.906 ' 00:04:09.906 09:27:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:09.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.906 --rc genhtml_branch_coverage=1 00:04:09.906 --rc genhtml_function_coverage=1 00:04:09.906 --rc genhtml_legend=1 00:04:09.906 --rc geninfo_all_blocks=1 00:04:09.906 --rc geninfo_unexecuted_blocks=1 00:04:09.906 00:04:09.906 ' 00:04:09.906 09:27:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:09.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.906 --rc genhtml_branch_coverage=1 00:04:09.906 --rc genhtml_function_coverage=1 00:04:09.906 --rc genhtml_legend=1 00:04:09.906 --rc geninfo_all_blocks=1 00:04:09.906 --rc geninfo_unexecuted_blocks=1 00:04:09.906 00:04:09.906 ' 00:04:09.906 09:27:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:09.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.906 --rc genhtml_branch_coverage=1 00:04:09.906 --rc genhtml_function_coverage=1 00:04:09.906 --rc genhtml_legend=1 00:04:09.906 --rc geninfo_all_blocks=1 00:04:09.906 --rc geninfo_unexecuted_blocks=1 00:04:09.906 00:04:09.906 ' 00:04:09.906 09:27:32 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:09.906 OK 00:04:09.906 09:27:32 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:09.906 00:04:09.906 real 0m0.150s 00:04:09.906 user 0m0.101s 00:04:09.906 sys 0m0.057s 00:04:09.906 09:27:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:09.906 09:27:32 -- common/autotest_common.sh@10 -- # set +x 00:04:09.906 ************************************ 00:04:09.906 END TEST rpc_client 00:04:09.906 ************************************ 00:04:09.906 09:27:32 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:09.906 09:27:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:09.906 09:27:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.906 09:27:32 -- common/autotest_common.sh@10 -- # set +x 00:04:09.906 ************************************ 00:04:09.906 START TEST json_config 00:04:09.906 ************************************ 00:04:09.906 09:27:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:09.906 09:27:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:09.906 09:27:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:09.906 09:27:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:09.906 09:27:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:09.906 09:27:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:09.906 09:27:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:09.906 09:27:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:09.906 09:27:32 -- scripts/common.sh@335 -- # IFS=.-: 00:04:09.906 09:27:32 -- scripts/common.sh@335 -- # read -ra ver1 00:04:09.906 09:27:32 -- scripts/common.sh@336 -- # IFS=.-: 00:04:09.906 09:27:32 -- scripts/common.sh@336 -- # read -ra ver2 00:04:09.906 09:27:32 -- scripts/common.sh@337 -- # local 'op=<' 00:04:09.906 09:27:32 -- scripts/common.sh@339 -- # ver1_l=2 00:04:09.906 09:27:32 -- scripts/common.sh@340 -- # ver2_l=1 00:04:09.906 09:27:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:09.906 09:27:32 -- scripts/common.sh@343 -- # case "$op" in 00:04:09.906 09:27:32 -- scripts/common.sh@344 -- # : 1 00:04:09.906 09:27:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:09.906 09:27:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:09.906 09:27:32 -- scripts/common.sh@364 -- # decimal 1 00:04:09.906 09:27:32 -- scripts/common.sh@352 -- # local d=1 00:04:09.906 09:27:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:09.906 09:27:32 -- scripts/common.sh@354 -- # echo 1 00:04:09.906 09:27:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:09.906 09:27:32 -- scripts/common.sh@365 -- # decimal 2 00:04:09.906 09:27:32 -- scripts/common.sh@352 -- # local d=2 00:04:09.906 09:27:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:09.906 09:27:32 -- scripts/common.sh@354 -- # echo 2 00:04:09.906 09:27:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:09.906 09:27:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:09.906 09:27:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:09.906 09:27:32 -- scripts/common.sh@367 -- # return 0 00:04:09.906 09:27:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:09.906 09:27:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:09.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.906 --rc genhtml_branch_coverage=1 00:04:09.906 --rc genhtml_function_coverage=1 00:04:09.906 --rc genhtml_legend=1 00:04:09.906 --rc geninfo_all_blocks=1 00:04:09.906 --rc geninfo_unexecuted_blocks=1 00:04:09.906 00:04:09.906 ' 00:04:09.906 09:27:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:09.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.906 --rc genhtml_branch_coverage=1 00:04:09.906 --rc genhtml_function_coverage=1 00:04:09.906 --rc genhtml_legend=1 00:04:09.906 --rc geninfo_all_blocks=1 00:04:09.906 --rc geninfo_unexecuted_blocks=1 00:04:09.906 00:04:09.906 ' 00:04:09.906 09:27:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:09.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.906 --rc genhtml_branch_coverage=1 00:04:09.906 --rc genhtml_function_coverage=1 00:04:09.906 --rc genhtml_legend=1 00:04:09.906 --rc geninfo_all_blocks=1 00:04:09.906 --rc geninfo_unexecuted_blocks=1 00:04:09.906 00:04:09.906 ' 00:04:09.906 09:27:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:09.906 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.906 --rc genhtml_branch_coverage=1 00:04:09.906 --rc genhtml_function_coverage=1 00:04:09.906 --rc genhtml_legend=1 00:04:09.906 --rc geninfo_all_blocks=1 00:04:09.906 --rc geninfo_unexecuted_blocks=1 00:04:09.906 00:04:09.906 ' 00:04:09.906 09:27:32 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:09.906 09:27:32 -- nvmf/common.sh@7 -- # uname -s 00:04:09.906 09:27:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:09.906 09:27:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:09.906 09:27:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:09.906 09:27:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:09.906 09:27:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:09.906 09:27:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:09.906 09:27:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:09.906 09:27:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:09.906 09:27:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:09.906 09:27:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:09.906 09:27:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:09.906 09:27:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:09.906 09:27:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:09.906 09:27:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:09.906 09:27:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:09.906 09:27:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:09.906 09:27:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:09.906 09:27:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:09.906 09:27:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:09.906 09:27:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:09.906 09:27:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:09.906 09:27:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:09.906 09:27:32 -- paths/export.sh@5 -- # export PATH 00:04:09.906 09:27:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:09.906 09:27:32 -- nvmf/common.sh@46 -- # : 0 00:04:09.907 09:27:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:09.907 09:27:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:09.907 09:27:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:09.907 09:27:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:09.907 09:27:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:09.907 09:27:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:09.907 09:27:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:09.907 09:27:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:09.907 09:27:32 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:09.907 09:27:32 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:09.907 09:27:32 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:09.907 09:27:32 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:09.907 09:27:32 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:09.907 09:27:32 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:09.907 09:27:32 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:09.907 09:27:32 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:09.907 09:27:32 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:09.907 09:27:32 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:09.907 09:27:32 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:09.907 09:27:32 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:09.907 09:27:32 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:09.907 09:27:32 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:09.907 09:27:32 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:09.907 INFO: JSON configuration test init 00:04:09.907 09:27:32 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:09.907 09:27:32 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:09.907 09:27:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:09.907 09:27:32 -- common/autotest_common.sh@10 -- # set +x 00:04:09.907 09:27:32 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:09.907 09:27:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:09.907 09:27:32 -- common/autotest_common.sh@10 -- # set +x 00:04:09.907 09:27:32 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:09.907 09:27:32 -- json_config/json_config.sh@98 -- # local app=target 00:04:09.907 09:27:32 -- json_config/json_config.sh@99 -- # shift 00:04:09.907 09:27:32 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:09.907 09:27:32 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:09.907 09:27:32 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:09.907 09:27:32 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:09.907 09:27:32 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:09.907 09:27:32 -- json_config/json_config.sh@111 -- # app_pid[$app]=4095934 00:04:09.907 09:27:32 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:09.907 09:27:32 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:09.907 Waiting for target to run... 00:04:09.907 09:27:32 -- json_config/json_config.sh@114 -- # waitforlisten 4095934 /var/tmp/spdk_tgt.sock 00:04:09.907 09:27:32 -- common/autotest_common.sh@829 -- # '[' -z 4095934 ']' 00:04:09.907 09:27:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:09.907 09:27:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:09.907 09:27:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:09.907 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:09.907 09:27:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:09.907 09:27:32 -- common/autotest_common.sh@10 -- # set +x 00:04:09.907 [2024-11-29 09:27:32.720105] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:09.907 [2024-11-29 09:27:32.720185] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4095934 ] 00:04:10.166 EAL: No free 2048 kB hugepages reported on node 1 00:04:10.424 [2024-11-29 09:27:33.065317] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:10.424 [2024-11-29 09:27:33.153246] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:10.424 [2024-11-29 09:27:33.153467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:11.029 09:27:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:11.029 09:27:33 -- common/autotest_common.sh@862 -- # return 0 00:04:11.029 09:27:33 -- json_config/json_config.sh@115 -- # echo '' 00:04:11.029 00:04:11.029 09:27:33 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:11.029 09:27:33 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:11.029 09:27:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:11.029 09:27:33 -- common/autotest_common.sh@10 -- # set +x 00:04:11.029 09:27:33 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:11.029 09:27:33 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:11.029 09:27:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:11.029 09:27:33 -- common/autotest_common.sh@10 -- # set +x 00:04:11.029 09:27:33 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:11.029 09:27:33 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:11.029 09:27:33 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:14.343 09:27:36 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:14.343 09:27:36 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:14.343 09:27:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:14.343 09:27:36 -- common/autotest_common.sh@10 -- # set +x 00:04:14.343 09:27:36 -- json_config/json_config.sh@48 -- # local ret=0 00:04:14.343 09:27:36 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:14.343 09:27:36 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:14.343 09:27:36 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:14.343 09:27:36 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:14.343 09:27:36 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:14.343 09:27:37 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:14.343 09:27:37 -- json_config/json_config.sh@51 -- # local get_types 00:04:14.343 09:27:37 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:14.343 09:27:37 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:14.343 09:27:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:14.343 09:27:37 -- common/autotest_common.sh@10 -- # set +x 00:04:14.343 09:27:37 -- json_config/json_config.sh@58 -- # return 0 00:04:14.343 09:27:37 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:14.343 09:27:37 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:14.343 09:27:37 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:14.343 09:27:37 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:14.343 09:27:37 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:14.343 09:27:37 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:14.343 09:27:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:14.343 09:27:37 -- common/autotest_common.sh@10 -- # set +x 00:04:14.343 09:27:37 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:14.343 09:27:37 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:14.343 09:27:37 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:14.343 09:27:37 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:14.343 09:27:37 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:14.602 MallocForNvmf0 00:04:14.602 09:27:37 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:14.602 09:27:37 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:14.860 MallocForNvmf1 00:04:14.860 09:27:37 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:14.860 09:27:37 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:15.118 [2024-11-29 09:27:37.911716] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:15.118 09:27:37 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:15.118 09:27:37 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:15.376 09:27:38 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:15.376 09:27:38 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:15.641 09:27:38 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:15.642 09:27:38 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:15.901 09:27:38 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:15.901 09:27:38 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:16.159 [2024-11-29 09:27:38.923134] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:16.159 09:27:38 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:16.159 09:27:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:16.159 09:27:38 -- common/autotest_common.sh@10 -- # set +x 00:04:16.159 09:27:38 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:16.159 09:27:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:16.159 09:27:38 -- common/autotest_common.sh@10 -- # set +x 00:04:16.159 09:27:38 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:16.159 09:27:38 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:16.159 09:27:38 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:16.417 MallocBdevForConfigChangeCheck 00:04:16.417 09:27:39 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:16.417 09:27:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:16.417 09:27:39 -- common/autotest_common.sh@10 -- # set +x 00:04:16.417 09:27:39 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:16.417 09:27:39 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:16.983 09:27:39 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:16.983 INFO: shutting down applications... 00:04:16.983 09:27:39 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:16.983 09:27:39 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:16.983 09:27:39 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:16.983 09:27:39 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:18.884 Calling clear_iscsi_subsystem 00:04:18.884 Calling clear_nvmf_subsystem 00:04:18.884 Calling clear_nbd_subsystem 00:04:18.884 Calling clear_ublk_subsystem 00:04:18.884 Calling clear_vhost_blk_subsystem 00:04:18.884 Calling clear_vhost_scsi_subsystem 00:04:18.884 Calling clear_scheduler_subsystem 00:04:18.884 Calling clear_bdev_subsystem 00:04:18.884 Calling clear_accel_subsystem 00:04:18.884 Calling clear_vmd_subsystem 00:04:18.884 Calling clear_sock_subsystem 00:04:18.884 Calling clear_iobuf_subsystem 00:04:18.884 09:27:41 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:18.884 09:27:41 -- json_config/json_config.sh@396 -- # count=100 00:04:18.884 09:27:41 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:18.884 09:27:41 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:18.884 09:27:41 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:18.884 09:27:41 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:18.884 09:27:41 -- json_config/json_config.sh@398 -- # break 00:04:18.884 09:27:41 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:18.884 09:27:41 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:18.884 09:27:41 -- json_config/json_config.sh@120 -- # local app=target 00:04:18.884 09:27:41 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:18.884 09:27:41 -- json_config/json_config.sh@124 -- # [[ -n 4095934 ]] 00:04:18.884 09:27:41 -- json_config/json_config.sh@127 -- # kill -SIGINT 4095934 00:04:18.884 09:27:41 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:18.884 09:27:41 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:18.884 09:27:41 -- json_config/json_config.sh@130 -- # kill -0 4095934 00:04:18.884 09:27:41 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:19.454 09:27:42 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:19.454 09:27:42 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:19.454 09:27:42 -- json_config/json_config.sh@130 -- # kill -0 4095934 00:04:19.454 09:27:42 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:19.454 09:27:42 -- json_config/json_config.sh@132 -- # break 00:04:19.454 09:27:42 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:19.454 09:27:42 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:19.454 SPDK target shutdown done 00:04:19.454 09:27:42 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:19.454 INFO: relaunching applications... 00:04:19.454 09:27:42 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:19.454 09:27:42 -- json_config/json_config.sh@98 -- # local app=target 00:04:19.454 09:27:42 -- json_config/json_config.sh@99 -- # shift 00:04:19.454 09:27:42 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:19.454 09:27:42 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:19.454 09:27:42 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:19.454 09:27:42 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:19.454 09:27:42 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:19.454 09:27:42 -- json_config/json_config.sh@111 -- # app_pid[$app]=4097280 00:04:19.454 09:27:42 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:19.454 09:27:42 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:19.454 Waiting for target to run... 00:04:19.454 09:27:42 -- json_config/json_config.sh@114 -- # waitforlisten 4097280 /var/tmp/spdk_tgt.sock 00:04:19.454 09:27:42 -- common/autotest_common.sh@829 -- # '[' -z 4097280 ']' 00:04:19.454 09:27:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:19.454 09:27:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:19.454 09:27:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:19.454 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:19.454 09:27:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:19.454 09:27:42 -- common/autotest_common.sh@10 -- # set +x 00:04:19.454 [2024-11-29 09:27:42.142199] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:19.454 [2024-11-29 09:27:42.142291] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4097280 ] 00:04:19.454 EAL: No free 2048 kB hugepages reported on node 1 00:04:20.037 [2024-11-29 09:27:42.685242] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:20.037 [2024-11-29 09:27:42.787289] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:20.037 [2024-11-29 09:27:42.787521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:23.322 [2024-11-29 09:27:45.823269] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:23.322 [2024-11-29 09:27:45.855754] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:23.322 09:27:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:23.322 09:27:46 -- common/autotest_common.sh@862 -- # return 0 00:04:23.322 09:27:46 -- json_config/json_config.sh@115 -- # echo '' 00:04:23.322 00:04:23.322 09:27:46 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:23.322 09:27:46 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:23.322 INFO: Checking if target configuration is the same... 00:04:23.322 09:27:46 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:23.322 09:27:46 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:23.322 09:27:46 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:23.322 + '[' 2 -ne 2 ']' 00:04:23.322 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:23.322 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:23.322 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:23.322 +++ basename /dev/fd/62 00:04:23.322 ++ mktemp /tmp/62.XXX 00:04:23.322 + tmp_file_1=/tmp/62.PqN 00:04:23.322 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:23.322 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:23.322 + tmp_file_2=/tmp/spdk_tgt_config.json.F6N 00:04:23.322 + ret=0 00:04:23.322 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:23.580 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:23.837 + diff -u /tmp/62.PqN /tmp/spdk_tgt_config.json.F6N 00:04:23.837 + echo 'INFO: JSON config files are the same' 00:04:23.837 INFO: JSON config files are the same 00:04:23.837 + rm /tmp/62.PqN /tmp/spdk_tgt_config.json.F6N 00:04:23.837 + exit 0 00:04:23.837 09:27:46 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:23.837 09:27:46 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:23.837 INFO: changing configuration and checking if this can be detected... 00:04:23.837 09:27:46 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:23.837 09:27:46 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:24.095 09:27:46 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:24.095 09:27:46 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:24.095 09:27:46 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:24.095 + '[' 2 -ne 2 ']' 00:04:24.095 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:24.095 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:24.095 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:24.095 +++ basename /dev/fd/62 00:04:24.095 ++ mktemp /tmp/62.XXX 00:04:24.095 + tmp_file_1=/tmp/62.Vzm 00:04:24.095 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:24.095 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:24.095 + tmp_file_2=/tmp/spdk_tgt_config.json.2Ez 00:04:24.095 + ret=0 00:04:24.095 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:24.353 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:24.353 + diff -u /tmp/62.Vzm /tmp/spdk_tgt_config.json.2Ez 00:04:24.353 + ret=1 00:04:24.353 + echo '=== Start of file: /tmp/62.Vzm ===' 00:04:24.353 + cat /tmp/62.Vzm 00:04:24.353 + echo '=== End of file: /tmp/62.Vzm ===' 00:04:24.353 + echo '' 00:04:24.353 + echo '=== Start of file: /tmp/spdk_tgt_config.json.2Ez ===' 00:04:24.353 + cat /tmp/spdk_tgt_config.json.2Ez 00:04:24.353 + echo '=== End of file: /tmp/spdk_tgt_config.json.2Ez ===' 00:04:24.353 + echo '' 00:04:24.353 + rm /tmp/62.Vzm /tmp/spdk_tgt_config.json.2Ez 00:04:24.353 + exit 1 00:04:24.353 09:27:47 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:24.353 INFO: configuration change detected. 00:04:24.353 09:27:47 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:24.353 09:27:47 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:24.353 09:27:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:24.353 09:27:47 -- common/autotest_common.sh@10 -- # set +x 00:04:24.353 09:27:47 -- json_config/json_config.sh@360 -- # local ret=0 00:04:24.353 09:27:47 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:24.353 09:27:47 -- json_config/json_config.sh@370 -- # [[ -n 4097280 ]] 00:04:24.353 09:27:47 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:24.353 09:27:47 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:24.353 09:27:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:24.353 09:27:47 -- common/autotest_common.sh@10 -- # set +x 00:04:24.353 09:27:47 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:24.353 09:27:47 -- json_config/json_config.sh@246 -- # uname -s 00:04:24.353 09:27:47 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:24.353 09:27:47 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:24.353 09:27:47 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:24.353 09:27:47 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:24.353 09:27:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:24.353 09:27:47 -- common/autotest_common.sh@10 -- # set +x 00:04:24.353 09:27:47 -- json_config/json_config.sh@376 -- # killprocess 4097280 00:04:24.353 09:27:47 -- common/autotest_common.sh@936 -- # '[' -z 4097280 ']' 00:04:24.353 09:27:47 -- common/autotest_common.sh@940 -- # kill -0 4097280 00:04:24.353 09:27:47 -- common/autotest_common.sh@941 -- # uname 00:04:24.353 09:27:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:24.353 09:27:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4097280 00:04:24.611 09:27:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:24.611 09:27:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:24.611 09:27:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4097280' 00:04:24.611 killing process with pid 4097280 00:04:24.611 09:27:47 -- common/autotest_common.sh@955 -- # kill 4097280 00:04:24.611 09:27:47 -- common/autotest_common.sh@960 -- # wait 4097280 00:04:26.512 09:27:48 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:26.512 09:27:48 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:26.512 09:27:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:26.512 09:27:48 -- common/autotest_common.sh@10 -- # set +x 00:04:26.512 09:27:48 -- json_config/json_config.sh@381 -- # return 0 00:04:26.512 09:27:48 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:26.512 INFO: Success 00:04:26.512 00:04:26.512 real 0m16.337s 00:04:26.512 user 0m18.819s 00:04:26.512 sys 0m2.111s 00:04:26.512 09:27:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:26.512 09:27:48 -- common/autotest_common.sh@10 -- # set +x 00:04:26.512 ************************************ 00:04:26.512 END TEST json_config 00:04:26.512 ************************************ 00:04:26.512 09:27:48 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:26.512 09:27:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:26.512 09:27:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:26.512 09:27:48 -- common/autotest_common.sh@10 -- # set +x 00:04:26.512 ************************************ 00:04:26.512 START TEST json_config_extra_key 00:04:26.512 ************************************ 00:04:26.512 09:27:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:26.512 09:27:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:26.512 09:27:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:26.512 09:27:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:26.513 09:27:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:26.513 09:27:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:26.513 09:27:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:26.513 09:27:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:26.513 09:27:49 -- scripts/common.sh@335 -- # IFS=.-: 00:04:26.513 09:27:49 -- scripts/common.sh@335 -- # read -ra ver1 00:04:26.513 09:27:49 -- scripts/common.sh@336 -- # IFS=.-: 00:04:26.513 09:27:49 -- scripts/common.sh@336 -- # read -ra ver2 00:04:26.513 09:27:49 -- scripts/common.sh@337 -- # local 'op=<' 00:04:26.513 09:27:49 -- scripts/common.sh@339 -- # ver1_l=2 00:04:26.513 09:27:49 -- scripts/common.sh@340 -- # ver2_l=1 00:04:26.513 09:27:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:26.513 09:27:49 -- scripts/common.sh@343 -- # case "$op" in 00:04:26.513 09:27:49 -- scripts/common.sh@344 -- # : 1 00:04:26.513 09:27:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:26.513 09:27:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:26.513 09:27:49 -- scripts/common.sh@364 -- # decimal 1 00:04:26.513 09:27:49 -- scripts/common.sh@352 -- # local d=1 00:04:26.513 09:27:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:26.513 09:27:49 -- scripts/common.sh@354 -- # echo 1 00:04:26.513 09:27:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:26.513 09:27:49 -- scripts/common.sh@365 -- # decimal 2 00:04:26.513 09:27:49 -- scripts/common.sh@352 -- # local d=2 00:04:26.513 09:27:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:26.513 09:27:49 -- scripts/common.sh@354 -- # echo 2 00:04:26.513 09:27:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:26.513 09:27:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:26.513 09:27:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:26.513 09:27:49 -- scripts/common.sh@367 -- # return 0 00:04:26.513 09:27:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:26.513 09:27:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:26.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.513 --rc genhtml_branch_coverage=1 00:04:26.513 --rc genhtml_function_coverage=1 00:04:26.513 --rc genhtml_legend=1 00:04:26.513 --rc geninfo_all_blocks=1 00:04:26.513 --rc geninfo_unexecuted_blocks=1 00:04:26.513 00:04:26.513 ' 00:04:26.513 09:27:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:26.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.513 --rc genhtml_branch_coverage=1 00:04:26.513 --rc genhtml_function_coverage=1 00:04:26.513 --rc genhtml_legend=1 00:04:26.513 --rc geninfo_all_blocks=1 00:04:26.513 --rc geninfo_unexecuted_blocks=1 00:04:26.513 00:04:26.513 ' 00:04:26.513 09:27:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:26.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.513 --rc genhtml_branch_coverage=1 00:04:26.513 --rc genhtml_function_coverage=1 00:04:26.513 --rc genhtml_legend=1 00:04:26.513 --rc geninfo_all_blocks=1 00:04:26.513 --rc geninfo_unexecuted_blocks=1 00:04:26.513 00:04:26.513 ' 00:04:26.513 09:27:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:26.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.513 --rc genhtml_branch_coverage=1 00:04:26.513 --rc genhtml_function_coverage=1 00:04:26.513 --rc genhtml_legend=1 00:04:26.513 --rc geninfo_all_blocks=1 00:04:26.513 --rc geninfo_unexecuted_blocks=1 00:04:26.513 00:04:26.513 ' 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:26.513 09:27:49 -- nvmf/common.sh@7 -- # uname -s 00:04:26.513 09:27:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:26.513 09:27:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:26.513 09:27:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:26.513 09:27:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:26.513 09:27:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:26.513 09:27:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:26.513 09:27:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:26.513 09:27:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:26.513 09:27:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:26.513 09:27:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:26.513 09:27:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:26.513 09:27:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:26.513 09:27:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:26.513 09:27:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:26.513 09:27:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:26.513 09:27:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:26.513 09:27:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:26.513 09:27:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:26.513 09:27:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:26.513 09:27:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:26.513 09:27:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:26.513 09:27:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:26.513 09:27:49 -- paths/export.sh@5 -- # export PATH 00:04:26.513 09:27:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:26.513 09:27:49 -- nvmf/common.sh@46 -- # : 0 00:04:26.513 09:27:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:26.513 09:27:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:26.513 09:27:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:26.513 09:27:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:26.513 09:27:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:26.513 09:27:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:26.513 09:27:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:26.513 09:27:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:26.513 INFO: launching applications... 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=4098230 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:26.513 Waiting for target to run... 00:04:26.513 09:27:49 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 4098230 /var/tmp/spdk_tgt.sock 00:04:26.513 09:27:49 -- common/autotest_common.sh@829 -- # '[' -z 4098230 ']' 00:04:26.513 09:27:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:26.513 09:27:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:26.513 09:27:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:26.513 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:26.513 09:27:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:26.513 09:27:49 -- common/autotest_common.sh@10 -- # set +x 00:04:26.513 [2024-11-29 09:27:49.079440] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:26.513 [2024-11-29 09:27:49.079522] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4098230 ] 00:04:26.513 EAL: No free 2048 kB hugepages reported on node 1 00:04:26.772 [2024-11-29 09:27:49.567741] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:27.030 [2024-11-29 09:27:49.670962] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:27.030 [2024-11-29 09:27:49.671152] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:27.288 09:27:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:27.288 09:27:50 -- common/autotest_common.sh@862 -- # return 0 00:04:27.288 09:27:50 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:27.288 00:04:27.288 09:27:50 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:27.288 INFO: shutting down applications... 00:04:27.288 09:27:50 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:27.288 09:27:50 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:27.288 09:27:50 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:27.288 09:27:50 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 4098230 ]] 00:04:27.288 09:27:50 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 4098230 00:04:27.288 09:27:50 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:27.288 09:27:50 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:27.288 09:27:50 -- json_config/json_config_extra_key.sh@50 -- # kill -0 4098230 00:04:27.288 09:27:50 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:27.854 09:27:50 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:27.854 09:27:50 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:27.854 09:27:50 -- json_config/json_config_extra_key.sh@50 -- # kill -0 4098230 00:04:27.854 09:27:50 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:28.429 09:27:51 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:28.429 09:27:51 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:28.429 09:27:51 -- json_config/json_config_extra_key.sh@50 -- # kill -0 4098230 00:04:28.429 09:27:51 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:28.429 09:27:51 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:28.429 09:27:51 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:28.429 09:27:51 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:28.429 SPDK target shutdown done 00:04:28.429 09:27:51 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:28.429 Success 00:04:28.429 00:04:28.429 real 0m2.186s 00:04:28.429 user 0m1.597s 00:04:28.429 sys 0m0.595s 00:04:28.429 09:27:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:28.429 09:27:51 -- common/autotest_common.sh@10 -- # set +x 00:04:28.429 ************************************ 00:04:28.429 END TEST json_config_extra_key 00:04:28.429 ************************************ 00:04:28.429 09:27:51 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:28.429 09:27:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:28.429 09:27:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:28.429 09:27:51 -- common/autotest_common.sh@10 -- # set +x 00:04:28.429 ************************************ 00:04:28.429 START TEST alias_rpc 00:04:28.429 ************************************ 00:04:28.429 09:27:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:28.429 * Looking for test storage... 00:04:28.429 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:28.429 09:27:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:28.429 09:27:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:28.429 09:27:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:28.429 09:27:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:28.429 09:27:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:28.429 09:27:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:28.429 09:27:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:28.429 09:27:51 -- scripts/common.sh@335 -- # IFS=.-: 00:04:28.429 09:27:51 -- scripts/common.sh@335 -- # read -ra ver1 00:04:28.429 09:27:51 -- scripts/common.sh@336 -- # IFS=.-: 00:04:28.429 09:27:51 -- scripts/common.sh@336 -- # read -ra ver2 00:04:28.429 09:27:51 -- scripts/common.sh@337 -- # local 'op=<' 00:04:28.429 09:27:51 -- scripts/common.sh@339 -- # ver1_l=2 00:04:28.429 09:27:51 -- scripts/common.sh@340 -- # ver2_l=1 00:04:28.429 09:27:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:28.429 09:27:51 -- scripts/common.sh@343 -- # case "$op" in 00:04:28.429 09:27:51 -- scripts/common.sh@344 -- # : 1 00:04:28.429 09:27:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:28.429 09:27:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:28.429 09:27:51 -- scripts/common.sh@364 -- # decimal 1 00:04:28.429 09:27:51 -- scripts/common.sh@352 -- # local d=1 00:04:28.429 09:27:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:28.429 09:27:51 -- scripts/common.sh@354 -- # echo 1 00:04:28.429 09:27:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:28.429 09:27:51 -- scripts/common.sh@365 -- # decimal 2 00:04:28.429 09:27:51 -- scripts/common.sh@352 -- # local d=2 00:04:28.429 09:27:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:28.429 09:27:51 -- scripts/common.sh@354 -- # echo 2 00:04:28.429 09:27:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:28.429 09:27:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:28.429 09:27:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:28.430 09:27:51 -- scripts/common.sh@367 -- # return 0 00:04:28.430 09:27:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:28.430 09:27:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:28.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.430 --rc genhtml_branch_coverage=1 00:04:28.430 --rc genhtml_function_coverage=1 00:04:28.430 --rc genhtml_legend=1 00:04:28.430 --rc geninfo_all_blocks=1 00:04:28.430 --rc geninfo_unexecuted_blocks=1 00:04:28.430 00:04:28.430 ' 00:04:28.430 09:27:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:28.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.430 --rc genhtml_branch_coverage=1 00:04:28.430 --rc genhtml_function_coverage=1 00:04:28.430 --rc genhtml_legend=1 00:04:28.430 --rc geninfo_all_blocks=1 00:04:28.430 --rc geninfo_unexecuted_blocks=1 00:04:28.430 00:04:28.430 ' 00:04:28.430 09:27:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:28.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.430 --rc genhtml_branch_coverage=1 00:04:28.430 --rc genhtml_function_coverage=1 00:04:28.430 --rc genhtml_legend=1 00:04:28.430 --rc geninfo_all_blocks=1 00:04:28.430 --rc geninfo_unexecuted_blocks=1 00:04:28.430 00:04:28.430 ' 00:04:28.430 09:27:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:28.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.430 --rc genhtml_branch_coverage=1 00:04:28.430 --rc genhtml_function_coverage=1 00:04:28.430 --rc genhtml_legend=1 00:04:28.430 --rc geninfo_all_blocks=1 00:04:28.430 --rc geninfo_unexecuted_blocks=1 00:04:28.430 00:04:28.430 ' 00:04:28.430 09:27:51 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:28.430 09:27:51 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=4098556 00:04:28.430 09:27:51 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:28.430 09:27:51 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 4098556 00:04:28.430 09:27:51 -- common/autotest_common.sh@829 -- # '[' -z 4098556 ']' 00:04:28.430 09:27:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:28.430 09:27:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:28.430 09:27:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:28.430 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:28.430 09:27:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:28.430 09:27:51 -- common/autotest_common.sh@10 -- # set +x 00:04:28.691 [2024-11-29 09:27:51.295511] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:28.691 [2024-11-29 09:27:51.295593] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4098556 ] 00:04:28.691 EAL: No free 2048 kB hugepages reported on node 1 00:04:28.691 [2024-11-29 09:27:51.351569] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:28.691 [2024-11-29 09:27:51.463072] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:28.691 [2024-11-29 09:27:51.463259] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:29.626 09:27:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:29.626 09:27:52 -- common/autotest_common.sh@862 -- # return 0 00:04:29.626 09:27:52 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:29.884 09:27:52 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 4098556 00:04:29.884 09:27:52 -- common/autotest_common.sh@936 -- # '[' -z 4098556 ']' 00:04:29.884 09:27:52 -- common/autotest_common.sh@940 -- # kill -0 4098556 00:04:29.884 09:27:52 -- common/autotest_common.sh@941 -- # uname 00:04:29.884 09:27:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:29.884 09:27:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4098556 00:04:29.884 09:27:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:29.884 09:27:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:29.884 09:27:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4098556' 00:04:29.884 killing process with pid 4098556 00:04:29.884 09:27:52 -- common/autotest_common.sh@955 -- # kill 4098556 00:04:29.884 09:27:52 -- common/autotest_common.sh@960 -- # wait 4098556 00:04:30.450 00:04:30.450 real 0m1.905s 00:04:30.450 user 0m2.165s 00:04:30.450 sys 0m0.478s 00:04:30.450 09:27:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:30.450 09:27:53 -- common/autotest_common.sh@10 -- # set +x 00:04:30.450 ************************************ 00:04:30.450 END TEST alias_rpc 00:04:30.450 ************************************ 00:04:30.450 09:27:53 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:30.450 09:27:53 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:30.450 09:27:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.450 09:27:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.450 09:27:53 -- common/autotest_common.sh@10 -- # set +x 00:04:30.450 ************************************ 00:04:30.450 START TEST spdkcli_tcp 00:04:30.450 ************************************ 00:04:30.450 09:27:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:30.450 * Looking for test storage... 00:04:30.450 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:30.450 09:27:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:30.450 09:27:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:30.450 09:27:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:30.450 09:27:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:30.450 09:27:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:30.450 09:27:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:30.450 09:27:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:30.450 09:27:53 -- scripts/common.sh@335 -- # IFS=.-: 00:04:30.450 09:27:53 -- scripts/common.sh@335 -- # read -ra ver1 00:04:30.450 09:27:53 -- scripts/common.sh@336 -- # IFS=.-: 00:04:30.450 09:27:53 -- scripts/common.sh@336 -- # read -ra ver2 00:04:30.450 09:27:53 -- scripts/common.sh@337 -- # local 'op=<' 00:04:30.450 09:27:53 -- scripts/common.sh@339 -- # ver1_l=2 00:04:30.450 09:27:53 -- scripts/common.sh@340 -- # ver2_l=1 00:04:30.450 09:27:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:30.450 09:27:53 -- scripts/common.sh@343 -- # case "$op" in 00:04:30.450 09:27:53 -- scripts/common.sh@344 -- # : 1 00:04:30.450 09:27:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:30.450 09:27:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:30.450 09:27:53 -- scripts/common.sh@364 -- # decimal 1 00:04:30.450 09:27:53 -- scripts/common.sh@352 -- # local d=1 00:04:30.450 09:27:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:30.450 09:27:53 -- scripts/common.sh@354 -- # echo 1 00:04:30.450 09:27:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:30.450 09:27:53 -- scripts/common.sh@365 -- # decimal 2 00:04:30.450 09:27:53 -- scripts/common.sh@352 -- # local d=2 00:04:30.450 09:27:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:30.450 09:27:53 -- scripts/common.sh@354 -- # echo 2 00:04:30.450 09:27:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:30.450 09:27:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:30.450 09:27:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:30.450 09:27:53 -- scripts/common.sh@367 -- # return 0 00:04:30.450 09:27:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:30.450 09:27:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:30.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.450 --rc genhtml_branch_coverage=1 00:04:30.450 --rc genhtml_function_coverage=1 00:04:30.450 --rc genhtml_legend=1 00:04:30.450 --rc geninfo_all_blocks=1 00:04:30.450 --rc geninfo_unexecuted_blocks=1 00:04:30.450 00:04:30.450 ' 00:04:30.451 09:27:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:30.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.451 --rc genhtml_branch_coverage=1 00:04:30.451 --rc genhtml_function_coverage=1 00:04:30.451 --rc genhtml_legend=1 00:04:30.451 --rc geninfo_all_blocks=1 00:04:30.451 --rc geninfo_unexecuted_blocks=1 00:04:30.451 00:04:30.451 ' 00:04:30.451 09:27:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:30.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.451 --rc genhtml_branch_coverage=1 00:04:30.451 --rc genhtml_function_coverage=1 00:04:30.451 --rc genhtml_legend=1 00:04:30.451 --rc geninfo_all_blocks=1 00:04:30.451 --rc geninfo_unexecuted_blocks=1 00:04:30.451 00:04:30.451 ' 00:04:30.451 09:27:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:30.451 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.451 --rc genhtml_branch_coverage=1 00:04:30.451 --rc genhtml_function_coverage=1 00:04:30.451 --rc genhtml_legend=1 00:04:30.451 --rc geninfo_all_blocks=1 00:04:30.451 --rc geninfo_unexecuted_blocks=1 00:04:30.451 00:04:30.451 ' 00:04:30.451 09:27:53 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:30.451 09:27:53 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:30.451 09:27:53 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:30.451 09:27:53 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:30.451 09:27:53 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:30.451 09:27:53 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:30.451 09:27:53 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:30.451 09:27:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:30.451 09:27:53 -- common/autotest_common.sh@10 -- # set +x 00:04:30.451 09:27:53 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=4098889 00:04:30.451 09:27:53 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:30.451 09:27:53 -- spdkcli/tcp.sh@27 -- # waitforlisten 4098889 00:04:30.451 09:27:53 -- common/autotest_common.sh@829 -- # '[' -z 4098889 ']' 00:04:30.451 09:27:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:30.451 09:27:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:30.451 09:27:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:30.451 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:30.451 09:27:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:30.451 09:27:53 -- common/autotest_common.sh@10 -- # set +x 00:04:30.451 [2024-11-29 09:27:53.215616] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:30.451 [2024-11-29 09:27:53.215713] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4098889 ] 00:04:30.451 EAL: No free 2048 kB hugepages reported on node 1 00:04:30.451 [2024-11-29 09:27:53.273063] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:30.710 [2024-11-29 09:27:53.379964] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:30.710 [2024-11-29 09:27:53.380203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:30.710 [2024-11-29 09:27:53.380208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:31.644 09:27:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:31.644 09:27:54 -- common/autotest_common.sh@862 -- # return 0 00:04:31.644 09:27:54 -- spdkcli/tcp.sh@31 -- # socat_pid=4099021 00:04:31.644 09:27:54 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:31.644 09:27:54 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:31.644 [ 00:04:31.644 "bdev_malloc_delete", 00:04:31.644 "bdev_malloc_create", 00:04:31.644 "bdev_null_resize", 00:04:31.644 "bdev_null_delete", 00:04:31.644 "bdev_null_create", 00:04:31.644 "bdev_nvme_cuse_unregister", 00:04:31.644 "bdev_nvme_cuse_register", 00:04:31.644 "bdev_opal_new_user", 00:04:31.644 "bdev_opal_set_lock_state", 00:04:31.644 "bdev_opal_delete", 00:04:31.644 "bdev_opal_get_info", 00:04:31.644 "bdev_opal_create", 00:04:31.644 "bdev_nvme_opal_revert", 00:04:31.644 "bdev_nvme_opal_init", 00:04:31.644 "bdev_nvme_send_cmd", 00:04:31.644 "bdev_nvme_get_path_iostat", 00:04:31.644 "bdev_nvme_get_mdns_discovery_info", 00:04:31.644 "bdev_nvme_stop_mdns_discovery", 00:04:31.644 "bdev_nvme_start_mdns_discovery", 00:04:31.644 "bdev_nvme_set_multipath_policy", 00:04:31.644 "bdev_nvme_set_preferred_path", 00:04:31.644 "bdev_nvme_get_io_paths", 00:04:31.644 "bdev_nvme_remove_error_injection", 00:04:31.644 "bdev_nvme_add_error_injection", 00:04:31.644 "bdev_nvme_get_discovery_info", 00:04:31.644 "bdev_nvme_stop_discovery", 00:04:31.644 "bdev_nvme_start_discovery", 00:04:31.644 "bdev_nvme_get_controller_health_info", 00:04:31.644 "bdev_nvme_disable_controller", 00:04:31.644 "bdev_nvme_enable_controller", 00:04:31.644 "bdev_nvme_reset_controller", 00:04:31.644 "bdev_nvme_get_transport_statistics", 00:04:31.644 "bdev_nvme_apply_firmware", 00:04:31.644 "bdev_nvme_detach_controller", 00:04:31.644 "bdev_nvme_get_controllers", 00:04:31.644 "bdev_nvme_attach_controller", 00:04:31.644 "bdev_nvme_set_hotplug", 00:04:31.644 "bdev_nvme_set_options", 00:04:31.644 "bdev_passthru_delete", 00:04:31.644 "bdev_passthru_create", 00:04:31.644 "bdev_lvol_grow_lvstore", 00:04:31.644 "bdev_lvol_get_lvols", 00:04:31.644 "bdev_lvol_get_lvstores", 00:04:31.644 "bdev_lvol_delete", 00:04:31.644 "bdev_lvol_set_read_only", 00:04:31.644 "bdev_lvol_resize", 00:04:31.644 "bdev_lvol_decouple_parent", 00:04:31.644 "bdev_lvol_inflate", 00:04:31.644 "bdev_lvol_rename", 00:04:31.644 "bdev_lvol_clone_bdev", 00:04:31.644 "bdev_lvol_clone", 00:04:31.644 "bdev_lvol_snapshot", 00:04:31.644 "bdev_lvol_create", 00:04:31.644 "bdev_lvol_delete_lvstore", 00:04:31.644 "bdev_lvol_rename_lvstore", 00:04:31.644 "bdev_lvol_create_lvstore", 00:04:31.644 "bdev_raid_set_options", 00:04:31.644 "bdev_raid_remove_base_bdev", 00:04:31.644 "bdev_raid_add_base_bdev", 00:04:31.644 "bdev_raid_delete", 00:04:31.644 "bdev_raid_create", 00:04:31.644 "bdev_raid_get_bdevs", 00:04:31.644 "bdev_error_inject_error", 00:04:31.644 "bdev_error_delete", 00:04:31.644 "bdev_error_create", 00:04:31.644 "bdev_split_delete", 00:04:31.644 "bdev_split_create", 00:04:31.644 "bdev_delay_delete", 00:04:31.644 "bdev_delay_create", 00:04:31.644 "bdev_delay_update_latency", 00:04:31.644 "bdev_zone_block_delete", 00:04:31.644 "bdev_zone_block_create", 00:04:31.644 "blobfs_create", 00:04:31.644 "blobfs_detect", 00:04:31.644 "blobfs_set_cache_size", 00:04:31.644 "bdev_aio_delete", 00:04:31.644 "bdev_aio_rescan", 00:04:31.644 "bdev_aio_create", 00:04:31.644 "bdev_ftl_set_property", 00:04:31.644 "bdev_ftl_get_properties", 00:04:31.644 "bdev_ftl_get_stats", 00:04:31.644 "bdev_ftl_unmap", 00:04:31.644 "bdev_ftl_unload", 00:04:31.644 "bdev_ftl_delete", 00:04:31.644 "bdev_ftl_load", 00:04:31.644 "bdev_ftl_create", 00:04:31.644 "bdev_virtio_attach_controller", 00:04:31.644 "bdev_virtio_scsi_get_devices", 00:04:31.644 "bdev_virtio_detach_controller", 00:04:31.644 "bdev_virtio_blk_set_hotplug", 00:04:31.644 "bdev_iscsi_delete", 00:04:31.644 "bdev_iscsi_create", 00:04:31.644 "bdev_iscsi_set_options", 00:04:31.644 "accel_error_inject_error", 00:04:31.644 "ioat_scan_accel_module", 00:04:31.644 "dsa_scan_accel_module", 00:04:31.644 "iaa_scan_accel_module", 00:04:31.644 "iscsi_set_options", 00:04:31.644 "iscsi_get_auth_groups", 00:04:31.644 "iscsi_auth_group_remove_secret", 00:04:31.644 "iscsi_auth_group_add_secret", 00:04:31.644 "iscsi_delete_auth_group", 00:04:31.644 "iscsi_create_auth_group", 00:04:31.644 "iscsi_set_discovery_auth", 00:04:31.644 "iscsi_get_options", 00:04:31.644 "iscsi_target_node_request_logout", 00:04:31.644 "iscsi_target_node_set_redirect", 00:04:31.644 "iscsi_target_node_set_auth", 00:04:31.644 "iscsi_target_node_add_lun", 00:04:31.644 "iscsi_get_connections", 00:04:31.644 "iscsi_portal_group_set_auth", 00:04:31.644 "iscsi_start_portal_group", 00:04:31.644 "iscsi_delete_portal_group", 00:04:31.644 "iscsi_create_portal_group", 00:04:31.644 "iscsi_get_portal_groups", 00:04:31.644 "iscsi_delete_target_node", 00:04:31.644 "iscsi_target_node_remove_pg_ig_maps", 00:04:31.644 "iscsi_target_node_add_pg_ig_maps", 00:04:31.644 "iscsi_create_target_node", 00:04:31.644 "iscsi_get_target_nodes", 00:04:31.644 "iscsi_delete_initiator_group", 00:04:31.644 "iscsi_initiator_group_remove_initiators", 00:04:31.644 "iscsi_initiator_group_add_initiators", 00:04:31.644 "iscsi_create_initiator_group", 00:04:31.644 "iscsi_get_initiator_groups", 00:04:31.644 "nvmf_set_crdt", 00:04:31.644 "nvmf_set_config", 00:04:31.644 "nvmf_set_max_subsystems", 00:04:31.644 "nvmf_subsystem_get_listeners", 00:04:31.644 "nvmf_subsystem_get_qpairs", 00:04:31.644 "nvmf_subsystem_get_controllers", 00:04:31.644 "nvmf_get_stats", 00:04:31.644 "nvmf_get_transports", 00:04:31.645 "nvmf_create_transport", 00:04:31.645 "nvmf_get_targets", 00:04:31.645 "nvmf_delete_target", 00:04:31.645 "nvmf_create_target", 00:04:31.645 "nvmf_subsystem_allow_any_host", 00:04:31.645 "nvmf_subsystem_remove_host", 00:04:31.645 "nvmf_subsystem_add_host", 00:04:31.645 "nvmf_subsystem_remove_ns", 00:04:31.645 "nvmf_subsystem_add_ns", 00:04:31.645 "nvmf_subsystem_listener_set_ana_state", 00:04:31.645 "nvmf_discovery_get_referrals", 00:04:31.645 "nvmf_discovery_remove_referral", 00:04:31.645 "nvmf_discovery_add_referral", 00:04:31.645 "nvmf_subsystem_remove_listener", 00:04:31.645 "nvmf_subsystem_add_listener", 00:04:31.645 "nvmf_delete_subsystem", 00:04:31.645 "nvmf_create_subsystem", 00:04:31.645 "nvmf_get_subsystems", 00:04:31.645 "env_dpdk_get_mem_stats", 00:04:31.645 "nbd_get_disks", 00:04:31.645 "nbd_stop_disk", 00:04:31.645 "nbd_start_disk", 00:04:31.645 "ublk_recover_disk", 00:04:31.645 "ublk_get_disks", 00:04:31.645 "ublk_stop_disk", 00:04:31.645 "ublk_start_disk", 00:04:31.645 "ublk_destroy_target", 00:04:31.645 "ublk_create_target", 00:04:31.645 "virtio_blk_create_transport", 00:04:31.645 "virtio_blk_get_transports", 00:04:31.645 "vhost_controller_set_coalescing", 00:04:31.645 "vhost_get_controllers", 00:04:31.645 "vhost_delete_controller", 00:04:31.645 "vhost_create_blk_controller", 00:04:31.645 "vhost_scsi_controller_remove_target", 00:04:31.645 "vhost_scsi_controller_add_target", 00:04:31.645 "vhost_start_scsi_controller", 00:04:31.645 "vhost_create_scsi_controller", 00:04:31.645 "thread_set_cpumask", 00:04:31.645 "framework_get_scheduler", 00:04:31.645 "framework_set_scheduler", 00:04:31.645 "framework_get_reactors", 00:04:31.645 "thread_get_io_channels", 00:04:31.645 "thread_get_pollers", 00:04:31.645 "thread_get_stats", 00:04:31.645 "framework_monitor_context_switch", 00:04:31.645 "spdk_kill_instance", 00:04:31.645 "log_enable_timestamps", 00:04:31.645 "log_get_flags", 00:04:31.645 "log_clear_flag", 00:04:31.645 "log_set_flag", 00:04:31.645 "log_get_level", 00:04:31.645 "log_set_level", 00:04:31.645 "log_get_print_level", 00:04:31.645 "log_set_print_level", 00:04:31.645 "framework_enable_cpumask_locks", 00:04:31.645 "framework_disable_cpumask_locks", 00:04:31.645 "framework_wait_init", 00:04:31.645 "framework_start_init", 00:04:31.645 "scsi_get_devices", 00:04:31.645 "bdev_get_histogram", 00:04:31.645 "bdev_enable_histogram", 00:04:31.645 "bdev_set_qos_limit", 00:04:31.645 "bdev_set_qd_sampling_period", 00:04:31.645 "bdev_get_bdevs", 00:04:31.645 "bdev_reset_iostat", 00:04:31.645 "bdev_get_iostat", 00:04:31.645 "bdev_examine", 00:04:31.645 "bdev_wait_for_examine", 00:04:31.645 "bdev_set_options", 00:04:31.645 "notify_get_notifications", 00:04:31.645 "notify_get_types", 00:04:31.645 "accel_get_stats", 00:04:31.645 "accel_set_options", 00:04:31.645 "accel_set_driver", 00:04:31.645 "accel_crypto_key_destroy", 00:04:31.645 "accel_crypto_keys_get", 00:04:31.645 "accel_crypto_key_create", 00:04:31.645 "accel_assign_opc", 00:04:31.645 "accel_get_module_info", 00:04:31.645 "accel_get_opc_assignments", 00:04:31.645 "vmd_rescan", 00:04:31.645 "vmd_remove_device", 00:04:31.645 "vmd_enable", 00:04:31.645 "sock_set_default_impl", 00:04:31.645 "sock_impl_set_options", 00:04:31.645 "sock_impl_get_options", 00:04:31.645 "iobuf_get_stats", 00:04:31.645 "iobuf_set_options", 00:04:31.645 "framework_get_pci_devices", 00:04:31.645 "framework_get_config", 00:04:31.645 "framework_get_subsystems", 00:04:31.645 "trace_get_info", 00:04:31.645 "trace_get_tpoint_group_mask", 00:04:31.645 "trace_disable_tpoint_group", 00:04:31.645 "trace_enable_tpoint_group", 00:04:31.645 "trace_clear_tpoint_mask", 00:04:31.645 "trace_set_tpoint_mask", 00:04:31.645 "spdk_get_version", 00:04:31.645 "rpc_get_methods" 00:04:31.645 ] 00:04:31.645 09:27:54 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:31.645 09:27:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:31.645 09:27:54 -- common/autotest_common.sh@10 -- # set +x 00:04:31.645 09:27:54 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:31.645 09:27:54 -- spdkcli/tcp.sh@38 -- # killprocess 4098889 00:04:31.645 09:27:54 -- common/autotest_common.sh@936 -- # '[' -z 4098889 ']' 00:04:31.645 09:27:54 -- common/autotest_common.sh@940 -- # kill -0 4098889 00:04:31.645 09:27:54 -- common/autotest_common.sh@941 -- # uname 00:04:31.645 09:27:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:31.645 09:27:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4098889 00:04:31.904 09:27:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:31.904 09:27:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:31.904 09:27:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4098889' 00:04:31.904 killing process with pid 4098889 00:04:31.904 09:27:54 -- common/autotest_common.sh@955 -- # kill 4098889 00:04:31.904 09:27:54 -- common/autotest_common.sh@960 -- # wait 4098889 00:04:32.162 00:04:32.162 real 0m1.916s 00:04:32.162 user 0m3.649s 00:04:32.162 sys 0m0.508s 00:04:32.162 09:27:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:32.162 09:27:54 -- common/autotest_common.sh@10 -- # set +x 00:04:32.162 ************************************ 00:04:32.162 END TEST spdkcli_tcp 00:04:32.162 ************************************ 00:04:32.162 09:27:54 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:32.162 09:27:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:32.162 09:27:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:32.162 09:27:54 -- common/autotest_common.sh@10 -- # set +x 00:04:32.162 ************************************ 00:04:32.162 START TEST dpdk_mem_utility 00:04:32.162 ************************************ 00:04:32.162 09:27:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:32.421 * Looking for test storage... 00:04:32.421 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:32.421 09:27:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:32.421 09:27:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:32.421 09:27:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:32.421 09:27:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:32.422 09:27:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:32.422 09:27:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:32.422 09:27:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:32.422 09:27:55 -- scripts/common.sh@335 -- # IFS=.-: 00:04:32.422 09:27:55 -- scripts/common.sh@335 -- # read -ra ver1 00:04:32.422 09:27:55 -- scripts/common.sh@336 -- # IFS=.-: 00:04:32.422 09:27:55 -- scripts/common.sh@336 -- # read -ra ver2 00:04:32.422 09:27:55 -- scripts/common.sh@337 -- # local 'op=<' 00:04:32.422 09:27:55 -- scripts/common.sh@339 -- # ver1_l=2 00:04:32.422 09:27:55 -- scripts/common.sh@340 -- # ver2_l=1 00:04:32.422 09:27:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:32.422 09:27:55 -- scripts/common.sh@343 -- # case "$op" in 00:04:32.422 09:27:55 -- scripts/common.sh@344 -- # : 1 00:04:32.422 09:27:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:32.422 09:27:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:32.422 09:27:55 -- scripts/common.sh@364 -- # decimal 1 00:04:32.422 09:27:55 -- scripts/common.sh@352 -- # local d=1 00:04:32.422 09:27:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:32.422 09:27:55 -- scripts/common.sh@354 -- # echo 1 00:04:32.422 09:27:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:32.422 09:27:55 -- scripts/common.sh@365 -- # decimal 2 00:04:32.422 09:27:55 -- scripts/common.sh@352 -- # local d=2 00:04:32.422 09:27:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:32.422 09:27:55 -- scripts/common.sh@354 -- # echo 2 00:04:32.422 09:27:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:32.422 09:27:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:32.422 09:27:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:32.422 09:27:55 -- scripts/common.sh@367 -- # return 0 00:04:32.422 09:27:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:32.422 09:27:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:32.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.422 --rc genhtml_branch_coverage=1 00:04:32.422 --rc genhtml_function_coverage=1 00:04:32.422 --rc genhtml_legend=1 00:04:32.422 --rc geninfo_all_blocks=1 00:04:32.422 --rc geninfo_unexecuted_blocks=1 00:04:32.422 00:04:32.422 ' 00:04:32.422 09:27:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:32.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.422 --rc genhtml_branch_coverage=1 00:04:32.422 --rc genhtml_function_coverage=1 00:04:32.422 --rc genhtml_legend=1 00:04:32.422 --rc geninfo_all_blocks=1 00:04:32.422 --rc geninfo_unexecuted_blocks=1 00:04:32.422 00:04:32.422 ' 00:04:32.422 09:27:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:32.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.422 --rc genhtml_branch_coverage=1 00:04:32.422 --rc genhtml_function_coverage=1 00:04:32.422 --rc genhtml_legend=1 00:04:32.422 --rc geninfo_all_blocks=1 00:04:32.422 --rc geninfo_unexecuted_blocks=1 00:04:32.422 00:04:32.422 ' 00:04:32.422 09:27:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:32.422 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.422 --rc genhtml_branch_coverage=1 00:04:32.422 --rc genhtml_function_coverage=1 00:04:32.422 --rc genhtml_legend=1 00:04:32.422 --rc geninfo_all_blocks=1 00:04:32.422 --rc geninfo_unexecuted_blocks=1 00:04:32.422 00:04:32.422 ' 00:04:32.422 09:27:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:32.422 09:27:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=4099108 00:04:32.422 09:27:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:32.422 09:27:55 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 4099108 00:04:32.422 09:27:55 -- common/autotest_common.sh@829 -- # '[' -z 4099108 ']' 00:04:32.422 09:27:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:32.422 09:27:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:32.422 09:27:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:32.422 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:32.422 09:27:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:32.422 09:27:55 -- common/autotest_common.sh@10 -- # set +x 00:04:32.422 [2024-11-29 09:27:55.180461] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:32.422 [2024-11-29 09:27:55.180558] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4099108 ] 00:04:32.422 EAL: No free 2048 kB hugepages reported on node 1 00:04:32.422 [2024-11-29 09:27:55.241257] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:32.680 [2024-11-29 09:27:55.355331] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:32.680 [2024-11-29 09:27:55.355525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:33.615 09:27:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:33.615 09:27:56 -- common/autotest_common.sh@862 -- # return 0 00:04:33.615 09:27:56 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:33.615 09:27:56 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:33.615 09:27:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:33.615 09:27:56 -- common/autotest_common.sh@10 -- # set +x 00:04:33.615 { 00:04:33.615 "filename": "/tmp/spdk_mem_dump.txt" 00:04:33.615 } 00:04:33.615 09:27:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:33.615 09:27:56 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:33.615 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:33.615 1 heaps totaling size 814.000000 MiB 00:04:33.615 size: 814.000000 MiB heap id: 0 00:04:33.615 end heaps---------- 00:04:33.615 8 mempools totaling size 598.116089 MiB 00:04:33.615 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:33.615 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:33.615 size: 84.521057 MiB name: bdev_io_4099108 00:04:33.615 size: 51.011292 MiB name: evtpool_4099108 00:04:33.615 size: 50.003479 MiB name: msgpool_4099108 00:04:33.615 size: 21.763794 MiB name: PDU_Pool 00:04:33.615 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:33.615 size: 0.026123 MiB name: Session_Pool 00:04:33.615 end mempools------- 00:04:33.615 6 memzones totaling size 4.142822 MiB 00:04:33.615 size: 1.000366 MiB name: RG_ring_0_4099108 00:04:33.615 size: 1.000366 MiB name: RG_ring_1_4099108 00:04:33.615 size: 1.000366 MiB name: RG_ring_4_4099108 00:04:33.615 size: 1.000366 MiB name: RG_ring_5_4099108 00:04:33.615 size: 0.125366 MiB name: RG_ring_2_4099108 00:04:33.615 size: 0.015991 MiB name: RG_ring_3_4099108 00:04:33.615 end memzones------- 00:04:33.615 09:27:56 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:33.615 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:33.615 list of free elements. size: 12.519348 MiB 00:04:33.615 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:33.615 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:33.615 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:33.615 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:33.615 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:33.615 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:33.615 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:33.615 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:33.615 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:33.615 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:33.615 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:33.615 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:33.615 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:33.615 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:33.615 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:33.615 list of standard malloc elements. size: 199.218079 MiB 00:04:33.615 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:33.615 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:33.615 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:33.615 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:33.615 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:33.615 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:33.615 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:33.615 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:33.615 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:33.615 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:33.615 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:33.615 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:33.615 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:33.615 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:33.615 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:33.615 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:33.615 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:33.615 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:33.615 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:33.615 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:33.615 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:33.615 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:33.615 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:33.615 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:33.615 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:33.615 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:33.615 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:33.615 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:33.615 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:33.615 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:33.615 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:33.615 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:33.615 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:33.615 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:33.615 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:33.615 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:33.615 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:33.615 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:33.615 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:33.615 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:33.615 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:33.615 list of memzone associated elements. size: 602.262573 MiB 00:04:33.615 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:33.615 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:33.615 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:33.615 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:33.615 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:33.615 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_4099108_0 00:04:33.615 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:33.616 associated memzone info: size: 48.002930 MiB name: MP_evtpool_4099108_0 00:04:33.616 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:33.616 associated memzone info: size: 48.002930 MiB name: MP_msgpool_4099108_0 00:04:33.616 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:33.616 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:33.616 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:33.616 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:33.616 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:33.616 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_4099108 00:04:33.616 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:33.616 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_4099108 00:04:33.616 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:33.616 associated memzone info: size: 1.007996 MiB name: MP_evtpool_4099108 00:04:33.616 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:33.616 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:33.616 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:33.616 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:33.616 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:33.616 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:33.616 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:33.616 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:33.616 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:33.616 associated memzone info: size: 1.000366 MiB name: RG_ring_0_4099108 00:04:33.616 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:33.616 associated memzone info: size: 1.000366 MiB name: RG_ring_1_4099108 00:04:33.616 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:33.616 associated memzone info: size: 1.000366 MiB name: RG_ring_4_4099108 00:04:33.616 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:33.616 associated memzone info: size: 1.000366 MiB name: RG_ring_5_4099108 00:04:33.616 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:33.616 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_4099108 00:04:33.616 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:33.616 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:33.616 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:33.616 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:33.616 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:33.616 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:33.616 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:33.616 associated memzone info: size: 0.125366 MiB name: RG_ring_2_4099108 00:04:33.616 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:33.616 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:33.616 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:33.616 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:33.616 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:33.616 associated memzone info: size: 0.015991 MiB name: RG_ring_3_4099108 00:04:33.616 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:33.616 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:33.616 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:33.616 associated memzone info: size: 0.000183 MiB name: MP_msgpool_4099108 00:04:33.616 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:33.616 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_4099108 00:04:33.616 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:33.616 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:33.616 09:27:56 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:33.616 09:27:56 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 4099108 00:04:33.616 09:27:56 -- common/autotest_common.sh@936 -- # '[' -z 4099108 ']' 00:04:33.616 09:27:56 -- common/autotest_common.sh@940 -- # kill -0 4099108 00:04:33.616 09:27:56 -- common/autotest_common.sh@941 -- # uname 00:04:33.616 09:27:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:33.616 09:27:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4099108 00:04:33.616 09:27:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:33.616 09:27:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:33.616 09:27:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4099108' 00:04:33.616 killing process with pid 4099108 00:04:33.616 09:27:56 -- common/autotest_common.sh@955 -- # kill 4099108 00:04:33.616 09:27:56 -- common/autotest_common.sh@960 -- # wait 4099108 00:04:34.183 00:04:34.183 real 0m1.785s 00:04:34.183 user 0m1.979s 00:04:34.183 sys 0m0.464s 00:04:34.183 09:27:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:34.183 09:27:56 -- common/autotest_common.sh@10 -- # set +x 00:04:34.183 ************************************ 00:04:34.183 END TEST dpdk_mem_utility 00:04:34.183 ************************************ 00:04:34.183 09:27:56 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:34.183 09:27:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.183 09:27:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.183 09:27:56 -- common/autotest_common.sh@10 -- # set +x 00:04:34.183 ************************************ 00:04:34.183 START TEST event 00:04:34.183 ************************************ 00:04:34.183 09:27:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:34.183 * Looking for test storage... 00:04:34.183 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:34.183 09:27:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:34.183 09:27:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:34.183 09:27:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:34.183 09:27:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:34.183 09:27:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:34.183 09:27:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:34.183 09:27:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:34.183 09:27:56 -- scripts/common.sh@335 -- # IFS=.-: 00:04:34.183 09:27:56 -- scripts/common.sh@335 -- # read -ra ver1 00:04:34.183 09:27:56 -- scripts/common.sh@336 -- # IFS=.-: 00:04:34.183 09:27:56 -- scripts/common.sh@336 -- # read -ra ver2 00:04:34.183 09:27:56 -- scripts/common.sh@337 -- # local 'op=<' 00:04:34.183 09:27:56 -- scripts/common.sh@339 -- # ver1_l=2 00:04:34.183 09:27:56 -- scripts/common.sh@340 -- # ver2_l=1 00:04:34.183 09:27:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:34.183 09:27:56 -- scripts/common.sh@343 -- # case "$op" in 00:04:34.183 09:27:56 -- scripts/common.sh@344 -- # : 1 00:04:34.183 09:27:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:34.183 09:27:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:34.183 09:27:56 -- scripts/common.sh@364 -- # decimal 1 00:04:34.183 09:27:56 -- scripts/common.sh@352 -- # local d=1 00:04:34.183 09:27:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:34.183 09:27:56 -- scripts/common.sh@354 -- # echo 1 00:04:34.183 09:27:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:34.183 09:27:56 -- scripts/common.sh@365 -- # decimal 2 00:04:34.183 09:27:56 -- scripts/common.sh@352 -- # local d=2 00:04:34.183 09:27:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:34.183 09:27:56 -- scripts/common.sh@354 -- # echo 2 00:04:34.183 09:27:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:34.183 09:27:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:34.183 09:27:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:34.183 09:27:56 -- scripts/common.sh@367 -- # return 0 00:04:34.183 09:27:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:34.183 09:27:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:34.184 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.184 --rc genhtml_branch_coverage=1 00:04:34.184 --rc genhtml_function_coverage=1 00:04:34.184 --rc genhtml_legend=1 00:04:34.184 --rc geninfo_all_blocks=1 00:04:34.184 --rc geninfo_unexecuted_blocks=1 00:04:34.184 00:04:34.184 ' 00:04:34.184 09:27:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:34.184 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.184 --rc genhtml_branch_coverage=1 00:04:34.184 --rc genhtml_function_coverage=1 00:04:34.184 --rc genhtml_legend=1 00:04:34.184 --rc geninfo_all_blocks=1 00:04:34.184 --rc geninfo_unexecuted_blocks=1 00:04:34.184 00:04:34.184 ' 00:04:34.184 09:27:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:34.184 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.184 --rc genhtml_branch_coverage=1 00:04:34.184 --rc genhtml_function_coverage=1 00:04:34.184 --rc genhtml_legend=1 00:04:34.184 --rc geninfo_all_blocks=1 00:04:34.184 --rc geninfo_unexecuted_blocks=1 00:04:34.184 00:04:34.184 ' 00:04:34.184 09:27:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:34.184 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.184 --rc genhtml_branch_coverage=1 00:04:34.184 --rc genhtml_function_coverage=1 00:04:34.184 --rc genhtml_legend=1 00:04:34.184 --rc geninfo_all_blocks=1 00:04:34.184 --rc geninfo_unexecuted_blocks=1 00:04:34.184 00:04:34.184 ' 00:04:34.184 09:27:56 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:34.184 09:27:56 -- bdev/nbd_common.sh@6 -- # set -e 00:04:34.184 09:27:56 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:34.184 09:27:56 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:34.184 09:27:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.184 09:27:56 -- common/autotest_common.sh@10 -- # set +x 00:04:34.184 ************************************ 00:04:34.184 START TEST event_perf 00:04:34.184 ************************************ 00:04:34.184 09:27:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:34.184 Running I/O for 1 seconds...[2024-11-29 09:27:56.955026] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:34.184 [2024-11-29 09:27:56.955103] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4099440 ] 00:04:34.184 EAL: No free 2048 kB hugepages reported on node 1 00:04:34.184 [2024-11-29 09:27:57.016078] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:34.442 [2024-11-29 09:27:57.134635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:34.442 [2024-11-29 09:27:57.134708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:34.442 [2024-11-29 09:27:57.134808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:34.442 [2024-11-29 09:27:57.134810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.816 Running I/O for 1 seconds... 00:04:35.816 lcore 0: 231718 00:04:35.816 lcore 1: 231717 00:04:35.816 lcore 2: 231717 00:04:35.816 lcore 3: 231718 00:04:35.816 done. 00:04:35.816 00:04:35.816 real 0m1.319s 00:04:35.816 user 0m4.231s 00:04:35.816 sys 0m0.082s 00:04:35.816 09:27:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:35.816 09:27:58 -- common/autotest_common.sh@10 -- # set +x 00:04:35.816 ************************************ 00:04:35.816 END TEST event_perf 00:04:35.816 ************************************ 00:04:35.816 09:27:58 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:35.816 09:27:58 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:35.816 09:27:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:35.816 09:27:58 -- common/autotest_common.sh@10 -- # set +x 00:04:35.816 ************************************ 00:04:35.816 START TEST event_reactor 00:04:35.816 ************************************ 00:04:35.816 09:27:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:35.816 [2024-11-29 09:27:58.296043] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:35.816 [2024-11-29 09:27:58.296112] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4099599 ] 00:04:35.816 EAL: No free 2048 kB hugepages reported on node 1 00:04:35.816 [2024-11-29 09:27:58.356129] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:35.816 [2024-11-29 09:27:58.472191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:37.192 test_start 00:04:37.192 oneshot 00:04:37.192 tick 100 00:04:37.192 tick 100 00:04:37.192 tick 250 00:04:37.192 tick 100 00:04:37.192 tick 100 00:04:37.192 tick 100 00:04:37.192 tick 250 00:04:37.192 tick 500 00:04:37.192 tick 100 00:04:37.192 tick 100 00:04:37.192 tick 250 00:04:37.192 tick 100 00:04:37.192 tick 100 00:04:37.192 test_end 00:04:37.192 00:04:37.192 real 0m1.311s 00:04:37.192 user 0m1.223s 00:04:37.192 sys 0m0.084s 00:04:37.192 09:27:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:37.192 09:27:59 -- common/autotest_common.sh@10 -- # set +x 00:04:37.192 ************************************ 00:04:37.192 END TEST event_reactor 00:04:37.192 ************************************ 00:04:37.192 09:27:59 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:37.192 09:27:59 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:37.192 09:27:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.192 09:27:59 -- common/autotest_common.sh@10 -- # set +x 00:04:37.192 ************************************ 00:04:37.192 START TEST event_reactor_perf 00:04:37.192 ************************************ 00:04:37.192 09:27:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:37.192 [2024-11-29 09:27:59.632064] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:37.192 [2024-11-29 09:27:59.632146] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4099753 ] 00:04:37.192 EAL: No free 2048 kB hugepages reported on node 1 00:04:37.192 [2024-11-29 09:27:59.693357] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:37.192 [2024-11-29 09:27:59.816244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:38.126 test_start 00:04:38.126 test_end 00:04:38.126 Performance: 353341 events per second 00:04:38.126 00:04:38.126 real 0m1.315s 00:04:38.126 user 0m1.227s 00:04:38.126 sys 0m0.083s 00:04:38.126 09:28:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.126 09:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:38.126 ************************************ 00:04:38.126 END TEST event_reactor_perf 00:04:38.126 ************************************ 00:04:38.126 09:28:00 -- event/event.sh@49 -- # uname -s 00:04:38.126 09:28:00 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:38.126 09:28:00 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:38.126 09:28:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.126 09:28:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.126 09:28:00 -- common/autotest_common.sh@10 -- # set +x 00:04:38.126 ************************************ 00:04:38.126 START TEST event_scheduler 00:04:38.126 ************************************ 00:04:38.126 09:28:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:38.384 * Looking for test storage... 00:04:38.384 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:38.384 09:28:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:38.384 09:28:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:38.384 09:28:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:38.384 09:28:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:38.384 09:28:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:38.384 09:28:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:38.384 09:28:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:38.384 09:28:01 -- scripts/common.sh@335 -- # IFS=.-: 00:04:38.384 09:28:01 -- scripts/common.sh@335 -- # read -ra ver1 00:04:38.384 09:28:01 -- scripts/common.sh@336 -- # IFS=.-: 00:04:38.384 09:28:01 -- scripts/common.sh@336 -- # read -ra ver2 00:04:38.384 09:28:01 -- scripts/common.sh@337 -- # local 'op=<' 00:04:38.384 09:28:01 -- scripts/common.sh@339 -- # ver1_l=2 00:04:38.384 09:28:01 -- scripts/common.sh@340 -- # ver2_l=1 00:04:38.384 09:28:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:38.384 09:28:01 -- scripts/common.sh@343 -- # case "$op" in 00:04:38.384 09:28:01 -- scripts/common.sh@344 -- # : 1 00:04:38.384 09:28:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:38.384 09:28:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:38.384 09:28:01 -- scripts/common.sh@364 -- # decimal 1 00:04:38.384 09:28:01 -- scripts/common.sh@352 -- # local d=1 00:04:38.384 09:28:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:38.384 09:28:01 -- scripts/common.sh@354 -- # echo 1 00:04:38.384 09:28:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:38.384 09:28:01 -- scripts/common.sh@365 -- # decimal 2 00:04:38.384 09:28:01 -- scripts/common.sh@352 -- # local d=2 00:04:38.384 09:28:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:38.384 09:28:01 -- scripts/common.sh@354 -- # echo 2 00:04:38.384 09:28:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:38.384 09:28:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:38.384 09:28:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:38.384 09:28:01 -- scripts/common.sh@367 -- # return 0 00:04:38.384 09:28:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:38.384 09:28:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:38.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.384 --rc genhtml_branch_coverage=1 00:04:38.384 --rc genhtml_function_coverage=1 00:04:38.384 --rc genhtml_legend=1 00:04:38.384 --rc geninfo_all_blocks=1 00:04:38.384 --rc geninfo_unexecuted_blocks=1 00:04:38.384 00:04:38.384 ' 00:04:38.384 09:28:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:38.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.384 --rc genhtml_branch_coverage=1 00:04:38.384 --rc genhtml_function_coverage=1 00:04:38.384 --rc genhtml_legend=1 00:04:38.384 --rc geninfo_all_blocks=1 00:04:38.384 --rc geninfo_unexecuted_blocks=1 00:04:38.384 00:04:38.384 ' 00:04:38.384 09:28:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:38.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.384 --rc genhtml_branch_coverage=1 00:04:38.385 --rc genhtml_function_coverage=1 00:04:38.385 --rc genhtml_legend=1 00:04:38.385 --rc geninfo_all_blocks=1 00:04:38.385 --rc geninfo_unexecuted_blocks=1 00:04:38.385 00:04:38.385 ' 00:04:38.385 09:28:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:38.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.385 --rc genhtml_branch_coverage=1 00:04:38.385 --rc genhtml_function_coverage=1 00:04:38.385 --rc genhtml_legend=1 00:04:38.385 --rc geninfo_all_blocks=1 00:04:38.385 --rc geninfo_unexecuted_blocks=1 00:04:38.385 00:04:38.385 ' 00:04:38.385 09:28:01 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:38.385 09:28:01 -- scheduler/scheduler.sh@35 -- # scheduler_pid=4100077 00:04:38.385 09:28:01 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:38.385 09:28:01 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:38.385 09:28:01 -- scheduler/scheduler.sh@37 -- # waitforlisten 4100077 00:04:38.385 09:28:01 -- common/autotest_common.sh@829 -- # '[' -z 4100077 ']' 00:04:38.385 09:28:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:38.385 09:28:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:38.385 09:28:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:38.385 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:38.385 09:28:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:38.385 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:38.385 [2024-11-29 09:28:01.133364] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:38.385 [2024-11-29 09:28:01.133464] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4100077 ] 00:04:38.385 EAL: No free 2048 kB hugepages reported on node 1 00:04:38.385 [2024-11-29 09:28:01.190288] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:38.643 [2024-11-29 09:28:01.302914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:38.643 [2024-11-29 09:28:01.302973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:38.643 [2024-11-29 09:28:01.303039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:38.643 [2024-11-29 09:28:01.303042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:38.643 09:28:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:38.643 09:28:01 -- common/autotest_common.sh@862 -- # return 0 00:04:38.643 09:28:01 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:38.643 09:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.643 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:38.643 POWER: Env isn't set yet! 00:04:38.643 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:38.643 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:38.643 POWER: Cannot get available frequencies of lcore 0 00:04:38.643 POWER: Attempting to initialise PSTAT power management... 00:04:38.643 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:38.643 POWER: Initialized successfully for lcore 0 power management 00:04:38.643 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:38.643 POWER: Initialized successfully for lcore 1 power management 00:04:38.643 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:38.643 POWER: Initialized successfully for lcore 2 power management 00:04:38.643 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:38.643 POWER: Initialized successfully for lcore 3 power management 00:04:38.643 [2024-11-29 09:28:01.396599] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:38.643 [2024-11-29 09:28:01.396617] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:38.643 [2024-11-29 09:28:01.396629] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:38.643 09:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.643 09:28:01 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:38.643 09:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.643 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:38.901 [2024-11-29 09:28:01.502023] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:38.901 09:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.901 09:28:01 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:38.901 09:28:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.901 09:28:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.901 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:38.901 ************************************ 00:04:38.901 START TEST scheduler_create_thread 00:04:38.901 ************************************ 00:04:38.901 09:28:01 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:38.901 09:28:01 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:38.901 09:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.901 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:38.901 2 00:04:38.901 09:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.901 09:28:01 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:38.901 09:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.901 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:38.901 3 00:04:38.901 09:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.901 09:28:01 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:38.901 09:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.901 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:38.901 4 00:04:38.901 09:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.901 09:28:01 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:38.901 09:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.901 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:38.901 5 00:04:38.901 09:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.901 09:28:01 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:38.901 09:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.901 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:38.901 6 00:04:38.901 09:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.901 09:28:01 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:38.901 09:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.901 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:38.901 7 00:04:38.901 09:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.901 09:28:01 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:38.901 09:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.901 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:38.901 8 00:04:38.901 09:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.901 09:28:01 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:38.901 09:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.901 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:38.901 9 00:04:38.901 09:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.901 09:28:01 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:38.901 09:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.901 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:38.901 10 00:04:38.901 09:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.901 09:28:01 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:38.901 09:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.901 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:38.901 09:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.901 09:28:01 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:38.901 09:28:01 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:38.901 09:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:38.901 09:28:01 -- common/autotest_common.sh@10 -- # set +x 00:04:39.467 09:28:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:39.467 09:28:02 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:39.467 09:28:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:39.467 09:28:02 -- common/autotest_common.sh@10 -- # set +x 00:04:40.878 09:28:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.878 09:28:03 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:40.878 09:28:03 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:40.878 09:28:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.878 09:28:03 -- common/autotest_common.sh@10 -- # set +x 00:04:41.833 09:28:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.833 00:04:41.833 real 0m3.102s 00:04:41.833 user 0m0.012s 00:04:41.833 sys 0m0.002s 00:04:41.833 09:28:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:41.833 09:28:04 -- common/autotest_common.sh@10 -- # set +x 00:04:41.833 ************************************ 00:04:41.833 END TEST scheduler_create_thread 00:04:41.833 ************************************ 00:04:41.833 09:28:04 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:41.833 09:28:04 -- scheduler/scheduler.sh@46 -- # killprocess 4100077 00:04:41.833 09:28:04 -- common/autotest_common.sh@936 -- # '[' -z 4100077 ']' 00:04:41.833 09:28:04 -- common/autotest_common.sh@940 -- # kill -0 4100077 00:04:41.833 09:28:04 -- common/autotest_common.sh@941 -- # uname 00:04:41.833 09:28:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:41.833 09:28:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4100077 00:04:42.090 09:28:04 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:42.090 09:28:04 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:42.090 09:28:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4100077' 00:04:42.090 killing process with pid 4100077 00:04:42.090 09:28:04 -- common/autotest_common.sh@955 -- # kill 4100077 00:04:42.090 09:28:04 -- common/autotest_common.sh@960 -- # wait 4100077 00:04:42.348 [2024-11-29 09:28:04.990442] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:42.348 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:42.348 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:42.348 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:42.348 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:42.348 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:42.348 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:42.348 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:42.348 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:42.606 00:04:42.606 real 0m4.323s 00:04:42.606 user 0m6.991s 00:04:42.606 sys 0m0.346s 00:04:42.606 09:28:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.606 09:28:05 -- common/autotest_common.sh@10 -- # set +x 00:04:42.606 ************************************ 00:04:42.606 END TEST event_scheduler 00:04:42.606 ************************************ 00:04:42.606 09:28:05 -- event/event.sh@51 -- # modprobe -n nbd 00:04:42.606 09:28:05 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:42.606 09:28:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.606 09:28:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.606 09:28:05 -- common/autotest_common.sh@10 -- # set +x 00:04:42.606 ************************************ 00:04:42.606 START TEST app_repeat 00:04:42.606 ************************************ 00:04:42.606 09:28:05 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:42.606 09:28:05 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:42.606 09:28:05 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:42.606 09:28:05 -- event/event.sh@13 -- # local nbd_list 00:04:42.606 09:28:05 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:42.606 09:28:05 -- event/event.sh@14 -- # local bdev_list 00:04:42.606 09:28:05 -- event/event.sh@15 -- # local repeat_times=4 00:04:42.606 09:28:05 -- event/event.sh@17 -- # modprobe nbd 00:04:42.606 09:28:05 -- event/event.sh@19 -- # repeat_pid=4100552 00:04:42.606 09:28:05 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:42.606 09:28:05 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:42.606 09:28:05 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 4100552' 00:04:42.606 Process app_repeat pid: 4100552 00:04:42.606 09:28:05 -- event/event.sh@23 -- # for i in {0..2} 00:04:42.606 09:28:05 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:42.606 spdk_app_start Round 0 00:04:42.606 09:28:05 -- event/event.sh@25 -- # waitforlisten 4100552 /var/tmp/spdk-nbd.sock 00:04:42.606 09:28:05 -- common/autotest_common.sh@829 -- # '[' -z 4100552 ']' 00:04:42.606 09:28:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:42.606 09:28:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:42.606 09:28:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:42.606 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:42.606 09:28:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:42.606 09:28:05 -- common/autotest_common.sh@10 -- # set +x 00:04:42.606 [2024-11-29 09:28:05.343518] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:42.606 [2024-11-29 09:28:05.343593] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4100552 ] 00:04:42.606 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.606 [2024-11-29 09:28:05.407974] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:42.864 [2024-11-29 09:28:05.530419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:42.864 [2024-11-29 09:28:05.530431] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:43.796 09:28:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:43.796 09:28:06 -- common/autotest_common.sh@862 -- # return 0 00:04:43.796 09:28:06 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:43.796 Malloc0 00:04:44.053 09:28:06 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:44.311 Malloc1 00:04:44.311 09:28:06 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@12 -- # local i 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:44.311 09:28:06 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:44.570 /dev/nbd0 00:04:44.570 09:28:07 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:44.570 09:28:07 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:44.570 09:28:07 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:44.570 09:28:07 -- common/autotest_common.sh@867 -- # local i 00:04:44.570 09:28:07 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:44.570 09:28:07 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:44.570 09:28:07 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:44.570 09:28:07 -- common/autotest_common.sh@871 -- # break 00:04:44.570 09:28:07 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:44.570 09:28:07 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:44.570 09:28:07 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:44.570 1+0 records in 00:04:44.570 1+0 records out 00:04:44.570 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000225309 s, 18.2 MB/s 00:04:44.570 09:28:07 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:44.570 09:28:07 -- common/autotest_common.sh@884 -- # size=4096 00:04:44.570 09:28:07 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:44.570 09:28:07 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:44.570 09:28:07 -- common/autotest_common.sh@887 -- # return 0 00:04:44.570 09:28:07 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:44.570 09:28:07 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:44.570 09:28:07 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:44.828 /dev/nbd1 00:04:44.828 09:28:07 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:44.828 09:28:07 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:44.828 09:28:07 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:44.828 09:28:07 -- common/autotest_common.sh@867 -- # local i 00:04:44.828 09:28:07 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:44.828 09:28:07 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:44.828 09:28:07 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:44.828 09:28:07 -- common/autotest_common.sh@871 -- # break 00:04:44.828 09:28:07 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:44.828 09:28:07 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:44.828 09:28:07 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:44.828 1+0 records in 00:04:44.828 1+0 records out 00:04:44.828 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000211357 s, 19.4 MB/s 00:04:44.828 09:28:07 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:44.828 09:28:07 -- common/autotest_common.sh@884 -- # size=4096 00:04:44.828 09:28:07 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:44.828 09:28:07 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:44.828 09:28:07 -- common/autotest_common.sh@887 -- # return 0 00:04:44.828 09:28:07 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:44.828 09:28:07 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:44.828 09:28:07 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:44.828 09:28:07 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:44.828 09:28:07 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:45.086 { 00:04:45.086 "nbd_device": "/dev/nbd0", 00:04:45.086 "bdev_name": "Malloc0" 00:04:45.086 }, 00:04:45.086 { 00:04:45.086 "nbd_device": "/dev/nbd1", 00:04:45.086 "bdev_name": "Malloc1" 00:04:45.086 } 00:04:45.086 ]' 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:45.086 { 00:04:45.086 "nbd_device": "/dev/nbd0", 00:04:45.086 "bdev_name": "Malloc0" 00:04:45.086 }, 00:04:45.086 { 00:04:45.086 "nbd_device": "/dev/nbd1", 00:04:45.086 "bdev_name": "Malloc1" 00:04:45.086 } 00:04:45.086 ]' 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:45.086 /dev/nbd1' 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:45.086 /dev/nbd1' 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@65 -- # count=2 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@95 -- # count=2 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:45.086 256+0 records in 00:04:45.086 256+0 records out 00:04:45.086 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00496321 s, 211 MB/s 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:45.086 09:28:07 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:45.087 256+0 records in 00:04:45.087 256+0 records out 00:04:45.087 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228454 s, 45.9 MB/s 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:45.087 256+0 records in 00:04:45.087 256+0 records out 00:04:45.087 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247699 s, 42.3 MB/s 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@51 -- # local i 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:45.087 09:28:07 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:45.344 09:28:08 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:45.344 09:28:08 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:45.344 09:28:08 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:45.344 09:28:08 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:45.344 09:28:08 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:45.344 09:28:08 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:45.344 09:28:08 -- bdev/nbd_common.sh@41 -- # break 00:04:45.344 09:28:08 -- bdev/nbd_common.sh@45 -- # return 0 00:04:45.344 09:28:08 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:45.344 09:28:08 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:45.602 09:28:08 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:45.602 09:28:08 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:45.602 09:28:08 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:45.602 09:28:08 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:45.602 09:28:08 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:45.602 09:28:08 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:45.602 09:28:08 -- bdev/nbd_common.sh@41 -- # break 00:04:45.602 09:28:08 -- bdev/nbd_common.sh@45 -- # return 0 00:04:45.602 09:28:08 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:45.602 09:28:08 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:45.602 09:28:08 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:45.860 09:28:08 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:45.860 09:28:08 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:45.860 09:28:08 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:46.118 09:28:08 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:46.118 09:28:08 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:46.118 09:28:08 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:46.118 09:28:08 -- bdev/nbd_common.sh@65 -- # true 00:04:46.118 09:28:08 -- bdev/nbd_common.sh@65 -- # count=0 00:04:46.118 09:28:08 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:46.118 09:28:08 -- bdev/nbd_common.sh@104 -- # count=0 00:04:46.118 09:28:08 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:46.118 09:28:08 -- bdev/nbd_common.sh@109 -- # return 0 00:04:46.118 09:28:08 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:46.376 09:28:09 -- event/event.sh@35 -- # sleep 3 00:04:46.635 [2024-11-29 09:28:09.278646] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:46.635 [2024-11-29 09:28:09.392105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.635 [2024-11-29 09:28:09.392106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:46.635 [2024-11-29 09:28:09.453560] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:46.635 [2024-11-29 09:28:09.453645] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:49.913 09:28:12 -- event/event.sh@23 -- # for i in {0..2} 00:04:49.913 09:28:12 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:49.913 spdk_app_start Round 1 00:04:49.913 09:28:12 -- event/event.sh@25 -- # waitforlisten 4100552 /var/tmp/spdk-nbd.sock 00:04:49.913 09:28:12 -- common/autotest_common.sh@829 -- # '[' -z 4100552 ']' 00:04:49.914 09:28:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:49.914 09:28:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:49.914 09:28:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:49.914 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:49.914 09:28:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:49.914 09:28:12 -- common/autotest_common.sh@10 -- # set +x 00:04:49.914 09:28:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:49.914 09:28:12 -- common/autotest_common.sh@862 -- # return 0 00:04:49.914 09:28:12 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:49.914 Malloc0 00:04:49.914 09:28:12 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:50.172 Malloc1 00:04:50.172 09:28:12 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@12 -- # local i 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:50.172 09:28:12 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:50.429 /dev/nbd0 00:04:50.429 09:28:13 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:50.429 09:28:13 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:50.429 09:28:13 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:50.429 09:28:13 -- common/autotest_common.sh@867 -- # local i 00:04:50.429 09:28:13 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:50.429 09:28:13 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:50.429 09:28:13 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:50.429 09:28:13 -- common/autotest_common.sh@871 -- # break 00:04:50.429 09:28:13 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:50.429 09:28:13 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:50.429 09:28:13 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:50.429 1+0 records in 00:04:50.429 1+0 records out 00:04:50.429 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000177697 s, 23.1 MB/s 00:04:50.429 09:28:13 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:50.429 09:28:13 -- common/autotest_common.sh@884 -- # size=4096 00:04:50.429 09:28:13 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:50.429 09:28:13 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:50.429 09:28:13 -- common/autotest_common.sh@887 -- # return 0 00:04:50.429 09:28:13 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:50.429 09:28:13 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:50.429 09:28:13 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:50.687 /dev/nbd1 00:04:50.687 09:28:13 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:50.687 09:28:13 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:50.687 09:28:13 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:50.687 09:28:13 -- common/autotest_common.sh@867 -- # local i 00:04:50.687 09:28:13 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:50.687 09:28:13 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:50.687 09:28:13 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:50.687 09:28:13 -- common/autotest_common.sh@871 -- # break 00:04:50.687 09:28:13 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:50.687 09:28:13 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:50.687 09:28:13 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:50.687 1+0 records in 00:04:50.687 1+0 records out 00:04:50.687 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000199477 s, 20.5 MB/s 00:04:50.687 09:28:13 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:50.687 09:28:13 -- common/autotest_common.sh@884 -- # size=4096 00:04:50.687 09:28:13 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:50.687 09:28:13 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:50.687 09:28:13 -- common/autotest_common.sh@887 -- # return 0 00:04:50.687 09:28:13 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:50.687 09:28:13 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:50.687 09:28:13 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:50.687 09:28:13 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:50.687 09:28:13 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:50.945 { 00:04:50.945 "nbd_device": "/dev/nbd0", 00:04:50.945 "bdev_name": "Malloc0" 00:04:50.945 }, 00:04:50.945 { 00:04:50.945 "nbd_device": "/dev/nbd1", 00:04:50.945 "bdev_name": "Malloc1" 00:04:50.945 } 00:04:50.945 ]' 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:50.945 { 00:04:50.945 "nbd_device": "/dev/nbd0", 00:04:50.945 "bdev_name": "Malloc0" 00:04:50.945 }, 00:04:50.945 { 00:04:50.945 "nbd_device": "/dev/nbd1", 00:04:50.945 "bdev_name": "Malloc1" 00:04:50.945 } 00:04:50.945 ]' 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:50.945 /dev/nbd1' 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:50.945 /dev/nbd1' 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@65 -- # count=2 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@95 -- # count=2 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:50.945 256+0 records in 00:04:50.945 256+0 records out 00:04:50.945 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00395082 s, 265 MB/s 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:50.945 256+0 records in 00:04:50.945 256+0 records out 00:04:50.945 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196459 s, 53.4 MB/s 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:50.945 256+0 records in 00:04:50.945 256+0 records out 00:04:50.945 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021545 s, 48.7 MB/s 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:50.945 09:28:13 -- bdev/nbd_common.sh@51 -- # local i 00:04:50.946 09:28:13 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:50.946 09:28:13 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:51.203 09:28:13 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:51.203 09:28:13 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:51.203 09:28:13 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:51.203 09:28:13 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:51.203 09:28:13 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:51.203 09:28:13 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:51.203 09:28:13 -- bdev/nbd_common.sh@41 -- # break 00:04:51.203 09:28:13 -- bdev/nbd_common.sh@45 -- # return 0 00:04:51.203 09:28:13 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:51.203 09:28:13 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:51.461 09:28:14 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:51.461 09:28:14 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:51.461 09:28:14 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:51.461 09:28:14 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:51.461 09:28:14 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:51.461 09:28:14 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:51.461 09:28:14 -- bdev/nbd_common.sh@41 -- # break 00:04:51.461 09:28:14 -- bdev/nbd_common.sh@45 -- # return 0 00:04:51.461 09:28:14 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:51.461 09:28:14 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.461 09:28:14 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:51.720 09:28:14 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:51.720 09:28:14 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:51.720 09:28:14 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:51.978 09:28:14 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:51.978 09:28:14 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:51.978 09:28:14 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:51.978 09:28:14 -- bdev/nbd_common.sh@65 -- # true 00:04:51.978 09:28:14 -- bdev/nbd_common.sh@65 -- # count=0 00:04:51.978 09:28:14 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:51.978 09:28:14 -- bdev/nbd_common.sh@104 -- # count=0 00:04:51.978 09:28:14 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:51.978 09:28:14 -- bdev/nbd_common.sh@109 -- # return 0 00:04:51.978 09:28:14 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:52.237 09:28:14 -- event/event.sh@35 -- # sleep 3 00:04:52.493 [2024-11-29 09:28:15.127269] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:52.493 [2024-11-29 09:28:15.240787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:52.493 [2024-11-29 09:28:15.240792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:52.493 [2024-11-29 09:28:15.302602] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:52.494 [2024-11-29 09:28:15.302691] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:55.019 09:28:17 -- event/event.sh@23 -- # for i in {0..2} 00:04:55.019 09:28:17 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:55.019 spdk_app_start Round 2 00:04:55.019 09:28:17 -- event/event.sh@25 -- # waitforlisten 4100552 /var/tmp/spdk-nbd.sock 00:04:55.019 09:28:17 -- common/autotest_common.sh@829 -- # '[' -z 4100552 ']' 00:04:55.019 09:28:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:55.019 09:28:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:55.019 09:28:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:55.019 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:55.019 09:28:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:55.019 09:28:17 -- common/autotest_common.sh@10 -- # set +x 00:04:55.276 09:28:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:55.276 09:28:18 -- common/autotest_common.sh@862 -- # return 0 00:04:55.276 09:28:18 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:55.534 Malloc0 00:04:55.535 09:28:18 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:55.793 Malloc1 00:04:55.793 09:28:18 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:55.793 09:28:18 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:55.793 09:28:18 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:55.793 09:28:18 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:55.793 09:28:18 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:55.793 09:28:18 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:55.793 09:28:18 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:55.793 09:28:18 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:56.050 09:28:18 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:56.050 09:28:18 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:56.050 09:28:18 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:56.050 09:28:18 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:56.050 09:28:18 -- bdev/nbd_common.sh@12 -- # local i 00:04:56.050 09:28:18 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:56.050 09:28:18 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:56.050 09:28:18 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:56.307 /dev/nbd0 00:04:56.307 09:28:18 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:56.307 09:28:18 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:56.307 09:28:18 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:56.307 09:28:18 -- common/autotest_common.sh@867 -- # local i 00:04:56.307 09:28:18 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:56.307 09:28:18 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:56.307 09:28:18 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:56.307 09:28:18 -- common/autotest_common.sh@871 -- # break 00:04:56.307 09:28:18 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:56.307 09:28:18 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:56.307 09:28:18 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:56.307 1+0 records in 00:04:56.308 1+0 records out 00:04:56.308 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000172548 s, 23.7 MB/s 00:04:56.308 09:28:18 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:56.308 09:28:18 -- common/autotest_common.sh@884 -- # size=4096 00:04:56.308 09:28:18 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:56.308 09:28:18 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:56.308 09:28:18 -- common/autotest_common.sh@887 -- # return 0 00:04:56.308 09:28:18 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:56.308 09:28:18 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:56.308 09:28:18 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:56.565 /dev/nbd1 00:04:56.565 09:28:19 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:56.565 09:28:19 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:56.565 09:28:19 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:56.565 09:28:19 -- common/autotest_common.sh@867 -- # local i 00:04:56.565 09:28:19 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:56.565 09:28:19 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:56.565 09:28:19 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:56.565 09:28:19 -- common/autotest_common.sh@871 -- # break 00:04:56.565 09:28:19 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:56.565 09:28:19 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:56.565 09:28:19 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:56.565 1+0 records in 00:04:56.565 1+0 records out 00:04:56.565 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000211972 s, 19.3 MB/s 00:04:56.565 09:28:19 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:56.565 09:28:19 -- common/autotest_common.sh@884 -- # size=4096 00:04:56.565 09:28:19 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:56.565 09:28:19 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:56.565 09:28:19 -- common/autotest_common.sh@887 -- # return 0 00:04:56.565 09:28:19 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:56.565 09:28:19 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:56.565 09:28:19 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:56.565 09:28:19 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:56.565 09:28:19 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:56.823 { 00:04:56.823 "nbd_device": "/dev/nbd0", 00:04:56.823 "bdev_name": "Malloc0" 00:04:56.823 }, 00:04:56.823 { 00:04:56.823 "nbd_device": "/dev/nbd1", 00:04:56.823 "bdev_name": "Malloc1" 00:04:56.823 } 00:04:56.823 ]' 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:56.823 { 00:04:56.823 "nbd_device": "/dev/nbd0", 00:04:56.823 "bdev_name": "Malloc0" 00:04:56.823 }, 00:04:56.823 { 00:04:56.823 "nbd_device": "/dev/nbd1", 00:04:56.823 "bdev_name": "Malloc1" 00:04:56.823 } 00:04:56.823 ]' 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:56.823 /dev/nbd1' 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:56.823 /dev/nbd1' 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@65 -- # count=2 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@95 -- # count=2 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:56.823 256+0 records in 00:04:56.823 256+0 records out 00:04:56.823 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0038517 s, 272 MB/s 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:56.823 256+0 records in 00:04:56.823 256+0 records out 00:04:56.823 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018999 s, 55.2 MB/s 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:56.823 256+0 records in 00:04:56.823 256+0 records out 00:04:56.823 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237267 s, 44.2 MB/s 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@51 -- # local i 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:56.823 09:28:19 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:57.081 09:28:19 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:57.081 09:28:19 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:57.081 09:28:19 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:57.081 09:28:19 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:57.081 09:28:19 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:57.081 09:28:19 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:57.081 09:28:19 -- bdev/nbd_common.sh@41 -- # break 00:04:57.081 09:28:19 -- bdev/nbd_common.sh@45 -- # return 0 00:04:57.081 09:28:19 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:57.081 09:28:19 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:57.339 09:28:20 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:57.339 09:28:20 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:57.339 09:28:20 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:57.339 09:28:20 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:57.339 09:28:20 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:57.339 09:28:20 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:57.339 09:28:20 -- bdev/nbd_common.sh@41 -- # break 00:04:57.339 09:28:20 -- bdev/nbd_common.sh@45 -- # return 0 00:04:57.339 09:28:20 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:57.339 09:28:20 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.339 09:28:20 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:57.596 09:28:20 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:57.596 09:28:20 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:57.596 09:28:20 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:57.854 09:28:20 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:57.854 09:28:20 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:57.854 09:28:20 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:57.854 09:28:20 -- bdev/nbd_common.sh@65 -- # true 00:04:57.854 09:28:20 -- bdev/nbd_common.sh@65 -- # count=0 00:04:57.854 09:28:20 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:57.854 09:28:20 -- bdev/nbd_common.sh@104 -- # count=0 00:04:57.854 09:28:20 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:57.854 09:28:20 -- bdev/nbd_common.sh@109 -- # return 0 00:04:57.854 09:28:20 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:58.111 09:28:20 -- event/event.sh@35 -- # sleep 3 00:04:58.369 [2024-11-29 09:28:21.005435] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:58.369 [2024-11-29 09:28:21.121645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:58.369 [2024-11-29 09:28:21.121650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:58.369 [2024-11-29 09:28:21.178284] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:58.369 [2024-11-29 09:28:21.178355] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:00.893 09:28:23 -- event/event.sh@38 -- # waitforlisten 4100552 /var/tmp/spdk-nbd.sock 00:05:00.893 09:28:23 -- common/autotest_common.sh@829 -- # '[' -z 4100552 ']' 00:05:00.893 09:28:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:00.893 09:28:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:00.893 09:28:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:00.893 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:00.893 09:28:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:00.893 09:28:23 -- common/autotest_common.sh@10 -- # set +x 00:05:01.150 09:28:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:01.151 09:28:23 -- common/autotest_common.sh@862 -- # return 0 00:05:01.151 09:28:23 -- event/event.sh@39 -- # killprocess 4100552 00:05:01.151 09:28:23 -- common/autotest_common.sh@936 -- # '[' -z 4100552 ']' 00:05:01.151 09:28:23 -- common/autotest_common.sh@940 -- # kill -0 4100552 00:05:01.151 09:28:23 -- common/autotest_common.sh@941 -- # uname 00:05:01.151 09:28:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:01.151 09:28:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4100552 00:05:01.409 09:28:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:01.409 09:28:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:01.409 09:28:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4100552' 00:05:01.409 killing process with pid 4100552 00:05:01.409 09:28:24 -- common/autotest_common.sh@955 -- # kill 4100552 00:05:01.409 09:28:24 -- common/autotest_common.sh@960 -- # wait 4100552 00:05:01.668 spdk_app_start is called in Round 0. 00:05:01.668 Shutdown signal received, stop current app iteration 00:05:01.668 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:01.668 spdk_app_start is called in Round 1. 00:05:01.668 Shutdown signal received, stop current app iteration 00:05:01.668 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:01.668 spdk_app_start is called in Round 2. 00:05:01.668 Shutdown signal received, stop current app iteration 00:05:01.668 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:01.668 spdk_app_start is called in Round 3. 00:05:01.668 Shutdown signal received, stop current app iteration 00:05:01.668 09:28:24 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:01.668 09:28:24 -- event/event.sh@42 -- # return 0 00:05:01.668 00:05:01.668 real 0m18.957s 00:05:01.668 user 0m41.355s 00:05:01.668 sys 0m3.158s 00:05:01.668 09:28:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:01.668 09:28:24 -- common/autotest_common.sh@10 -- # set +x 00:05:01.668 ************************************ 00:05:01.668 END TEST app_repeat 00:05:01.668 ************************************ 00:05:01.668 09:28:24 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:01.668 09:28:24 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:01.668 09:28:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:01.668 09:28:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:01.668 09:28:24 -- common/autotest_common.sh@10 -- # set +x 00:05:01.668 ************************************ 00:05:01.668 START TEST cpu_locks 00:05:01.668 ************************************ 00:05:01.668 09:28:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:01.668 * Looking for test storage... 00:05:01.668 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:01.668 09:28:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:01.668 09:28:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:01.668 09:28:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:01.668 09:28:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:01.668 09:28:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:01.668 09:28:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:01.668 09:28:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:01.668 09:28:24 -- scripts/common.sh@335 -- # IFS=.-: 00:05:01.668 09:28:24 -- scripts/common.sh@335 -- # read -ra ver1 00:05:01.668 09:28:24 -- scripts/common.sh@336 -- # IFS=.-: 00:05:01.668 09:28:24 -- scripts/common.sh@336 -- # read -ra ver2 00:05:01.668 09:28:24 -- scripts/common.sh@337 -- # local 'op=<' 00:05:01.668 09:28:24 -- scripts/common.sh@339 -- # ver1_l=2 00:05:01.668 09:28:24 -- scripts/common.sh@340 -- # ver2_l=1 00:05:01.668 09:28:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:01.668 09:28:24 -- scripts/common.sh@343 -- # case "$op" in 00:05:01.668 09:28:24 -- scripts/common.sh@344 -- # : 1 00:05:01.668 09:28:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:01.668 09:28:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:01.668 09:28:24 -- scripts/common.sh@364 -- # decimal 1 00:05:01.668 09:28:24 -- scripts/common.sh@352 -- # local d=1 00:05:01.668 09:28:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:01.668 09:28:24 -- scripts/common.sh@354 -- # echo 1 00:05:01.668 09:28:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:01.668 09:28:24 -- scripts/common.sh@365 -- # decimal 2 00:05:01.668 09:28:24 -- scripts/common.sh@352 -- # local d=2 00:05:01.668 09:28:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:01.668 09:28:24 -- scripts/common.sh@354 -- # echo 2 00:05:01.668 09:28:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:01.668 09:28:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:01.668 09:28:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:01.668 09:28:24 -- scripts/common.sh@367 -- # return 0 00:05:01.668 09:28:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:01.668 09:28:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:01.668 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:01.668 --rc genhtml_branch_coverage=1 00:05:01.668 --rc genhtml_function_coverage=1 00:05:01.668 --rc genhtml_legend=1 00:05:01.668 --rc geninfo_all_blocks=1 00:05:01.668 --rc geninfo_unexecuted_blocks=1 00:05:01.668 00:05:01.668 ' 00:05:01.668 09:28:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:01.668 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:01.668 --rc genhtml_branch_coverage=1 00:05:01.668 --rc genhtml_function_coverage=1 00:05:01.668 --rc genhtml_legend=1 00:05:01.668 --rc geninfo_all_blocks=1 00:05:01.668 --rc geninfo_unexecuted_blocks=1 00:05:01.668 00:05:01.668 ' 00:05:01.668 09:28:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:01.668 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:01.668 --rc genhtml_branch_coverage=1 00:05:01.668 --rc genhtml_function_coverage=1 00:05:01.668 --rc genhtml_legend=1 00:05:01.668 --rc geninfo_all_blocks=1 00:05:01.668 --rc geninfo_unexecuted_blocks=1 00:05:01.668 00:05:01.668 ' 00:05:01.668 09:28:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:01.668 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:01.668 --rc genhtml_branch_coverage=1 00:05:01.668 --rc genhtml_function_coverage=1 00:05:01.668 --rc genhtml_legend=1 00:05:01.668 --rc geninfo_all_blocks=1 00:05:01.668 --rc geninfo_unexecuted_blocks=1 00:05:01.668 00:05:01.668 ' 00:05:01.668 09:28:24 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:01.668 09:28:24 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:01.668 09:28:24 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:01.668 09:28:24 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:01.668 09:28:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:01.668 09:28:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:01.668 09:28:24 -- common/autotest_common.sh@10 -- # set +x 00:05:01.668 ************************************ 00:05:01.668 START TEST default_locks 00:05:01.668 ************************************ 00:05:01.668 09:28:24 -- common/autotest_common.sh@1114 -- # default_locks 00:05:01.668 09:28:24 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=4103181 00:05:01.668 09:28:24 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:01.668 09:28:24 -- event/cpu_locks.sh@47 -- # waitforlisten 4103181 00:05:01.668 09:28:24 -- common/autotest_common.sh@829 -- # '[' -z 4103181 ']' 00:05:01.668 09:28:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:01.668 09:28:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:01.668 09:28:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:01.668 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:01.668 09:28:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:01.668 09:28:24 -- common/autotest_common.sh@10 -- # set +x 00:05:01.928 [2024-11-29 09:28:24.515951] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:01.928 [2024-11-29 09:28:24.516043] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4103181 ] 00:05:01.928 EAL: No free 2048 kB hugepages reported on node 1 00:05:01.928 [2024-11-29 09:28:24.577608] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:01.928 [2024-11-29 09:28:24.683564] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:01.928 [2024-11-29 09:28:24.683744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:02.859 09:28:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:02.859 09:28:25 -- common/autotest_common.sh@862 -- # return 0 00:05:02.859 09:28:25 -- event/cpu_locks.sh@49 -- # locks_exist 4103181 00:05:02.859 09:28:25 -- event/cpu_locks.sh@22 -- # lslocks -p 4103181 00:05:02.859 09:28:25 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:03.118 lslocks: write error 00:05:03.118 09:28:25 -- event/cpu_locks.sh@50 -- # killprocess 4103181 00:05:03.118 09:28:25 -- common/autotest_common.sh@936 -- # '[' -z 4103181 ']' 00:05:03.118 09:28:25 -- common/autotest_common.sh@940 -- # kill -0 4103181 00:05:03.118 09:28:25 -- common/autotest_common.sh@941 -- # uname 00:05:03.118 09:28:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:03.118 09:28:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4103181 00:05:03.118 09:28:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:03.118 09:28:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:03.118 09:28:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4103181' 00:05:03.118 killing process with pid 4103181 00:05:03.118 09:28:25 -- common/autotest_common.sh@955 -- # kill 4103181 00:05:03.118 09:28:25 -- common/autotest_common.sh@960 -- # wait 4103181 00:05:03.684 09:28:26 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 4103181 00:05:03.684 09:28:26 -- common/autotest_common.sh@650 -- # local es=0 00:05:03.684 09:28:26 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 4103181 00:05:03.684 09:28:26 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:03.684 09:28:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:03.684 09:28:26 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:03.684 09:28:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:03.684 09:28:26 -- common/autotest_common.sh@653 -- # waitforlisten 4103181 00:05:03.684 09:28:26 -- common/autotest_common.sh@829 -- # '[' -z 4103181 ']' 00:05:03.684 09:28:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:03.684 09:28:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:03.684 09:28:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:03.684 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:03.684 09:28:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:03.684 09:28:26 -- common/autotest_common.sh@10 -- # set +x 00:05:03.684 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (4103181) - No such process 00:05:03.684 ERROR: process (pid: 4103181) is no longer running 00:05:03.684 09:28:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:03.684 09:28:26 -- common/autotest_common.sh@862 -- # return 1 00:05:03.684 09:28:26 -- common/autotest_common.sh@653 -- # es=1 00:05:03.684 09:28:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:03.684 09:28:26 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:03.684 09:28:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:03.684 09:28:26 -- event/cpu_locks.sh@54 -- # no_locks 00:05:03.684 09:28:26 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:03.684 09:28:26 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:03.684 09:28:26 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:03.684 00:05:03.684 real 0m1.765s 00:05:03.684 user 0m1.915s 00:05:03.684 sys 0m0.567s 00:05:03.684 09:28:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:03.684 09:28:26 -- common/autotest_common.sh@10 -- # set +x 00:05:03.684 ************************************ 00:05:03.684 END TEST default_locks 00:05:03.684 ************************************ 00:05:03.684 09:28:26 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:03.684 09:28:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:03.684 09:28:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:03.684 09:28:26 -- common/autotest_common.sh@10 -- # set +x 00:05:03.684 ************************************ 00:05:03.684 START TEST default_locks_via_rpc 00:05:03.684 ************************************ 00:05:03.684 09:28:26 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:05:03.684 09:28:26 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=4103414 00:05:03.684 09:28:26 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:03.684 09:28:26 -- event/cpu_locks.sh@63 -- # waitforlisten 4103414 00:05:03.684 09:28:26 -- common/autotest_common.sh@829 -- # '[' -z 4103414 ']' 00:05:03.684 09:28:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:03.684 09:28:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:03.684 09:28:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:03.684 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:03.684 09:28:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:03.684 09:28:26 -- common/autotest_common.sh@10 -- # set +x 00:05:03.684 [2024-11-29 09:28:26.306610] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:03.684 [2024-11-29 09:28:26.306709] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4103414 ] 00:05:03.684 EAL: No free 2048 kB hugepages reported on node 1 00:05:03.684 [2024-11-29 09:28:26.372819] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:03.684 [2024-11-29 09:28:26.491650] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:03.684 [2024-11-29 09:28:26.491838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.618 09:28:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:04.618 09:28:27 -- common/autotest_common.sh@862 -- # return 0 00:05:04.618 09:28:27 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:04.618 09:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:04.618 09:28:27 -- common/autotest_common.sh@10 -- # set +x 00:05:04.618 09:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:04.618 09:28:27 -- event/cpu_locks.sh@67 -- # no_locks 00:05:04.618 09:28:27 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:04.618 09:28:27 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:04.618 09:28:27 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:04.618 09:28:27 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:04.618 09:28:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:04.618 09:28:27 -- common/autotest_common.sh@10 -- # set +x 00:05:04.618 09:28:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:04.618 09:28:27 -- event/cpu_locks.sh@71 -- # locks_exist 4103414 00:05:04.618 09:28:27 -- event/cpu_locks.sh@22 -- # lslocks -p 4103414 00:05:04.618 09:28:27 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:04.876 09:28:27 -- event/cpu_locks.sh@73 -- # killprocess 4103414 00:05:04.876 09:28:27 -- common/autotest_common.sh@936 -- # '[' -z 4103414 ']' 00:05:04.876 09:28:27 -- common/autotest_common.sh@940 -- # kill -0 4103414 00:05:04.876 09:28:27 -- common/autotest_common.sh@941 -- # uname 00:05:04.876 09:28:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:04.876 09:28:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4103414 00:05:04.876 09:28:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:04.876 09:28:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:04.876 09:28:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4103414' 00:05:04.876 killing process with pid 4103414 00:05:04.876 09:28:27 -- common/autotest_common.sh@955 -- # kill 4103414 00:05:04.876 09:28:27 -- common/autotest_common.sh@960 -- # wait 4103414 00:05:05.442 00:05:05.442 real 0m1.793s 00:05:05.442 user 0m1.967s 00:05:05.442 sys 0m0.559s 00:05:05.442 09:28:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.442 09:28:28 -- common/autotest_common.sh@10 -- # set +x 00:05:05.442 ************************************ 00:05:05.442 END TEST default_locks_via_rpc 00:05:05.442 ************************************ 00:05:05.442 09:28:28 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:05.442 09:28:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.442 09:28:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.442 09:28:28 -- common/autotest_common.sh@10 -- # set +x 00:05:05.442 ************************************ 00:05:05.442 START TEST non_locking_app_on_locked_coremask 00:05:05.442 ************************************ 00:05:05.442 09:28:28 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:05.442 09:28:28 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=4103706 00:05:05.442 09:28:28 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:05.442 09:28:28 -- event/cpu_locks.sh@81 -- # waitforlisten 4103706 /var/tmp/spdk.sock 00:05:05.442 09:28:28 -- common/autotest_common.sh@829 -- # '[' -z 4103706 ']' 00:05:05.442 09:28:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:05.442 09:28:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:05.442 09:28:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:05.442 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:05.442 09:28:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:05.442 09:28:28 -- common/autotest_common.sh@10 -- # set +x 00:05:05.442 [2024-11-29 09:28:28.120498] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:05.442 [2024-11-29 09:28:28.120592] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4103706 ] 00:05:05.442 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.442 [2024-11-29 09:28:28.178156] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:05.700 [2024-11-29 09:28:28.287610] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:05.700 [2024-11-29 09:28:28.287789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.265 09:28:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:06.266 09:28:29 -- common/autotest_common.sh@862 -- # return 0 00:05:06.266 09:28:29 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=4103846 00:05:06.266 09:28:29 -- event/cpu_locks.sh@85 -- # waitforlisten 4103846 /var/tmp/spdk2.sock 00:05:06.266 09:28:29 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:06.266 09:28:29 -- common/autotest_common.sh@829 -- # '[' -z 4103846 ']' 00:05:06.266 09:28:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:06.266 09:28:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:06.266 09:28:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:06.266 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:06.266 09:28:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:06.266 09:28:29 -- common/autotest_common.sh@10 -- # set +x 00:05:06.524 [2024-11-29 09:28:29.143317] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:06.524 [2024-11-29 09:28:29.143418] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4103846 ] 00:05:06.524 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.524 [2024-11-29 09:28:29.236400] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:06.524 [2024-11-29 09:28:29.236442] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:06.782 [2024-11-29 09:28:29.467984] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:06.782 [2024-11-29 09:28:29.468181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:07.391 09:28:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:07.391 09:28:30 -- common/autotest_common.sh@862 -- # return 0 00:05:07.391 09:28:30 -- event/cpu_locks.sh@87 -- # locks_exist 4103706 00:05:07.391 09:28:30 -- event/cpu_locks.sh@22 -- # lslocks -p 4103706 00:05:07.391 09:28:30 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:07.672 lslocks: write error 00:05:07.672 09:28:30 -- event/cpu_locks.sh@89 -- # killprocess 4103706 00:05:07.672 09:28:30 -- common/autotest_common.sh@936 -- # '[' -z 4103706 ']' 00:05:07.672 09:28:30 -- common/autotest_common.sh@940 -- # kill -0 4103706 00:05:07.672 09:28:30 -- common/autotest_common.sh@941 -- # uname 00:05:07.672 09:28:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:07.672 09:28:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4103706 00:05:07.930 09:28:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:07.930 09:28:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:07.930 09:28:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4103706' 00:05:07.930 killing process with pid 4103706 00:05:07.930 09:28:30 -- common/autotest_common.sh@955 -- # kill 4103706 00:05:07.930 09:28:30 -- common/autotest_common.sh@960 -- # wait 4103706 00:05:08.862 09:28:31 -- event/cpu_locks.sh@90 -- # killprocess 4103846 00:05:08.862 09:28:31 -- common/autotest_common.sh@936 -- # '[' -z 4103846 ']' 00:05:08.862 09:28:31 -- common/autotest_common.sh@940 -- # kill -0 4103846 00:05:08.862 09:28:31 -- common/autotest_common.sh@941 -- # uname 00:05:08.862 09:28:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:08.862 09:28:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4103846 00:05:08.862 09:28:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:08.862 09:28:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:08.862 09:28:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4103846' 00:05:08.862 killing process with pid 4103846 00:05:08.862 09:28:31 -- common/autotest_common.sh@955 -- # kill 4103846 00:05:08.862 09:28:31 -- common/autotest_common.sh@960 -- # wait 4103846 00:05:09.428 00:05:09.428 real 0m3.889s 00:05:09.428 user 0m4.248s 00:05:09.428 sys 0m1.076s 00:05:09.428 09:28:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:09.428 09:28:31 -- common/autotest_common.sh@10 -- # set +x 00:05:09.428 ************************************ 00:05:09.428 END TEST non_locking_app_on_locked_coremask 00:05:09.428 ************************************ 00:05:09.428 09:28:31 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:09.428 09:28:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:09.428 09:28:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:09.428 09:28:31 -- common/autotest_common.sh@10 -- # set +x 00:05:09.428 ************************************ 00:05:09.428 START TEST locking_app_on_unlocked_coremask 00:05:09.428 ************************************ 00:05:09.428 09:28:31 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:09.428 09:28:31 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=4104165 00:05:09.428 09:28:31 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:09.428 09:28:31 -- event/cpu_locks.sh@99 -- # waitforlisten 4104165 /var/tmp/spdk.sock 00:05:09.428 09:28:31 -- common/autotest_common.sh@829 -- # '[' -z 4104165 ']' 00:05:09.428 09:28:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:09.428 09:28:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:09.428 09:28:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:09.428 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:09.428 09:28:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:09.428 09:28:31 -- common/autotest_common.sh@10 -- # set +x 00:05:09.428 [2024-11-29 09:28:32.043159] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:09.428 [2024-11-29 09:28:32.043259] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4104165 ] 00:05:09.428 EAL: No free 2048 kB hugepages reported on node 1 00:05:09.428 [2024-11-29 09:28:32.102184] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:09.428 [2024-11-29 09:28:32.102224] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:09.428 [2024-11-29 09:28:32.209970] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:09.428 [2024-11-29 09:28:32.210147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.361 09:28:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:10.361 09:28:33 -- common/autotest_common.sh@862 -- # return 0 00:05:10.361 09:28:33 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=4104302 00:05:10.361 09:28:33 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:10.361 09:28:33 -- event/cpu_locks.sh@103 -- # waitforlisten 4104302 /var/tmp/spdk2.sock 00:05:10.361 09:28:33 -- common/autotest_common.sh@829 -- # '[' -z 4104302 ']' 00:05:10.361 09:28:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:10.361 09:28:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:10.361 09:28:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:10.361 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:10.361 09:28:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:10.361 09:28:33 -- common/autotest_common.sh@10 -- # set +x 00:05:10.361 [2024-11-29 09:28:33.047420] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:10.361 [2024-11-29 09:28:33.047515] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4104302 ] 00:05:10.361 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.361 [2024-11-29 09:28:33.139941] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:10.619 [2024-11-29 09:28:33.376092] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:10.619 [2024-11-29 09:28:33.376281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:11.184 09:28:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:11.185 09:28:33 -- common/autotest_common.sh@862 -- # return 0 00:05:11.185 09:28:33 -- event/cpu_locks.sh@105 -- # locks_exist 4104302 00:05:11.185 09:28:33 -- event/cpu_locks.sh@22 -- # lslocks -p 4104302 00:05:11.185 09:28:33 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:11.751 lslocks: write error 00:05:11.751 09:28:34 -- event/cpu_locks.sh@107 -- # killprocess 4104165 00:05:11.751 09:28:34 -- common/autotest_common.sh@936 -- # '[' -z 4104165 ']' 00:05:11.751 09:28:34 -- common/autotest_common.sh@940 -- # kill -0 4104165 00:05:11.751 09:28:34 -- common/autotest_common.sh@941 -- # uname 00:05:11.751 09:28:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:11.751 09:28:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4104165 00:05:11.751 09:28:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:11.751 09:28:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:11.751 09:28:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4104165' 00:05:11.751 killing process with pid 4104165 00:05:11.751 09:28:34 -- common/autotest_common.sh@955 -- # kill 4104165 00:05:11.751 09:28:34 -- common/autotest_common.sh@960 -- # wait 4104165 00:05:12.684 09:28:35 -- event/cpu_locks.sh@108 -- # killprocess 4104302 00:05:12.684 09:28:35 -- common/autotest_common.sh@936 -- # '[' -z 4104302 ']' 00:05:12.684 09:28:35 -- common/autotest_common.sh@940 -- # kill -0 4104302 00:05:12.684 09:28:35 -- common/autotest_common.sh@941 -- # uname 00:05:12.684 09:28:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:12.684 09:28:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4104302 00:05:12.684 09:28:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:12.684 09:28:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:12.684 09:28:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4104302' 00:05:12.684 killing process with pid 4104302 00:05:12.684 09:28:35 -- common/autotest_common.sh@955 -- # kill 4104302 00:05:12.684 09:28:35 -- common/autotest_common.sh@960 -- # wait 4104302 00:05:13.249 00:05:13.249 real 0m3.951s 00:05:13.249 user 0m4.332s 00:05:13.249 sys 0m1.020s 00:05:13.249 09:28:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.249 09:28:35 -- common/autotest_common.sh@10 -- # set +x 00:05:13.249 ************************************ 00:05:13.249 END TEST locking_app_on_unlocked_coremask 00:05:13.249 ************************************ 00:05:13.249 09:28:35 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:13.250 09:28:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:13.250 09:28:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.250 09:28:35 -- common/autotest_common.sh@10 -- # set +x 00:05:13.250 ************************************ 00:05:13.250 START TEST locking_app_on_locked_coremask 00:05:13.250 ************************************ 00:05:13.250 09:28:35 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:13.250 09:28:35 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=4104743 00:05:13.250 09:28:35 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:13.250 09:28:35 -- event/cpu_locks.sh@116 -- # waitforlisten 4104743 /var/tmp/spdk.sock 00:05:13.250 09:28:35 -- common/autotest_common.sh@829 -- # '[' -z 4104743 ']' 00:05:13.250 09:28:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:13.250 09:28:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:13.250 09:28:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:13.250 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:13.250 09:28:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:13.250 09:28:35 -- common/autotest_common.sh@10 -- # set +x 00:05:13.250 [2024-11-29 09:28:36.021016] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:13.250 [2024-11-29 09:28:36.021108] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4104743 ] 00:05:13.250 EAL: No free 2048 kB hugepages reported on node 1 00:05:13.250 [2024-11-29 09:28:36.081756] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:13.508 [2024-11-29 09:28:36.193292] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:13.508 [2024-11-29 09:28:36.193492] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:14.442 09:28:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:14.442 09:28:36 -- common/autotest_common.sh@862 -- # return 0 00:05:14.442 09:28:36 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=4104884 00:05:14.442 09:28:36 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 4104884 /var/tmp/spdk2.sock 00:05:14.442 09:28:36 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:14.442 09:28:36 -- common/autotest_common.sh@650 -- # local es=0 00:05:14.442 09:28:36 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 4104884 /var/tmp/spdk2.sock 00:05:14.442 09:28:36 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:14.442 09:28:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:14.442 09:28:36 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:14.442 09:28:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:14.442 09:28:36 -- common/autotest_common.sh@653 -- # waitforlisten 4104884 /var/tmp/spdk2.sock 00:05:14.442 09:28:36 -- common/autotest_common.sh@829 -- # '[' -z 4104884 ']' 00:05:14.442 09:28:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:14.442 09:28:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:14.442 09:28:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:14.442 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:14.442 09:28:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:14.442 09:28:36 -- common/autotest_common.sh@10 -- # set +x 00:05:14.442 [2024-11-29 09:28:37.026897] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.442 [2024-11-29 09:28:37.026974] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4104884 ] 00:05:14.442 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.442 [2024-11-29 09:28:37.122940] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 4104743 has claimed it. 00:05:14.442 [2024-11-29 09:28:37.123004] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:15.008 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (4104884) - No such process 00:05:15.008 ERROR: process (pid: 4104884) is no longer running 00:05:15.008 09:28:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:15.008 09:28:37 -- common/autotest_common.sh@862 -- # return 1 00:05:15.008 09:28:37 -- common/autotest_common.sh@653 -- # es=1 00:05:15.008 09:28:37 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:15.008 09:28:37 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:15.008 09:28:37 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:15.008 09:28:37 -- event/cpu_locks.sh@122 -- # locks_exist 4104743 00:05:15.008 09:28:37 -- event/cpu_locks.sh@22 -- # lslocks -p 4104743 00:05:15.008 09:28:37 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:15.266 lslocks: write error 00:05:15.266 09:28:38 -- event/cpu_locks.sh@124 -- # killprocess 4104743 00:05:15.266 09:28:38 -- common/autotest_common.sh@936 -- # '[' -z 4104743 ']' 00:05:15.266 09:28:38 -- common/autotest_common.sh@940 -- # kill -0 4104743 00:05:15.266 09:28:38 -- common/autotest_common.sh@941 -- # uname 00:05:15.266 09:28:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:15.266 09:28:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4104743 00:05:15.524 09:28:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:15.524 09:28:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:15.524 09:28:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4104743' 00:05:15.524 killing process with pid 4104743 00:05:15.524 09:28:38 -- common/autotest_common.sh@955 -- # kill 4104743 00:05:15.524 09:28:38 -- common/autotest_common.sh@960 -- # wait 4104743 00:05:15.782 00:05:15.782 real 0m2.613s 00:05:15.782 user 0m3.000s 00:05:15.782 sys 0m0.661s 00:05:15.782 09:28:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:15.782 09:28:38 -- common/autotest_common.sh@10 -- # set +x 00:05:15.782 ************************************ 00:05:15.782 END TEST locking_app_on_locked_coremask 00:05:15.782 ************************************ 00:05:15.782 09:28:38 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:15.782 09:28:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:15.782 09:28:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:15.782 09:28:38 -- common/autotest_common.sh@10 -- # set +x 00:05:15.782 ************************************ 00:05:15.782 START TEST locking_overlapped_coremask 00:05:15.782 ************************************ 00:05:15.782 09:28:38 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:15.782 09:28:38 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=4105055 00:05:15.782 09:28:38 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:15.782 09:28:38 -- event/cpu_locks.sh@133 -- # waitforlisten 4105055 /var/tmp/spdk.sock 00:05:15.782 09:28:38 -- common/autotest_common.sh@829 -- # '[' -z 4105055 ']' 00:05:15.782 09:28:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:15.782 09:28:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:15.782 09:28:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:15.782 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:15.782 09:28:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:15.782 09:28:38 -- common/autotest_common.sh@10 -- # set +x 00:05:16.040 [2024-11-29 09:28:38.661463] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:16.040 [2024-11-29 09:28:38.661566] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4105055 ] 00:05:16.040 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.040 [2024-11-29 09:28:38.718792] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:16.040 [2024-11-29 09:28:38.828328] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:16.040 [2024-11-29 09:28:38.828547] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:16.040 [2024-11-29 09:28:38.828605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:16.040 [2024-11-29 09:28:38.828608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:16.973 09:28:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:16.973 09:28:39 -- common/autotest_common.sh@862 -- # return 0 00:05:16.973 09:28:39 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=4105199 00:05:16.973 09:28:39 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 4105199 /var/tmp/spdk2.sock 00:05:16.973 09:28:39 -- common/autotest_common.sh@650 -- # local es=0 00:05:16.973 09:28:39 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:16.973 09:28:39 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 4105199 /var/tmp/spdk2.sock 00:05:16.973 09:28:39 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:16.973 09:28:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:16.973 09:28:39 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:16.973 09:28:39 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:16.973 09:28:39 -- common/autotest_common.sh@653 -- # waitforlisten 4105199 /var/tmp/spdk2.sock 00:05:16.973 09:28:39 -- common/autotest_common.sh@829 -- # '[' -z 4105199 ']' 00:05:16.973 09:28:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:16.973 09:28:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:16.973 09:28:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:16.973 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:16.973 09:28:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:16.973 09:28:39 -- common/autotest_common.sh@10 -- # set +x 00:05:16.973 [2024-11-29 09:28:39.667796] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:16.973 [2024-11-29 09:28:39.667871] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4105199 ] 00:05:16.973 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.973 [2024-11-29 09:28:39.755984] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 4105055 has claimed it. 00:05:16.973 [2024-11-29 09:28:39.756044] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:17.539 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (4105199) - No such process 00:05:17.539 ERROR: process (pid: 4105199) is no longer running 00:05:17.539 09:28:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:17.539 09:28:40 -- common/autotest_common.sh@862 -- # return 1 00:05:17.539 09:28:40 -- common/autotest_common.sh@653 -- # es=1 00:05:17.539 09:28:40 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:17.539 09:28:40 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:17.539 09:28:40 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:17.540 09:28:40 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:17.540 09:28:40 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:17.540 09:28:40 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:17.540 09:28:40 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:17.540 09:28:40 -- event/cpu_locks.sh@141 -- # killprocess 4105055 00:05:17.540 09:28:40 -- common/autotest_common.sh@936 -- # '[' -z 4105055 ']' 00:05:17.540 09:28:40 -- common/autotest_common.sh@940 -- # kill -0 4105055 00:05:17.540 09:28:40 -- common/autotest_common.sh@941 -- # uname 00:05:17.540 09:28:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:17.540 09:28:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4105055 00:05:17.798 09:28:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:17.798 09:28:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:17.798 09:28:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4105055' 00:05:17.798 killing process with pid 4105055 00:05:17.798 09:28:40 -- common/autotest_common.sh@955 -- # kill 4105055 00:05:17.798 09:28:40 -- common/autotest_common.sh@960 -- # wait 4105055 00:05:18.057 00:05:18.057 real 0m2.241s 00:05:18.057 user 0m6.375s 00:05:18.057 sys 0m0.454s 00:05:18.057 09:28:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:18.057 09:28:40 -- common/autotest_common.sh@10 -- # set +x 00:05:18.057 ************************************ 00:05:18.057 END TEST locking_overlapped_coremask 00:05:18.057 ************************************ 00:05:18.057 09:28:40 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:18.057 09:28:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:18.057 09:28:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:18.057 09:28:40 -- common/autotest_common.sh@10 -- # set +x 00:05:18.057 ************************************ 00:05:18.057 START TEST locking_overlapped_coremask_via_rpc 00:05:18.057 ************************************ 00:05:18.057 09:28:40 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:18.057 09:28:40 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=4105363 00:05:18.057 09:28:40 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:18.057 09:28:40 -- event/cpu_locks.sh@149 -- # waitforlisten 4105363 /var/tmp/spdk.sock 00:05:18.057 09:28:40 -- common/autotest_common.sh@829 -- # '[' -z 4105363 ']' 00:05:18.057 09:28:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:18.057 09:28:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:18.057 09:28:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:18.057 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:18.057 09:28:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:18.057 09:28:40 -- common/autotest_common.sh@10 -- # set +x 00:05:18.315 [2024-11-29 09:28:40.936477] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:18.315 [2024-11-29 09:28:40.936572] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4105363 ] 00:05:18.315 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.315 [2024-11-29 09:28:40.994014] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:18.315 [2024-11-29 09:28:40.994055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:18.315 [2024-11-29 09:28:41.102310] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:18.315 [2024-11-29 09:28:41.102536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:18.315 [2024-11-29 09:28:41.102595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:18.315 [2024-11-29 09:28:41.102598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.250 09:28:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:19.250 09:28:41 -- common/autotest_common.sh@862 -- # return 0 00:05:19.250 09:28:41 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=4105505 00:05:19.250 09:28:41 -- event/cpu_locks.sh@153 -- # waitforlisten 4105505 /var/tmp/spdk2.sock 00:05:19.250 09:28:41 -- common/autotest_common.sh@829 -- # '[' -z 4105505 ']' 00:05:19.250 09:28:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:19.250 09:28:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:19.250 09:28:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:19.250 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:19.250 09:28:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:19.250 09:28:41 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:19.250 09:28:41 -- common/autotest_common.sh@10 -- # set +x 00:05:19.250 [2024-11-29 09:28:41.941325] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:19.250 [2024-11-29 09:28:41.941420] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4105505 ] 00:05:19.250 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.250 [2024-11-29 09:28:42.029031] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:19.250 [2024-11-29 09:28:42.029063] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:19.508 [2024-11-29 09:28:42.247150] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:19.508 [2024-11-29 09:28:42.247442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:19.508 [2024-11-29 09:28:42.251453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:19.508 [2024-11-29 09:28:42.251456] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:20.075 09:28:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:20.075 09:28:42 -- common/autotest_common.sh@862 -- # return 0 00:05:20.075 09:28:42 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:20.075 09:28:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:20.075 09:28:42 -- common/autotest_common.sh@10 -- # set +x 00:05:20.075 09:28:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:20.075 09:28:42 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:20.075 09:28:42 -- common/autotest_common.sh@650 -- # local es=0 00:05:20.075 09:28:42 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:20.075 09:28:42 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:20.075 09:28:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:20.075 09:28:42 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:20.075 09:28:42 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:20.075 09:28:42 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:20.075 09:28:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:20.075 09:28:42 -- common/autotest_common.sh@10 -- # set +x 00:05:20.075 [2024-11-29 09:28:42.895499] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 4105363 has claimed it. 00:05:20.075 request: 00:05:20.075 { 00:05:20.075 "method": "framework_enable_cpumask_locks", 00:05:20.075 "req_id": 1 00:05:20.075 } 00:05:20.076 Got JSON-RPC error response 00:05:20.076 response: 00:05:20.076 { 00:05:20.076 "code": -32603, 00:05:20.076 "message": "Failed to claim CPU core: 2" 00:05:20.076 } 00:05:20.076 09:28:42 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:20.076 09:28:42 -- common/autotest_common.sh@653 -- # es=1 00:05:20.076 09:28:42 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:20.076 09:28:42 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:20.076 09:28:42 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:20.076 09:28:42 -- event/cpu_locks.sh@158 -- # waitforlisten 4105363 /var/tmp/spdk.sock 00:05:20.076 09:28:42 -- common/autotest_common.sh@829 -- # '[' -z 4105363 ']' 00:05:20.076 09:28:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:20.076 09:28:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:20.076 09:28:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:20.076 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:20.076 09:28:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:20.076 09:28:42 -- common/autotest_common.sh@10 -- # set +x 00:05:20.334 09:28:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:20.334 09:28:43 -- common/autotest_common.sh@862 -- # return 0 00:05:20.334 09:28:43 -- event/cpu_locks.sh@159 -- # waitforlisten 4105505 /var/tmp/spdk2.sock 00:05:20.334 09:28:43 -- common/autotest_common.sh@829 -- # '[' -z 4105505 ']' 00:05:20.334 09:28:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:20.334 09:28:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:20.334 09:28:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:20.334 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:20.334 09:28:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:20.334 09:28:43 -- common/autotest_common.sh@10 -- # set +x 00:05:20.591 09:28:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:20.591 09:28:43 -- common/autotest_common.sh@862 -- # return 0 00:05:20.591 09:28:43 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:20.591 09:28:43 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:20.592 09:28:43 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:20.592 09:28:43 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:20.592 00:05:20.592 real 0m2.525s 00:05:20.592 user 0m1.242s 00:05:20.592 sys 0m0.198s 00:05:20.592 09:28:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.592 09:28:43 -- common/autotest_common.sh@10 -- # set +x 00:05:20.592 ************************************ 00:05:20.592 END TEST locking_overlapped_coremask_via_rpc 00:05:20.592 ************************************ 00:05:20.592 09:28:43 -- event/cpu_locks.sh@174 -- # cleanup 00:05:20.592 09:28:43 -- event/cpu_locks.sh@15 -- # [[ -z 4105363 ]] 00:05:20.592 09:28:43 -- event/cpu_locks.sh@15 -- # killprocess 4105363 00:05:20.592 09:28:43 -- common/autotest_common.sh@936 -- # '[' -z 4105363 ']' 00:05:20.592 09:28:43 -- common/autotest_common.sh@940 -- # kill -0 4105363 00:05:20.849 09:28:43 -- common/autotest_common.sh@941 -- # uname 00:05:20.849 09:28:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:20.849 09:28:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4105363 00:05:20.849 09:28:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:20.849 09:28:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:20.849 09:28:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4105363' 00:05:20.849 killing process with pid 4105363 00:05:20.849 09:28:43 -- common/autotest_common.sh@955 -- # kill 4105363 00:05:20.849 09:28:43 -- common/autotest_common.sh@960 -- # wait 4105363 00:05:21.107 09:28:43 -- event/cpu_locks.sh@16 -- # [[ -z 4105505 ]] 00:05:21.107 09:28:43 -- event/cpu_locks.sh@16 -- # killprocess 4105505 00:05:21.107 09:28:43 -- common/autotest_common.sh@936 -- # '[' -z 4105505 ']' 00:05:21.107 09:28:43 -- common/autotest_common.sh@940 -- # kill -0 4105505 00:05:21.107 09:28:43 -- common/autotest_common.sh@941 -- # uname 00:05:21.107 09:28:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:21.107 09:28:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4105505 00:05:21.366 09:28:43 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:21.366 09:28:43 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:21.366 09:28:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4105505' 00:05:21.366 killing process with pid 4105505 00:05:21.366 09:28:43 -- common/autotest_common.sh@955 -- # kill 4105505 00:05:21.366 09:28:43 -- common/autotest_common.sh@960 -- # wait 4105505 00:05:21.624 09:28:44 -- event/cpu_locks.sh@18 -- # rm -f 00:05:21.624 09:28:44 -- event/cpu_locks.sh@1 -- # cleanup 00:05:21.624 09:28:44 -- event/cpu_locks.sh@15 -- # [[ -z 4105363 ]] 00:05:21.624 09:28:44 -- event/cpu_locks.sh@15 -- # killprocess 4105363 00:05:21.624 09:28:44 -- common/autotest_common.sh@936 -- # '[' -z 4105363 ']' 00:05:21.624 09:28:44 -- common/autotest_common.sh@940 -- # kill -0 4105363 00:05:21.624 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (4105363) - No such process 00:05:21.624 09:28:44 -- common/autotest_common.sh@963 -- # echo 'Process with pid 4105363 is not found' 00:05:21.624 Process with pid 4105363 is not found 00:05:21.624 09:28:44 -- event/cpu_locks.sh@16 -- # [[ -z 4105505 ]] 00:05:21.624 09:28:44 -- event/cpu_locks.sh@16 -- # killprocess 4105505 00:05:21.624 09:28:44 -- common/autotest_common.sh@936 -- # '[' -z 4105505 ']' 00:05:21.624 09:28:44 -- common/autotest_common.sh@940 -- # kill -0 4105505 00:05:21.624 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (4105505) - No such process 00:05:21.624 09:28:44 -- common/autotest_common.sh@963 -- # echo 'Process with pid 4105505 is not found' 00:05:21.624 Process with pid 4105505 is not found 00:05:21.624 09:28:44 -- event/cpu_locks.sh@18 -- # rm -f 00:05:21.624 00:05:21.624 real 0m20.105s 00:05:21.624 user 0m35.782s 00:05:21.624 sys 0m5.375s 00:05:21.624 09:28:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.624 09:28:44 -- common/autotest_common.sh@10 -- # set +x 00:05:21.624 ************************************ 00:05:21.624 END TEST cpu_locks 00:05:21.624 ************************************ 00:05:21.624 00:05:21.624 real 0m47.638s 00:05:21.624 user 1m30.972s 00:05:21.624 sys 0m9.307s 00:05:21.624 09:28:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.624 09:28:44 -- common/autotest_common.sh@10 -- # set +x 00:05:21.624 ************************************ 00:05:21.624 END TEST event 00:05:21.624 ************************************ 00:05:21.624 09:28:44 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:21.624 09:28:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:21.624 09:28:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.624 09:28:44 -- common/autotest_common.sh@10 -- # set +x 00:05:21.624 ************************************ 00:05:21.624 START TEST thread 00:05:21.624 ************************************ 00:05:21.624 09:28:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:21.883 * Looking for test storage... 00:05:21.883 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:21.883 09:28:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:21.883 09:28:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:21.883 09:28:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:21.883 09:28:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:21.883 09:28:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:21.883 09:28:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:21.883 09:28:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:21.883 09:28:44 -- scripts/common.sh@335 -- # IFS=.-: 00:05:21.883 09:28:44 -- scripts/common.sh@335 -- # read -ra ver1 00:05:21.883 09:28:44 -- scripts/common.sh@336 -- # IFS=.-: 00:05:21.883 09:28:44 -- scripts/common.sh@336 -- # read -ra ver2 00:05:21.883 09:28:44 -- scripts/common.sh@337 -- # local 'op=<' 00:05:21.883 09:28:44 -- scripts/common.sh@339 -- # ver1_l=2 00:05:21.883 09:28:44 -- scripts/common.sh@340 -- # ver2_l=1 00:05:21.883 09:28:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:21.883 09:28:44 -- scripts/common.sh@343 -- # case "$op" in 00:05:21.883 09:28:44 -- scripts/common.sh@344 -- # : 1 00:05:21.883 09:28:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:21.883 09:28:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:21.883 09:28:44 -- scripts/common.sh@364 -- # decimal 1 00:05:21.883 09:28:44 -- scripts/common.sh@352 -- # local d=1 00:05:21.883 09:28:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:21.883 09:28:44 -- scripts/common.sh@354 -- # echo 1 00:05:21.883 09:28:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:21.883 09:28:44 -- scripts/common.sh@365 -- # decimal 2 00:05:21.883 09:28:44 -- scripts/common.sh@352 -- # local d=2 00:05:21.883 09:28:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:21.883 09:28:44 -- scripts/common.sh@354 -- # echo 2 00:05:21.883 09:28:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:21.883 09:28:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:21.883 09:28:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:21.883 09:28:44 -- scripts/common.sh@367 -- # return 0 00:05:21.883 09:28:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:21.883 09:28:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:21.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:21.883 --rc genhtml_branch_coverage=1 00:05:21.883 --rc genhtml_function_coverage=1 00:05:21.883 --rc genhtml_legend=1 00:05:21.883 --rc geninfo_all_blocks=1 00:05:21.883 --rc geninfo_unexecuted_blocks=1 00:05:21.883 00:05:21.883 ' 00:05:21.883 09:28:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:21.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:21.883 --rc genhtml_branch_coverage=1 00:05:21.883 --rc genhtml_function_coverage=1 00:05:21.883 --rc genhtml_legend=1 00:05:21.883 --rc geninfo_all_blocks=1 00:05:21.883 --rc geninfo_unexecuted_blocks=1 00:05:21.883 00:05:21.883 ' 00:05:21.883 09:28:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:21.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:21.883 --rc genhtml_branch_coverage=1 00:05:21.883 --rc genhtml_function_coverage=1 00:05:21.883 --rc genhtml_legend=1 00:05:21.883 --rc geninfo_all_blocks=1 00:05:21.883 --rc geninfo_unexecuted_blocks=1 00:05:21.883 00:05:21.883 ' 00:05:21.883 09:28:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:21.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:21.883 --rc genhtml_branch_coverage=1 00:05:21.883 --rc genhtml_function_coverage=1 00:05:21.883 --rc genhtml_legend=1 00:05:21.883 --rc geninfo_all_blocks=1 00:05:21.883 --rc geninfo_unexecuted_blocks=1 00:05:21.883 00:05:21.883 ' 00:05:21.883 09:28:44 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:21.883 09:28:44 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:21.883 09:28:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.883 09:28:44 -- common/autotest_common.sh@10 -- # set +x 00:05:21.883 ************************************ 00:05:21.883 START TEST thread_poller_perf 00:05:21.883 ************************************ 00:05:21.883 09:28:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:21.883 [2024-11-29 09:28:44.615204] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:21.883 [2024-11-29 09:28:44.615299] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4105890 ] 00:05:21.883 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.883 [2024-11-29 09:28:44.679878] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.142 [2024-11-29 09:28:44.798403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.142 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:23.515 [2024-11-29T08:28:46.358Z] ====================================== 00:05:23.515 [2024-11-29T08:28:46.358Z] busy:2713661429 (cyc) 00:05:23.515 [2024-11-29T08:28:46.358Z] total_run_count: 284000 00:05:23.515 [2024-11-29T08:28:46.358Z] tsc_hz: 2700000000 (cyc) 00:05:23.515 [2024-11-29T08:28:46.358Z] ====================================== 00:05:23.515 [2024-11-29T08:28:46.358Z] poller_cost: 9555 (cyc), 3538 (nsec) 00:05:23.515 00:05:23.515 real 0m1.330s 00:05:23.515 user 0m1.242s 00:05:23.515 sys 0m0.081s 00:05:23.515 09:28:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:23.515 09:28:45 -- common/autotest_common.sh@10 -- # set +x 00:05:23.515 ************************************ 00:05:23.515 END TEST thread_poller_perf 00:05:23.515 ************************************ 00:05:23.515 09:28:45 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:23.516 09:28:45 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:23.516 09:28:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:23.516 09:28:45 -- common/autotest_common.sh@10 -- # set +x 00:05:23.516 ************************************ 00:05:23.516 START TEST thread_poller_perf 00:05:23.516 ************************************ 00:05:23.516 09:28:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:23.516 [2024-11-29 09:28:45.972404] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:23.516 [2024-11-29 09:28:45.972491] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4106126 ] 00:05:23.516 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.516 [2024-11-29 09:28:46.033926] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:23.516 [2024-11-29 09:28:46.152824] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.516 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:24.450 [2024-11-29T08:28:47.293Z] ====================================== 00:05:24.450 [2024-11-29T08:28:47.293Z] busy:2703321998 (cyc) 00:05:24.450 [2024-11-29T08:28:47.293Z] total_run_count: 3832000 00:05:24.450 [2024-11-29T08:28:47.293Z] tsc_hz: 2700000000 (cyc) 00:05:24.450 [2024-11-29T08:28:47.293Z] ====================================== 00:05:24.450 [2024-11-29T08:28:47.293Z] poller_cost: 705 (cyc), 261 (nsec) 00:05:24.450 00:05:24.450 real 0m1.317s 00:05:24.450 user 0m1.231s 00:05:24.450 sys 0m0.079s 00:05:24.450 09:28:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.450 09:28:47 -- common/autotest_common.sh@10 -- # set +x 00:05:24.450 ************************************ 00:05:24.450 END TEST thread_poller_perf 00:05:24.450 ************************************ 00:05:24.709 09:28:47 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:24.709 00:05:24.709 real 0m2.840s 00:05:24.709 user 0m2.589s 00:05:24.709 sys 0m0.255s 00:05:24.709 09:28:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.709 09:28:47 -- common/autotest_common.sh@10 -- # set +x 00:05:24.709 ************************************ 00:05:24.709 END TEST thread 00:05:24.709 ************************************ 00:05:24.709 09:28:47 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:24.709 09:28:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:24.709 09:28:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.709 09:28:47 -- common/autotest_common.sh@10 -- # set +x 00:05:24.709 ************************************ 00:05:24.709 START TEST accel 00:05:24.709 ************************************ 00:05:24.710 09:28:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:24.710 * Looking for test storage... 00:05:24.710 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:24.710 09:28:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:24.710 09:28:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:24.710 09:28:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:24.710 09:28:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:24.710 09:28:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:24.710 09:28:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:24.710 09:28:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:24.710 09:28:47 -- scripts/common.sh@335 -- # IFS=.-: 00:05:24.710 09:28:47 -- scripts/common.sh@335 -- # read -ra ver1 00:05:24.710 09:28:47 -- scripts/common.sh@336 -- # IFS=.-: 00:05:24.710 09:28:47 -- scripts/common.sh@336 -- # read -ra ver2 00:05:24.710 09:28:47 -- scripts/common.sh@337 -- # local 'op=<' 00:05:24.710 09:28:47 -- scripts/common.sh@339 -- # ver1_l=2 00:05:24.710 09:28:47 -- scripts/common.sh@340 -- # ver2_l=1 00:05:24.710 09:28:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:24.710 09:28:47 -- scripts/common.sh@343 -- # case "$op" in 00:05:24.710 09:28:47 -- scripts/common.sh@344 -- # : 1 00:05:24.710 09:28:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:24.710 09:28:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:24.710 09:28:47 -- scripts/common.sh@364 -- # decimal 1 00:05:24.710 09:28:47 -- scripts/common.sh@352 -- # local d=1 00:05:24.710 09:28:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:24.710 09:28:47 -- scripts/common.sh@354 -- # echo 1 00:05:24.710 09:28:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:24.710 09:28:47 -- scripts/common.sh@365 -- # decimal 2 00:05:24.710 09:28:47 -- scripts/common.sh@352 -- # local d=2 00:05:24.710 09:28:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:24.710 09:28:47 -- scripts/common.sh@354 -- # echo 2 00:05:24.710 09:28:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:24.710 09:28:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:24.710 09:28:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:24.710 09:28:47 -- scripts/common.sh@367 -- # return 0 00:05:24.710 09:28:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:24.710 09:28:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:24.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:24.710 --rc genhtml_branch_coverage=1 00:05:24.710 --rc genhtml_function_coverage=1 00:05:24.710 --rc genhtml_legend=1 00:05:24.710 --rc geninfo_all_blocks=1 00:05:24.710 --rc geninfo_unexecuted_blocks=1 00:05:24.710 00:05:24.710 ' 00:05:24.710 09:28:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:24.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:24.710 --rc genhtml_branch_coverage=1 00:05:24.710 --rc genhtml_function_coverage=1 00:05:24.710 --rc genhtml_legend=1 00:05:24.710 --rc geninfo_all_blocks=1 00:05:24.710 --rc geninfo_unexecuted_blocks=1 00:05:24.710 00:05:24.710 ' 00:05:24.710 09:28:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:24.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:24.710 --rc genhtml_branch_coverage=1 00:05:24.710 --rc genhtml_function_coverage=1 00:05:24.710 --rc genhtml_legend=1 00:05:24.710 --rc geninfo_all_blocks=1 00:05:24.710 --rc geninfo_unexecuted_blocks=1 00:05:24.710 00:05:24.710 ' 00:05:24.710 09:28:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:24.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:24.710 --rc genhtml_branch_coverage=1 00:05:24.710 --rc genhtml_function_coverage=1 00:05:24.710 --rc genhtml_legend=1 00:05:24.710 --rc geninfo_all_blocks=1 00:05:24.710 --rc geninfo_unexecuted_blocks=1 00:05:24.710 00:05:24.710 ' 00:05:24.710 09:28:47 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:24.710 09:28:47 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:24.710 09:28:47 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:24.710 09:28:47 -- accel/accel.sh@59 -- # spdk_tgt_pid=4106376 00:05:24.710 09:28:47 -- accel/accel.sh@60 -- # waitforlisten 4106376 00:05:24.710 09:28:47 -- common/autotest_common.sh@829 -- # '[' -z 4106376 ']' 00:05:24.710 09:28:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:24.710 09:28:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:24.710 09:28:47 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:24.710 09:28:47 -- accel/accel.sh@58 -- # build_accel_config 00:05:24.710 09:28:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:24.710 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:24.710 09:28:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:24.710 09:28:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:24.710 09:28:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:24.710 09:28:47 -- common/autotest_common.sh@10 -- # set +x 00:05:24.710 09:28:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:24.710 09:28:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:24.710 09:28:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:24.710 09:28:47 -- accel/accel.sh@41 -- # local IFS=, 00:05:24.710 09:28:47 -- accel/accel.sh@42 -- # jq -r . 00:05:24.710 [2024-11-29 09:28:47.513961] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:24.710 [2024-11-29 09:28:47.514040] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4106376 ] 00:05:24.710 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.968 [2024-11-29 09:28:47.574152] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.968 [2024-11-29 09:28:47.691214] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:24.968 [2024-11-29 09:28:47.691412] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.904 09:28:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:25.904 09:28:48 -- common/autotest_common.sh@862 -- # return 0 00:05:25.904 09:28:48 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:25.904 09:28:48 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:25.904 09:28:48 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:25.904 09:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:25.904 09:28:48 -- common/autotest_common.sh@10 -- # set +x 00:05:25.904 09:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:25.904 09:28:48 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # IFS== 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # read -r opc module 00:05:25.904 09:28:48 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:25.904 09:28:48 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # IFS== 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # read -r opc module 00:05:25.904 09:28:48 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:25.904 09:28:48 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # IFS== 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # read -r opc module 00:05:25.904 09:28:48 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:25.904 09:28:48 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # IFS== 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # read -r opc module 00:05:25.904 09:28:48 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:25.904 09:28:48 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # IFS== 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # read -r opc module 00:05:25.904 09:28:48 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:25.904 09:28:48 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # IFS== 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # read -r opc module 00:05:25.904 09:28:48 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:25.904 09:28:48 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # IFS== 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # read -r opc module 00:05:25.904 09:28:48 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:25.904 09:28:48 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # IFS== 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # read -r opc module 00:05:25.904 09:28:48 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:25.904 09:28:48 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # IFS== 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # read -r opc module 00:05:25.904 09:28:48 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:25.904 09:28:48 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # IFS== 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # read -r opc module 00:05:25.904 09:28:48 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:25.904 09:28:48 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # IFS== 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # read -r opc module 00:05:25.904 09:28:48 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:25.904 09:28:48 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # IFS== 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # read -r opc module 00:05:25.904 09:28:48 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:25.904 09:28:48 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # IFS== 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # read -r opc module 00:05:25.904 09:28:48 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:25.904 09:28:48 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # IFS== 00:05:25.904 09:28:48 -- accel/accel.sh@64 -- # read -r opc module 00:05:25.904 09:28:48 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:25.904 09:28:48 -- accel/accel.sh@67 -- # killprocess 4106376 00:05:25.904 09:28:48 -- common/autotest_common.sh@936 -- # '[' -z 4106376 ']' 00:05:25.904 09:28:48 -- common/autotest_common.sh@940 -- # kill -0 4106376 00:05:25.904 09:28:48 -- common/autotest_common.sh@941 -- # uname 00:05:25.904 09:28:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:25.904 09:28:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4106376 00:05:25.904 09:28:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:25.904 09:28:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:25.904 09:28:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4106376' 00:05:25.904 killing process with pid 4106376 00:05:25.904 09:28:48 -- common/autotest_common.sh@955 -- # kill 4106376 00:05:25.904 09:28:48 -- common/autotest_common.sh@960 -- # wait 4106376 00:05:26.469 09:28:49 -- accel/accel.sh@68 -- # trap - ERR 00:05:26.470 09:28:49 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:26.470 09:28:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:26.470 09:28:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.470 09:28:49 -- common/autotest_common.sh@10 -- # set +x 00:05:26.470 09:28:49 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:26.470 09:28:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:26.470 09:28:49 -- accel/accel.sh@12 -- # build_accel_config 00:05:26.470 09:28:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:26.470 09:28:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:26.470 09:28:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:26.470 09:28:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:26.470 09:28:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:26.470 09:28:49 -- accel/accel.sh@41 -- # local IFS=, 00:05:26.470 09:28:49 -- accel/accel.sh@42 -- # jq -r . 00:05:26.470 09:28:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.470 09:28:49 -- common/autotest_common.sh@10 -- # set +x 00:05:26.470 09:28:49 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:26.470 09:28:49 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:26.470 09:28:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.470 09:28:49 -- common/autotest_common.sh@10 -- # set +x 00:05:26.470 ************************************ 00:05:26.470 START TEST accel_missing_filename 00:05:26.470 ************************************ 00:05:26.470 09:28:49 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:26.470 09:28:49 -- common/autotest_common.sh@650 -- # local es=0 00:05:26.470 09:28:49 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:26.470 09:28:49 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:26.470 09:28:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:26.470 09:28:49 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:26.470 09:28:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:26.470 09:28:49 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:26.470 09:28:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:26.470 09:28:49 -- accel/accel.sh@12 -- # build_accel_config 00:05:26.470 09:28:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:26.470 09:28:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:26.470 09:28:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:26.470 09:28:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:26.470 09:28:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:26.470 09:28:49 -- accel/accel.sh@41 -- # local IFS=, 00:05:26.470 09:28:49 -- accel/accel.sh@42 -- # jq -r . 00:05:26.470 [2024-11-29 09:28:49.128818] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.470 [2024-11-29 09:28:49.128899] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4106550 ] 00:05:26.470 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.470 [2024-11-29 09:28:49.192692] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.470 [2024-11-29 09:28:49.310277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.729 [2024-11-29 09:28:49.368968] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:26.729 [2024-11-29 09:28:49.448778] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:26.729 A filename is required. 00:05:26.729 09:28:49 -- common/autotest_common.sh@653 -- # es=234 00:05:26.729 09:28:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:26.729 09:28:49 -- common/autotest_common.sh@662 -- # es=106 00:05:26.729 09:28:49 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:26.729 09:28:49 -- common/autotest_common.sh@670 -- # es=1 00:05:26.729 09:28:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:26.729 00:05:26.729 real 0m0.455s 00:05:26.729 user 0m0.359s 00:05:26.729 sys 0m0.129s 00:05:26.729 09:28:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.729 09:28:49 -- common/autotest_common.sh@10 -- # set +x 00:05:26.729 ************************************ 00:05:26.729 END TEST accel_missing_filename 00:05:26.729 ************************************ 00:05:26.987 09:28:49 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:26.987 09:28:49 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:26.987 09:28:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.987 09:28:49 -- common/autotest_common.sh@10 -- # set +x 00:05:26.987 ************************************ 00:05:26.987 START TEST accel_compress_verify 00:05:26.987 ************************************ 00:05:26.987 09:28:49 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:26.987 09:28:49 -- common/autotest_common.sh@650 -- # local es=0 00:05:26.987 09:28:49 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:26.987 09:28:49 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:26.987 09:28:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:26.987 09:28:49 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:26.987 09:28:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:26.987 09:28:49 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:26.987 09:28:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:26.987 09:28:49 -- accel/accel.sh@12 -- # build_accel_config 00:05:26.987 09:28:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:26.987 09:28:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:26.987 09:28:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:26.987 09:28:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:26.987 09:28:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:26.987 09:28:49 -- accel/accel.sh@41 -- # local IFS=, 00:05:26.987 09:28:49 -- accel/accel.sh@42 -- # jq -r . 00:05:26.987 [2024-11-29 09:28:49.613011] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.988 [2024-11-29 09:28:49.613097] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4106702 ] 00:05:26.988 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.988 [2024-11-29 09:28:49.675189] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.988 [2024-11-29 09:28:49.789176] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.247 [2024-11-29 09:28:49.851381] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:27.247 [2024-11-29 09:28:49.935103] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:27.247 00:05:27.247 Compression does not support the verify option, aborting. 00:05:27.247 09:28:50 -- common/autotest_common.sh@653 -- # es=161 00:05:27.247 09:28:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:27.247 09:28:50 -- common/autotest_common.sh@662 -- # es=33 00:05:27.247 09:28:50 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:27.247 09:28:50 -- common/autotest_common.sh@670 -- # es=1 00:05:27.247 09:28:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:27.247 00:05:27.247 real 0m0.467s 00:05:27.247 user 0m0.351s 00:05:27.247 sys 0m0.149s 00:05:27.247 09:28:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.247 09:28:50 -- common/autotest_common.sh@10 -- # set +x 00:05:27.247 ************************************ 00:05:27.247 END TEST accel_compress_verify 00:05:27.247 ************************************ 00:05:27.247 09:28:50 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:27.247 09:28:50 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:27.247 09:28:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.247 09:28:50 -- common/autotest_common.sh@10 -- # set +x 00:05:27.247 ************************************ 00:05:27.247 START TEST accel_wrong_workload 00:05:27.247 ************************************ 00:05:27.506 09:28:50 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:27.506 09:28:50 -- common/autotest_common.sh@650 -- # local es=0 00:05:27.506 09:28:50 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:27.506 09:28:50 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:27.506 09:28:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:27.506 09:28:50 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:27.506 09:28:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:27.506 09:28:50 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:27.506 09:28:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:27.506 09:28:50 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.506 09:28:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.506 09:28:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.506 09:28:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.506 09:28:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.506 09:28:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.506 09:28:50 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.506 09:28:50 -- accel/accel.sh@42 -- # jq -r . 00:05:27.506 Unsupported workload type: foobar 00:05:27.506 [2024-11-29 09:28:50.107943] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:27.506 accel_perf options: 00:05:27.506 [-h help message] 00:05:27.506 [-q queue depth per core] 00:05:27.506 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:27.506 [-T number of threads per core 00:05:27.506 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:27.506 [-t time in seconds] 00:05:27.506 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:27.506 [ dif_verify, , dif_generate, dif_generate_copy 00:05:27.506 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:27.506 [-l for compress/decompress workloads, name of uncompressed input file 00:05:27.506 [-S for crc32c workload, use this seed value (default 0) 00:05:27.506 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:27.506 [-f for fill workload, use this BYTE value (default 255) 00:05:27.506 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:27.506 [-y verify result if this switch is on] 00:05:27.506 [-a tasks to allocate per core (default: same value as -q)] 00:05:27.506 Can be used to spread operations across a wider range of memory. 00:05:27.506 09:28:50 -- common/autotest_common.sh@653 -- # es=1 00:05:27.506 09:28:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:27.506 09:28:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:27.506 09:28:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:27.506 00:05:27.506 real 0m0.024s 00:05:27.506 user 0m0.011s 00:05:27.506 sys 0m0.013s 00:05:27.506 09:28:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.506 09:28:50 -- common/autotest_common.sh@10 -- # set +x 00:05:27.506 ************************************ 00:05:27.506 END TEST accel_wrong_workload 00:05:27.506 ************************************ 00:05:27.506 Error: writing output failed: Broken pipe 00:05:27.506 09:28:50 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:27.506 09:28:50 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:27.506 09:28:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.506 09:28:50 -- common/autotest_common.sh@10 -- # set +x 00:05:27.506 ************************************ 00:05:27.506 START TEST accel_negative_buffers 00:05:27.506 ************************************ 00:05:27.506 09:28:50 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:27.506 09:28:50 -- common/autotest_common.sh@650 -- # local es=0 00:05:27.506 09:28:50 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:27.506 09:28:50 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:27.506 09:28:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:27.506 09:28:50 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:27.506 09:28:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:27.506 09:28:50 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:27.506 09:28:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:27.506 09:28:50 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.506 09:28:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.506 09:28:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.506 09:28:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.506 09:28:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.506 09:28:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.506 09:28:50 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.506 09:28:50 -- accel/accel.sh@42 -- # jq -r . 00:05:27.506 -x option must be non-negative. 00:05:27.506 [2024-11-29 09:28:50.156384] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:27.506 accel_perf options: 00:05:27.506 [-h help message] 00:05:27.506 [-q queue depth per core] 00:05:27.506 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:27.506 [-T number of threads per core 00:05:27.506 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:27.506 [-t time in seconds] 00:05:27.506 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:27.506 [ dif_verify, , dif_generate, dif_generate_copy 00:05:27.506 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:27.506 [-l for compress/decompress workloads, name of uncompressed input file 00:05:27.506 [-S for crc32c workload, use this seed value (default 0) 00:05:27.506 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:27.506 [-f for fill workload, use this BYTE value (default 255) 00:05:27.506 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:27.506 [-y verify result if this switch is on] 00:05:27.506 [-a tasks to allocate per core (default: same value as -q)] 00:05:27.506 Can be used to spread operations across a wider range of memory. 00:05:27.506 09:28:50 -- common/autotest_common.sh@653 -- # es=1 00:05:27.506 09:28:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:27.506 09:28:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:27.506 09:28:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:27.506 00:05:27.506 real 0m0.024s 00:05:27.506 user 0m0.012s 00:05:27.506 sys 0m0.013s 00:05:27.506 09:28:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.506 09:28:50 -- common/autotest_common.sh@10 -- # set +x 00:05:27.506 ************************************ 00:05:27.506 END TEST accel_negative_buffers 00:05:27.506 ************************************ 00:05:27.506 Error: writing output failed: Broken pipe 00:05:27.506 09:28:50 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:27.506 09:28:50 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:27.506 09:28:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.506 09:28:50 -- common/autotest_common.sh@10 -- # set +x 00:05:27.506 ************************************ 00:05:27.506 START TEST accel_crc32c 00:05:27.506 ************************************ 00:05:27.506 09:28:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:27.506 09:28:50 -- accel/accel.sh@16 -- # local accel_opc 00:05:27.506 09:28:50 -- accel/accel.sh@17 -- # local accel_module 00:05:27.506 09:28:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:27.506 09:28:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:27.506 09:28:50 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.506 09:28:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.506 09:28:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.506 09:28:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.506 09:28:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.506 09:28:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.506 09:28:50 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.506 09:28:50 -- accel/accel.sh@42 -- # jq -r . 00:05:27.507 [2024-11-29 09:28:50.204798] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:27.507 [2024-11-29 09:28:50.204863] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4106755 ] 00:05:27.507 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.507 [2024-11-29 09:28:50.267246] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.765 [2024-11-29 09:28:50.386658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.136 09:28:51 -- accel/accel.sh@18 -- # out=' 00:05:29.136 SPDK Configuration: 00:05:29.136 Core mask: 0x1 00:05:29.136 00:05:29.136 Accel Perf Configuration: 00:05:29.136 Workload Type: crc32c 00:05:29.136 CRC-32C seed: 32 00:05:29.136 Transfer size: 4096 bytes 00:05:29.136 Vector count 1 00:05:29.136 Module: software 00:05:29.136 Queue depth: 32 00:05:29.136 Allocate depth: 32 00:05:29.136 # threads/core: 1 00:05:29.136 Run time: 1 seconds 00:05:29.136 Verify: Yes 00:05:29.136 00:05:29.136 Running for 1 seconds... 00:05:29.136 00:05:29.136 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:29.136 ------------------------------------------------------------------------------------ 00:05:29.136 0,0 405984/s 1585 MiB/s 0 0 00:05:29.136 ==================================================================================== 00:05:29.136 Total 405984/s 1585 MiB/s 0 0' 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:29.136 09:28:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:29.136 09:28:51 -- accel/accel.sh@12 -- # build_accel_config 00:05:29.136 09:28:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:29.136 09:28:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:29.136 09:28:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:29.136 09:28:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:29.136 09:28:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:29.136 09:28:51 -- accel/accel.sh@41 -- # local IFS=, 00:05:29.136 09:28:51 -- accel/accel.sh@42 -- # jq -r . 00:05:29.136 [2024-11-29 09:28:51.667330] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.136 [2024-11-29 09:28:51.667420] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4107006 ] 00:05:29.136 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.136 [2024-11-29 09:28:51.729576] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.136 [2024-11-29 09:28:51.843215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val= 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val= 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val=0x1 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val= 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val= 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val=crc32c 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val=32 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val= 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val=software 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@23 -- # accel_module=software 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val=32 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val=32 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val=1 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val=Yes 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val= 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:29.136 09:28:51 -- accel/accel.sh@21 -- # val= 00:05:29.136 09:28:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # IFS=: 00:05:29.136 09:28:51 -- accel/accel.sh@20 -- # read -r var val 00:05:30.508 09:28:53 -- accel/accel.sh@21 -- # val= 00:05:30.508 09:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.508 09:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:30.508 09:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:30.508 09:28:53 -- accel/accel.sh@21 -- # val= 00:05:30.508 09:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.508 09:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:30.508 09:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:30.508 09:28:53 -- accel/accel.sh@21 -- # val= 00:05:30.508 09:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.508 09:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:30.508 09:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:30.508 09:28:53 -- accel/accel.sh@21 -- # val= 00:05:30.508 09:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.508 09:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:30.508 09:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:30.508 09:28:53 -- accel/accel.sh@21 -- # val= 00:05:30.508 09:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.508 09:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:30.508 09:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:30.508 09:28:53 -- accel/accel.sh@21 -- # val= 00:05:30.508 09:28:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.508 09:28:53 -- accel/accel.sh@20 -- # IFS=: 00:05:30.508 09:28:53 -- accel/accel.sh@20 -- # read -r var val 00:05:30.508 09:28:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:30.508 09:28:53 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:30.508 09:28:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:30.508 00:05:30.508 real 0m2.929s 00:05:30.508 user 0m2.639s 00:05:30.508 sys 0m0.283s 00:05:30.508 09:28:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:30.508 09:28:53 -- common/autotest_common.sh@10 -- # set +x 00:05:30.508 ************************************ 00:05:30.508 END TEST accel_crc32c 00:05:30.508 ************************************ 00:05:30.508 09:28:53 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:30.508 09:28:53 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:30.508 09:28:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:30.508 09:28:53 -- common/autotest_common.sh@10 -- # set +x 00:05:30.508 ************************************ 00:05:30.508 START TEST accel_crc32c_C2 00:05:30.508 ************************************ 00:05:30.508 09:28:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:30.508 09:28:53 -- accel/accel.sh@16 -- # local accel_opc 00:05:30.508 09:28:53 -- accel/accel.sh@17 -- # local accel_module 00:05:30.508 09:28:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:30.508 09:28:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:30.508 09:28:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:30.508 09:28:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:30.508 09:28:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:30.508 09:28:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:30.508 09:28:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:30.508 09:28:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:30.508 09:28:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:30.508 09:28:53 -- accel/accel.sh@42 -- # jq -r . 00:05:30.508 [2024-11-29 09:28:53.158258] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:30.508 [2024-11-29 09:28:53.158343] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4107183 ] 00:05:30.508 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.508 [2024-11-29 09:28:53.219433] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.508 [2024-11-29 09:28:53.336240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.883 09:28:54 -- accel/accel.sh@18 -- # out=' 00:05:31.883 SPDK Configuration: 00:05:31.883 Core mask: 0x1 00:05:31.883 00:05:31.883 Accel Perf Configuration: 00:05:31.883 Workload Type: crc32c 00:05:31.883 CRC-32C seed: 0 00:05:31.883 Transfer size: 4096 bytes 00:05:31.883 Vector count 2 00:05:31.883 Module: software 00:05:31.883 Queue depth: 32 00:05:31.883 Allocate depth: 32 00:05:31.883 # threads/core: 1 00:05:31.883 Run time: 1 seconds 00:05:31.883 Verify: Yes 00:05:31.883 00:05:31.883 Running for 1 seconds... 00:05:31.883 00:05:31.883 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:31.883 ------------------------------------------------------------------------------------ 00:05:31.883 0,0 313472/s 2449 MiB/s 0 0 00:05:31.883 ==================================================================================== 00:05:31.883 Total 313472/s 1224 MiB/s 0 0' 00:05:31.883 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:31.883 09:28:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:31.883 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:31.883 09:28:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:31.883 09:28:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:31.883 09:28:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:31.883 09:28:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:31.883 09:28:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:31.883 09:28:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:31.883 09:28:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:31.883 09:28:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:31.883 09:28:54 -- accel/accel.sh@42 -- # jq -r . 00:05:31.883 [2024-11-29 09:28:54.633391] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.883 [2024-11-29 09:28:54.633500] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4107329 ] 00:05:31.883 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.883 [2024-11-29 09:28:54.695052] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.140 [2024-11-29 09:28:54.811634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.140 09:28:54 -- accel/accel.sh@21 -- # val= 00:05:32.140 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.140 09:28:54 -- accel/accel.sh@21 -- # val= 00:05:32.140 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.140 09:28:54 -- accel/accel.sh@21 -- # val=0x1 00:05:32.140 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.140 09:28:54 -- accel/accel.sh@21 -- # val= 00:05:32.140 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.140 09:28:54 -- accel/accel.sh@21 -- # val= 00:05:32.140 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.140 09:28:54 -- accel/accel.sh@21 -- # val=crc32c 00:05:32.140 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.140 09:28:54 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.140 09:28:54 -- accel/accel.sh@21 -- # val=0 00:05:32.140 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.140 09:28:54 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:32.140 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.140 09:28:54 -- accel/accel.sh@21 -- # val= 00:05:32.140 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.140 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.140 09:28:54 -- accel/accel.sh@21 -- # val=software 00:05:32.140 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.140 09:28:54 -- accel/accel.sh@23 -- # accel_module=software 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.141 09:28:54 -- accel/accel.sh@21 -- # val=32 00:05:32.141 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.141 09:28:54 -- accel/accel.sh@21 -- # val=32 00:05:32.141 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.141 09:28:54 -- accel/accel.sh@21 -- # val=1 00:05:32.141 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.141 09:28:54 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:32.141 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.141 09:28:54 -- accel/accel.sh@21 -- # val=Yes 00:05:32.141 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.141 09:28:54 -- accel/accel.sh@21 -- # val= 00:05:32.141 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:32.141 09:28:54 -- accel/accel.sh@21 -- # val= 00:05:32.141 09:28:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # IFS=: 00:05:32.141 09:28:54 -- accel/accel.sh@20 -- # read -r var val 00:05:33.513 09:28:56 -- accel/accel.sh@21 -- # val= 00:05:33.513 09:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.514 09:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:33.514 09:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:33.514 09:28:56 -- accel/accel.sh@21 -- # val= 00:05:33.514 09:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.514 09:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:33.514 09:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:33.514 09:28:56 -- accel/accel.sh@21 -- # val= 00:05:33.514 09:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.514 09:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:33.514 09:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:33.514 09:28:56 -- accel/accel.sh@21 -- # val= 00:05:33.514 09:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.514 09:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:33.514 09:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:33.514 09:28:56 -- accel/accel.sh@21 -- # val= 00:05:33.514 09:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.514 09:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:33.514 09:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:33.514 09:28:56 -- accel/accel.sh@21 -- # val= 00:05:33.514 09:28:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.514 09:28:56 -- accel/accel.sh@20 -- # IFS=: 00:05:33.514 09:28:56 -- accel/accel.sh@20 -- # read -r var val 00:05:33.514 09:28:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:33.514 09:28:56 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:33.514 09:28:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:33.514 00:05:33.514 real 0m2.941s 00:05:33.514 user 0m2.652s 00:05:33.514 sys 0m0.281s 00:05:33.514 09:28:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.514 09:28:56 -- common/autotest_common.sh@10 -- # set +x 00:05:33.514 ************************************ 00:05:33.514 END TEST accel_crc32c_C2 00:05:33.514 ************************************ 00:05:33.514 09:28:56 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:33.514 09:28:56 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:33.514 09:28:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.514 09:28:56 -- common/autotest_common.sh@10 -- # set +x 00:05:33.514 ************************************ 00:05:33.514 START TEST accel_copy 00:05:33.514 ************************************ 00:05:33.514 09:28:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:33.514 09:28:56 -- accel/accel.sh@16 -- # local accel_opc 00:05:33.514 09:28:56 -- accel/accel.sh@17 -- # local accel_module 00:05:33.514 09:28:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:33.514 09:28:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:33.514 09:28:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.514 09:28:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.514 09:28:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.514 09:28:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.514 09:28:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.514 09:28:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.514 09:28:56 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.514 09:28:56 -- accel/accel.sh@42 -- # jq -r . 00:05:33.514 [2024-11-29 09:28:56.127993] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.514 [2024-11-29 09:28:56.128072] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4107499 ] 00:05:33.514 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.514 [2024-11-29 09:28:56.190949] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.514 [2024-11-29 09:28:56.305493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.943 09:28:57 -- accel/accel.sh@18 -- # out=' 00:05:34.943 SPDK Configuration: 00:05:34.943 Core mask: 0x1 00:05:34.943 00:05:34.943 Accel Perf Configuration: 00:05:34.943 Workload Type: copy 00:05:34.943 Transfer size: 4096 bytes 00:05:34.943 Vector count 1 00:05:34.943 Module: software 00:05:34.943 Queue depth: 32 00:05:34.943 Allocate depth: 32 00:05:34.943 # threads/core: 1 00:05:34.943 Run time: 1 seconds 00:05:34.943 Verify: Yes 00:05:34.943 00:05:34.943 Running for 1 seconds... 00:05:34.943 00:05:34.943 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:34.943 ------------------------------------------------------------------------------------ 00:05:34.943 0,0 279104/s 1090 MiB/s 0 0 00:05:34.943 ==================================================================================== 00:05:34.943 Total 279104/s 1090 MiB/s 0 0' 00:05:34.943 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:34.943 09:28:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:34.943 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:34.943 09:28:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:34.943 09:28:57 -- accel/accel.sh@12 -- # build_accel_config 00:05:34.943 09:28:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.943 09:28:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.943 09:28:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.943 09:28:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.943 09:28:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.943 09:28:57 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.943 09:28:57 -- accel/accel.sh@42 -- # jq -r . 00:05:34.943 [2024-11-29 09:28:57.587011] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:34.943 [2024-11-29 09:28:57.587088] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4107758 ] 00:05:34.943 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.943 [2024-11-29 09:28:57.648468] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.943 [2024-11-29 09:28:57.764283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val= 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val= 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val=0x1 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val= 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val= 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val=copy 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val= 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val=software 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@23 -- # accel_module=software 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val=32 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val=32 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val=1 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val=Yes 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val= 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:35.201 09:28:57 -- accel/accel.sh@21 -- # val= 00:05:35.201 09:28:57 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # IFS=: 00:05:35.201 09:28:57 -- accel/accel.sh@20 -- # read -r var val 00:05:36.576 09:28:59 -- accel/accel.sh@21 -- # val= 00:05:36.576 09:28:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.576 09:28:59 -- accel/accel.sh@20 -- # IFS=: 00:05:36.576 09:28:59 -- accel/accel.sh@20 -- # read -r var val 00:05:36.576 09:28:59 -- accel/accel.sh@21 -- # val= 00:05:36.576 09:28:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.576 09:28:59 -- accel/accel.sh@20 -- # IFS=: 00:05:36.576 09:28:59 -- accel/accel.sh@20 -- # read -r var val 00:05:36.576 09:28:59 -- accel/accel.sh@21 -- # val= 00:05:36.576 09:28:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.576 09:28:59 -- accel/accel.sh@20 -- # IFS=: 00:05:36.576 09:28:59 -- accel/accel.sh@20 -- # read -r var val 00:05:36.576 09:28:59 -- accel/accel.sh@21 -- # val= 00:05:36.576 09:28:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.576 09:28:59 -- accel/accel.sh@20 -- # IFS=: 00:05:36.576 09:28:59 -- accel/accel.sh@20 -- # read -r var val 00:05:36.576 09:28:59 -- accel/accel.sh@21 -- # val= 00:05:36.576 09:28:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.576 09:28:59 -- accel/accel.sh@20 -- # IFS=: 00:05:36.576 09:28:59 -- accel/accel.sh@20 -- # read -r var val 00:05:36.576 09:28:59 -- accel/accel.sh@21 -- # val= 00:05:36.576 09:28:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.576 09:28:59 -- accel/accel.sh@20 -- # IFS=: 00:05:36.576 09:28:59 -- accel/accel.sh@20 -- # read -r var val 00:05:36.576 09:28:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:36.576 09:28:59 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:36.576 09:28:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:36.576 00:05:36.576 real 0m2.937s 00:05:36.576 user 0m2.634s 00:05:36.576 sys 0m0.294s 00:05:36.576 09:28:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.576 09:28:59 -- common/autotest_common.sh@10 -- # set +x 00:05:36.576 ************************************ 00:05:36.576 END TEST accel_copy 00:05:36.576 ************************************ 00:05:36.576 09:28:59 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:36.576 09:28:59 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:36.576 09:28:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.576 09:28:59 -- common/autotest_common.sh@10 -- # set +x 00:05:36.576 ************************************ 00:05:36.576 START TEST accel_fill 00:05:36.576 ************************************ 00:05:36.576 09:28:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:36.576 09:28:59 -- accel/accel.sh@16 -- # local accel_opc 00:05:36.576 09:28:59 -- accel/accel.sh@17 -- # local accel_module 00:05:36.576 09:28:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:36.576 09:28:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:36.576 09:28:59 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.576 09:28:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.576 09:28:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.576 09:28:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.576 09:28:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.576 09:28:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.576 09:28:59 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.576 09:28:59 -- accel/accel.sh@42 -- # jq -r . 00:05:36.576 [2024-11-29 09:28:59.089718] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.576 [2024-11-29 09:28:59.089801] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4107913 ] 00:05:36.576 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.576 [2024-11-29 09:28:59.155039] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.576 [2024-11-29 09:28:59.273378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.949 09:29:00 -- accel/accel.sh@18 -- # out=' 00:05:37.949 SPDK Configuration: 00:05:37.949 Core mask: 0x1 00:05:37.949 00:05:37.949 Accel Perf Configuration: 00:05:37.949 Workload Type: fill 00:05:37.949 Fill pattern: 0x80 00:05:37.949 Transfer size: 4096 bytes 00:05:37.949 Vector count 1 00:05:37.949 Module: software 00:05:37.949 Queue depth: 64 00:05:37.949 Allocate depth: 64 00:05:37.949 # threads/core: 1 00:05:37.949 Run time: 1 seconds 00:05:37.949 Verify: Yes 00:05:37.949 00:05:37.949 Running for 1 seconds... 00:05:37.949 00:05:37.949 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:37.949 ------------------------------------------------------------------------------------ 00:05:37.949 0,0 404416/s 1579 MiB/s 0 0 00:05:37.949 ==================================================================================== 00:05:37.949 Total 404416/s 1579 MiB/s 0 0' 00:05:37.949 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:37.949 09:29:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:37.949 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:37.949 09:29:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:37.949 09:29:00 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.949 09:29:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.949 09:29:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.949 09:29:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.949 09:29:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.949 09:29:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.949 09:29:00 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.949 09:29:00 -- accel/accel.sh@42 -- # jq -r . 00:05:37.949 [2024-11-29 09:29:00.576270] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:37.949 [2024-11-29 09:29:00.576366] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4108059 ] 00:05:37.949 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.949 [2024-11-29 09:29:00.640824] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.949 [2024-11-29 09:29:00.764317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.207 09:29:00 -- accel/accel.sh@21 -- # val= 00:05:38.207 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.207 09:29:00 -- accel/accel.sh@21 -- # val= 00:05:38.207 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.207 09:29:00 -- accel/accel.sh@21 -- # val=0x1 00:05:38.207 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.207 09:29:00 -- accel/accel.sh@21 -- # val= 00:05:38.207 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.207 09:29:00 -- accel/accel.sh@21 -- # val= 00:05:38.207 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.207 09:29:00 -- accel/accel.sh@21 -- # val=fill 00:05:38.207 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.207 09:29:00 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.207 09:29:00 -- accel/accel.sh@21 -- # val=0x80 00:05:38.207 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.207 09:29:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:38.207 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.207 09:29:00 -- accel/accel.sh@21 -- # val= 00:05:38.207 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.207 09:29:00 -- accel/accel.sh@21 -- # val=software 00:05:38.207 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.207 09:29:00 -- accel/accel.sh@23 -- # accel_module=software 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.207 09:29:00 -- accel/accel.sh@21 -- # val=64 00:05:38.207 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.207 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 09:29:00 -- accel/accel.sh@21 -- # val=64 00:05:38.208 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 09:29:00 -- accel/accel.sh@21 -- # val=1 00:05:38.208 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 09:29:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:38.208 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 09:29:00 -- accel/accel.sh@21 -- # val=Yes 00:05:38.208 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 09:29:00 -- accel/accel.sh@21 -- # val= 00:05:38.208 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 09:29:00 -- accel/accel.sh@21 -- # val= 00:05:38.208 09:29:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 09:29:00 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 09:29:00 -- accel/accel.sh@20 -- # read -r var val 00:05:39.582 09:29:02 -- accel/accel.sh@21 -- # val= 00:05:39.582 09:29:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.582 09:29:02 -- accel/accel.sh@20 -- # IFS=: 00:05:39.582 09:29:02 -- accel/accel.sh@20 -- # read -r var val 00:05:39.582 09:29:02 -- accel/accel.sh@21 -- # val= 00:05:39.582 09:29:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.582 09:29:02 -- accel/accel.sh@20 -- # IFS=: 00:05:39.582 09:29:02 -- accel/accel.sh@20 -- # read -r var val 00:05:39.582 09:29:02 -- accel/accel.sh@21 -- # val= 00:05:39.582 09:29:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.582 09:29:02 -- accel/accel.sh@20 -- # IFS=: 00:05:39.582 09:29:02 -- accel/accel.sh@20 -- # read -r var val 00:05:39.582 09:29:02 -- accel/accel.sh@21 -- # val= 00:05:39.582 09:29:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.582 09:29:02 -- accel/accel.sh@20 -- # IFS=: 00:05:39.582 09:29:02 -- accel/accel.sh@20 -- # read -r var val 00:05:39.582 09:29:02 -- accel/accel.sh@21 -- # val= 00:05:39.582 09:29:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.582 09:29:02 -- accel/accel.sh@20 -- # IFS=: 00:05:39.582 09:29:02 -- accel/accel.sh@20 -- # read -r var val 00:05:39.582 09:29:02 -- accel/accel.sh@21 -- # val= 00:05:39.582 09:29:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.582 09:29:02 -- accel/accel.sh@20 -- # IFS=: 00:05:39.582 09:29:02 -- accel/accel.sh@20 -- # read -r var val 00:05:39.582 09:29:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:39.582 09:29:02 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:39.582 09:29:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:39.582 00:05:39.582 real 0m2.964s 00:05:39.582 user 0m2.660s 00:05:39.582 sys 0m0.295s 00:05:39.582 09:29:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.582 09:29:02 -- common/autotest_common.sh@10 -- # set +x 00:05:39.582 ************************************ 00:05:39.582 END TEST accel_fill 00:05:39.582 ************************************ 00:05:39.582 09:29:02 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:39.582 09:29:02 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:39.582 09:29:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.582 09:29:02 -- common/autotest_common.sh@10 -- # set +x 00:05:39.582 ************************************ 00:05:39.582 START TEST accel_copy_crc32c 00:05:39.582 ************************************ 00:05:39.582 09:29:02 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:39.582 09:29:02 -- accel/accel.sh@16 -- # local accel_opc 00:05:39.582 09:29:02 -- accel/accel.sh@17 -- # local accel_module 00:05:39.582 09:29:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:39.582 09:29:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:39.582 09:29:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.582 09:29:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.582 09:29:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.582 09:29:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.582 09:29:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.582 09:29:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.582 09:29:02 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.582 09:29:02 -- accel/accel.sh@42 -- # jq -r . 00:05:39.582 [2024-11-29 09:29:02.080498] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.582 [2024-11-29 09:29:02.080584] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4108341 ] 00:05:39.582 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.582 [2024-11-29 09:29:02.143160] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.582 [2024-11-29 09:29:02.263851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.955 09:29:03 -- accel/accel.sh@18 -- # out=' 00:05:40.955 SPDK Configuration: 00:05:40.955 Core mask: 0x1 00:05:40.955 00:05:40.955 Accel Perf Configuration: 00:05:40.955 Workload Type: copy_crc32c 00:05:40.955 CRC-32C seed: 0 00:05:40.955 Vector size: 4096 bytes 00:05:40.955 Transfer size: 4096 bytes 00:05:40.955 Vector count 1 00:05:40.955 Module: software 00:05:40.955 Queue depth: 32 00:05:40.955 Allocate depth: 32 00:05:40.955 # threads/core: 1 00:05:40.955 Run time: 1 seconds 00:05:40.955 Verify: Yes 00:05:40.955 00:05:40.955 Running for 1 seconds... 00:05:40.955 00:05:40.955 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:40.955 ------------------------------------------------------------------------------------ 00:05:40.955 0,0 218688/s 854 MiB/s 0 0 00:05:40.956 ==================================================================================== 00:05:40.956 Total 218688/s 854 MiB/s 0 0' 00:05:40.956 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:40.956 09:29:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:40.956 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:40.956 09:29:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:40.956 09:29:03 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.956 09:29:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.956 09:29:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.956 09:29:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.956 09:29:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.956 09:29:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.956 09:29:03 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.956 09:29:03 -- accel/accel.sh@42 -- # jq -r . 00:05:40.956 [2024-11-29 09:29:03.567730] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.956 [2024-11-29 09:29:03.567818] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4108482 ] 00:05:40.956 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.956 [2024-11-29 09:29:03.629973] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.956 [2024-11-29 09:29:03.749999] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val= 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val= 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val=0x1 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val= 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val= 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val=0 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val= 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val=software 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@23 -- # accel_module=software 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val=32 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val=32 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val=1 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val=Yes 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val= 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:41.214 09:29:03 -- accel/accel.sh@21 -- # val= 00:05:41.214 09:29:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # IFS=: 00:05:41.214 09:29:03 -- accel/accel.sh@20 -- # read -r var val 00:05:42.586 09:29:05 -- accel/accel.sh@21 -- # val= 00:05:42.586 09:29:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.587 09:29:05 -- accel/accel.sh@20 -- # IFS=: 00:05:42.587 09:29:05 -- accel/accel.sh@20 -- # read -r var val 00:05:42.587 09:29:05 -- accel/accel.sh@21 -- # val= 00:05:42.587 09:29:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.587 09:29:05 -- accel/accel.sh@20 -- # IFS=: 00:05:42.587 09:29:05 -- accel/accel.sh@20 -- # read -r var val 00:05:42.587 09:29:05 -- accel/accel.sh@21 -- # val= 00:05:42.587 09:29:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.587 09:29:05 -- accel/accel.sh@20 -- # IFS=: 00:05:42.587 09:29:05 -- accel/accel.sh@20 -- # read -r var val 00:05:42.587 09:29:05 -- accel/accel.sh@21 -- # val= 00:05:42.587 09:29:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.587 09:29:05 -- accel/accel.sh@20 -- # IFS=: 00:05:42.587 09:29:05 -- accel/accel.sh@20 -- # read -r var val 00:05:42.587 09:29:05 -- accel/accel.sh@21 -- # val= 00:05:42.587 09:29:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.587 09:29:05 -- accel/accel.sh@20 -- # IFS=: 00:05:42.587 09:29:05 -- accel/accel.sh@20 -- # read -r var val 00:05:42.587 09:29:05 -- accel/accel.sh@21 -- # val= 00:05:42.587 09:29:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.587 09:29:05 -- accel/accel.sh@20 -- # IFS=: 00:05:42.587 09:29:05 -- accel/accel.sh@20 -- # read -r var val 00:05:42.587 09:29:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:42.587 09:29:05 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:42.587 09:29:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:42.587 00:05:42.587 real 0m2.974s 00:05:42.587 user 0m2.677s 00:05:42.587 sys 0m0.289s 00:05:42.587 09:29:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.587 09:29:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.587 ************************************ 00:05:42.587 END TEST accel_copy_crc32c 00:05:42.587 ************************************ 00:05:42.587 09:29:05 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:42.587 09:29:05 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:42.587 09:29:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.587 09:29:05 -- common/autotest_common.sh@10 -- # set +x 00:05:42.587 ************************************ 00:05:42.587 START TEST accel_copy_crc32c_C2 00:05:42.587 ************************************ 00:05:42.587 09:29:05 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:42.587 09:29:05 -- accel/accel.sh@16 -- # local accel_opc 00:05:42.587 09:29:05 -- accel/accel.sh@17 -- # local accel_module 00:05:42.587 09:29:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:42.587 09:29:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:42.587 09:29:05 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.587 09:29:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.587 09:29:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.587 09:29:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.587 09:29:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.587 09:29:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.587 09:29:05 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.587 09:29:05 -- accel/accel.sh@42 -- # jq -r . 00:05:42.587 [2024-11-29 09:29:05.086220] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.587 [2024-11-29 09:29:05.086309] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4108640 ] 00:05:42.587 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.587 [2024-11-29 09:29:05.153480] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.587 [2024-11-29 09:29:05.272102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.960 09:29:06 -- accel/accel.sh@18 -- # out=' 00:05:43.960 SPDK Configuration: 00:05:43.960 Core mask: 0x1 00:05:43.960 00:05:43.960 Accel Perf Configuration: 00:05:43.960 Workload Type: copy_crc32c 00:05:43.960 CRC-32C seed: 0 00:05:43.960 Vector size: 4096 bytes 00:05:43.960 Transfer size: 8192 bytes 00:05:43.960 Vector count 2 00:05:43.960 Module: software 00:05:43.960 Queue depth: 32 00:05:43.960 Allocate depth: 32 00:05:43.960 # threads/core: 1 00:05:43.960 Run time: 1 seconds 00:05:43.960 Verify: Yes 00:05:43.960 00:05:43.960 Running for 1 seconds... 00:05:43.960 00:05:43.960 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:43.960 ------------------------------------------------------------------------------------ 00:05:43.960 0,0 154592/s 1207 MiB/s 0 0 00:05:43.960 ==================================================================================== 00:05:43.960 Total 154592/s 603 MiB/s 0 0' 00:05:43.960 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:43.960 09:29:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:43.960 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:43.960 09:29:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:43.960 09:29:06 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.960 09:29:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.960 09:29:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.960 09:29:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.960 09:29:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.960 09:29:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.960 09:29:06 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.960 09:29:06 -- accel/accel.sh@42 -- # jq -r . 00:05:43.960 [2024-11-29 09:29:06.558420] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:43.960 [2024-11-29 09:29:06.558513] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4108906 ] 00:05:43.960 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.960 [2024-11-29 09:29:06.622052] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.960 [2024-11-29 09:29:06.741484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val= 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val= 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val=0x1 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val= 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val= 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val=0 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val= 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val=software 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@23 -- # accel_module=software 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val=32 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val=32 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val=1 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val=Yes 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val= 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:44.218 09:29:06 -- accel/accel.sh@21 -- # val= 00:05:44.218 09:29:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # IFS=: 00:05:44.218 09:29:06 -- accel/accel.sh@20 -- # read -r var val 00:05:45.592 09:29:08 -- accel/accel.sh@21 -- # val= 00:05:45.592 09:29:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.592 09:29:08 -- accel/accel.sh@20 -- # IFS=: 00:05:45.592 09:29:08 -- accel/accel.sh@20 -- # read -r var val 00:05:45.592 09:29:08 -- accel/accel.sh@21 -- # val= 00:05:45.592 09:29:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.592 09:29:08 -- accel/accel.sh@20 -- # IFS=: 00:05:45.592 09:29:08 -- accel/accel.sh@20 -- # read -r var val 00:05:45.592 09:29:08 -- accel/accel.sh@21 -- # val= 00:05:45.592 09:29:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.592 09:29:08 -- accel/accel.sh@20 -- # IFS=: 00:05:45.592 09:29:08 -- accel/accel.sh@20 -- # read -r var val 00:05:45.592 09:29:08 -- accel/accel.sh@21 -- # val= 00:05:45.592 09:29:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.592 09:29:08 -- accel/accel.sh@20 -- # IFS=: 00:05:45.592 09:29:08 -- accel/accel.sh@20 -- # read -r var val 00:05:45.592 09:29:08 -- accel/accel.sh@21 -- # val= 00:05:45.592 09:29:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.592 09:29:08 -- accel/accel.sh@20 -- # IFS=: 00:05:45.592 09:29:08 -- accel/accel.sh@20 -- # read -r var val 00:05:45.592 09:29:08 -- accel/accel.sh@21 -- # val= 00:05:45.592 09:29:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.592 09:29:08 -- accel/accel.sh@20 -- # IFS=: 00:05:45.592 09:29:08 -- accel/accel.sh@20 -- # read -r var val 00:05:45.592 09:29:08 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:45.592 09:29:08 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:45.592 09:29:08 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:45.592 00:05:45.592 real 0m2.962s 00:05:45.592 user 0m2.660s 00:05:45.592 sys 0m0.293s 00:05:45.592 09:29:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.592 09:29:08 -- common/autotest_common.sh@10 -- # set +x 00:05:45.592 ************************************ 00:05:45.592 END TEST accel_copy_crc32c_C2 00:05:45.592 ************************************ 00:05:45.592 09:29:08 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:45.592 09:29:08 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:45.592 09:29:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.592 09:29:08 -- common/autotest_common.sh@10 -- # set +x 00:05:45.592 ************************************ 00:05:45.592 START TEST accel_dualcast 00:05:45.592 ************************************ 00:05:45.592 09:29:08 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:45.592 09:29:08 -- accel/accel.sh@16 -- # local accel_opc 00:05:45.592 09:29:08 -- accel/accel.sh@17 -- # local accel_module 00:05:45.592 09:29:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:45.592 09:29:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:45.592 09:29:08 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.592 09:29:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.592 09:29:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.592 09:29:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.592 09:29:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.592 09:29:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.592 09:29:08 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.592 09:29:08 -- accel/accel.sh@42 -- # jq -r . 00:05:45.592 [2024-11-29 09:29:08.076200] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.592 [2024-11-29 09:29:08.076292] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4109068 ] 00:05:45.592 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.592 [2024-11-29 09:29:08.140124] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.592 [2024-11-29 09:29:08.258205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:46.966 09:29:09 -- accel/accel.sh@18 -- # out=' 00:05:46.966 SPDK Configuration: 00:05:46.966 Core mask: 0x1 00:05:46.966 00:05:46.966 Accel Perf Configuration: 00:05:46.966 Workload Type: dualcast 00:05:46.966 Transfer size: 4096 bytes 00:05:46.966 Vector count 1 00:05:46.966 Module: software 00:05:46.966 Queue depth: 32 00:05:46.966 Allocate depth: 32 00:05:46.966 # threads/core: 1 00:05:46.966 Run time: 1 seconds 00:05:46.966 Verify: Yes 00:05:46.966 00:05:46.966 Running for 1 seconds... 00:05:46.966 00:05:46.966 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:46.966 ------------------------------------------------------------------------------------ 00:05:46.966 0,0 298240/s 1165 MiB/s 0 0 00:05:46.966 ==================================================================================== 00:05:46.966 Total 298240/s 1165 MiB/s 0 0' 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:46.966 09:29:09 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.966 09:29:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.966 09:29:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.966 09:29:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.966 09:29:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.966 09:29:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.966 09:29:09 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.966 09:29:09 -- accel/accel.sh@42 -- # jq -r . 00:05:46.966 [2024-11-29 09:29:09.562810] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:46.966 [2024-11-29 09:29:09.562897] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4109206 ] 00:05:46.966 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.966 [2024-11-29 09:29:09.624175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.966 [2024-11-29 09:29:09.742338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val= 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val= 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val=0x1 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val= 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val= 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val=dualcast 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val= 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val=software 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@23 -- # accel_module=software 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val=32 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val=32 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val=1 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val=Yes 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val= 00:05:46.966 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:46.966 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:46.966 09:29:09 -- accel/accel.sh@21 -- # val= 00:05:47.225 09:29:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.225 09:29:09 -- accel/accel.sh@20 -- # IFS=: 00:05:47.225 09:29:09 -- accel/accel.sh@20 -- # read -r var val 00:05:48.595 09:29:11 -- accel/accel.sh@21 -- # val= 00:05:48.595 09:29:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.595 09:29:11 -- accel/accel.sh@20 -- # IFS=: 00:05:48.595 09:29:11 -- accel/accel.sh@20 -- # read -r var val 00:05:48.595 09:29:11 -- accel/accel.sh@21 -- # val= 00:05:48.595 09:29:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.595 09:29:11 -- accel/accel.sh@20 -- # IFS=: 00:05:48.595 09:29:11 -- accel/accel.sh@20 -- # read -r var val 00:05:48.595 09:29:11 -- accel/accel.sh@21 -- # val= 00:05:48.595 09:29:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.595 09:29:11 -- accel/accel.sh@20 -- # IFS=: 00:05:48.595 09:29:11 -- accel/accel.sh@20 -- # read -r var val 00:05:48.595 09:29:11 -- accel/accel.sh@21 -- # val= 00:05:48.595 09:29:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.595 09:29:11 -- accel/accel.sh@20 -- # IFS=: 00:05:48.595 09:29:11 -- accel/accel.sh@20 -- # read -r var val 00:05:48.595 09:29:11 -- accel/accel.sh@21 -- # val= 00:05:48.595 09:29:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.595 09:29:11 -- accel/accel.sh@20 -- # IFS=: 00:05:48.595 09:29:11 -- accel/accel.sh@20 -- # read -r var val 00:05:48.595 09:29:11 -- accel/accel.sh@21 -- # val= 00:05:48.595 09:29:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.595 09:29:11 -- accel/accel.sh@20 -- # IFS=: 00:05:48.595 09:29:11 -- accel/accel.sh@20 -- # read -r var val 00:05:48.595 09:29:11 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:48.595 09:29:11 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:48.595 09:29:11 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:48.595 00:05:48.595 real 0m2.957s 00:05:48.595 user 0m2.664s 00:05:48.595 sys 0m0.283s 00:05:48.595 09:29:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:48.595 09:29:11 -- common/autotest_common.sh@10 -- # set +x 00:05:48.595 ************************************ 00:05:48.595 END TEST accel_dualcast 00:05:48.595 ************************************ 00:05:48.595 09:29:11 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:48.595 09:29:11 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:48.595 09:29:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.595 09:29:11 -- common/autotest_common.sh@10 -- # set +x 00:05:48.595 ************************************ 00:05:48.595 START TEST accel_compare 00:05:48.595 ************************************ 00:05:48.595 09:29:11 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:48.595 09:29:11 -- accel/accel.sh@16 -- # local accel_opc 00:05:48.595 09:29:11 -- accel/accel.sh@17 -- # local accel_module 00:05:48.595 09:29:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:48.595 09:29:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:48.595 09:29:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.595 09:29:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.595 09:29:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.595 09:29:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.595 09:29:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.595 09:29:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.595 09:29:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.595 09:29:11 -- accel/accel.sh@42 -- # jq -r . 00:05:48.595 [2024-11-29 09:29:11.056270] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.595 [2024-11-29 09:29:11.056356] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4109494 ] 00:05:48.595 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.595 [2024-11-29 09:29:11.117508] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.595 [2024-11-29 09:29:11.238097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.962 09:29:12 -- accel/accel.sh@18 -- # out=' 00:05:49.962 SPDK Configuration: 00:05:49.962 Core mask: 0x1 00:05:49.962 00:05:49.962 Accel Perf Configuration: 00:05:49.962 Workload Type: compare 00:05:49.962 Transfer size: 4096 bytes 00:05:49.962 Vector count 1 00:05:49.962 Module: software 00:05:49.962 Queue depth: 32 00:05:49.962 Allocate depth: 32 00:05:49.962 # threads/core: 1 00:05:49.962 Run time: 1 seconds 00:05:49.962 Verify: Yes 00:05:49.962 00:05:49.962 Running for 1 seconds... 00:05:49.962 00:05:49.962 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:49.962 ------------------------------------------------------------------------------------ 00:05:49.962 0,0 397568/s 1553 MiB/s 0 0 00:05:49.962 ==================================================================================== 00:05:49.962 Total 397568/s 1553 MiB/s 0 0' 00:05:49.962 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.962 09:29:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:49.962 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.962 09:29:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:49.962 09:29:12 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.962 09:29:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.962 09:29:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.962 09:29:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.962 09:29:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.962 09:29:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.962 09:29:12 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.962 09:29:12 -- accel/accel.sh@42 -- # jq -r . 00:05:49.962 [2024-11-29 09:29:12.539787] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:49.962 [2024-11-29 09:29:12.539873] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4109634 ] 00:05:49.962 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.962 [2024-11-29 09:29:12.602180] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.962 [2024-11-29 09:29:12.721505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.962 09:29:12 -- accel/accel.sh@21 -- # val= 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val= 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val=0x1 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val= 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val= 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val=compare 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val= 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val=software 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@23 -- # accel_module=software 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val=32 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val=32 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val=1 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val=Yes 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val= 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:49.963 09:29:12 -- accel/accel.sh@21 -- # val= 00:05:49.963 09:29:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # IFS=: 00:05:49.963 09:29:12 -- accel/accel.sh@20 -- # read -r var val 00:05:51.337 09:29:14 -- accel/accel.sh@21 -- # val= 00:05:51.337 09:29:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.337 09:29:14 -- accel/accel.sh@20 -- # IFS=: 00:05:51.337 09:29:14 -- accel/accel.sh@20 -- # read -r var val 00:05:51.337 09:29:14 -- accel/accel.sh@21 -- # val= 00:05:51.337 09:29:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.337 09:29:14 -- accel/accel.sh@20 -- # IFS=: 00:05:51.337 09:29:14 -- accel/accel.sh@20 -- # read -r var val 00:05:51.337 09:29:14 -- accel/accel.sh@21 -- # val= 00:05:51.337 09:29:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.337 09:29:14 -- accel/accel.sh@20 -- # IFS=: 00:05:51.337 09:29:14 -- accel/accel.sh@20 -- # read -r var val 00:05:51.337 09:29:14 -- accel/accel.sh@21 -- # val= 00:05:51.337 09:29:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.337 09:29:14 -- accel/accel.sh@20 -- # IFS=: 00:05:51.337 09:29:14 -- accel/accel.sh@20 -- # read -r var val 00:05:51.337 09:29:14 -- accel/accel.sh@21 -- # val= 00:05:51.337 09:29:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.337 09:29:14 -- accel/accel.sh@20 -- # IFS=: 00:05:51.337 09:29:14 -- accel/accel.sh@20 -- # read -r var val 00:05:51.337 09:29:14 -- accel/accel.sh@21 -- # val= 00:05:51.337 09:29:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.337 09:29:14 -- accel/accel.sh@20 -- # IFS=: 00:05:51.337 09:29:14 -- accel/accel.sh@20 -- # read -r var val 00:05:51.337 09:29:14 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:51.337 09:29:14 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:51.337 09:29:14 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:51.337 00:05:51.337 real 0m2.969s 00:05:51.337 user 0m2.677s 00:05:51.337 sys 0m0.284s 00:05:51.337 09:29:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:51.337 09:29:14 -- common/autotest_common.sh@10 -- # set +x 00:05:51.337 ************************************ 00:05:51.337 END TEST accel_compare 00:05:51.337 ************************************ 00:05:51.337 09:29:14 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:51.337 09:29:14 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:51.337 09:29:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:51.337 09:29:14 -- common/autotest_common.sh@10 -- # set +x 00:05:51.337 ************************************ 00:05:51.337 START TEST accel_xor 00:05:51.337 ************************************ 00:05:51.337 09:29:14 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:51.337 09:29:14 -- accel/accel.sh@16 -- # local accel_opc 00:05:51.337 09:29:14 -- accel/accel.sh@17 -- # local accel_module 00:05:51.337 09:29:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:51.337 09:29:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:51.337 09:29:14 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.337 09:29:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.337 09:29:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.337 09:29:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.337 09:29:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.337 09:29:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.337 09:29:14 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.337 09:29:14 -- accel/accel.sh@42 -- # jq -r . 00:05:51.337 [2024-11-29 09:29:14.056507] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:51.337 [2024-11-29 09:29:14.056607] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4109795 ] 00:05:51.337 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.337 [2024-11-29 09:29:14.120117] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.595 [2024-11-29 09:29:14.239227] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.966 09:29:15 -- accel/accel.sh@18 -- # out=' 00:05:52.966 SPDK Configuration: 00:05:52.966 Core mask: 0x1 00:05:52.966 00:05:52.966 Accel Perf Configuration: 00:05:52.966 Workload Type: xor 00:05:52.966 Source buffers: 2 00:05:52.966 Transfer size: 4096 bytes 00:05:52.966 Vector count 1 00:05:52.966 Module: software 00:05:52.966 Queue depth: 32 00:05:52.966 Allocate depth: 32 00:05:52.966 # threads/core: 1 00:05:52.966 Run time: 1 seconds 00:05:52.966 Verify: Yes 00:05:52.966 00:05:52.966 Running for 1 seconds... 00:05:52.966 00:05:52.966 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:52.966 ------------------------------------------------------------------------------------ 00:05:52.966 0,0 190144/s 742 MiB/s 0 0 00:05:52.966 ==================================================================================== 00:05:52.966 Total 190144/s 742 MiB/s 0 0' 00:05:52.966 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.966 09:29:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:52.966 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.966 09:29:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:52.966 09:29:15 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.966 09:29:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.966 09:29:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.966 09:29:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.966 09:29:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.966 09:29:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.966 09:29:15 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.966 09:29:15 -- accel/accel.sh@42 -- # jq -r . 00:05:52.966 [2024-11-29 09:29:15.530186] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.966 [2024-11-29 09:29:15.530271] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4110054 ] 00:05:52.966 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.966 [2024-11-29 09:29:15.597105] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.966 [2024-11-29 09:29:15.716699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.966 09:29:15 -- accel/accel.sh@21 -- # val= 00:05:52.966 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.966 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.966 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.966 09:29:15 -- accel/accel.sh@21 -- # val= 00:05:52.966 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.966 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.966 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.966 09:29:15 -- accel/accel.sh@21 -- # val=0x1 00:05:52.966 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.966 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.966 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.966 09:29:15 -- accel/accel.sh@21 -- # val= 00:05:52.966 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.966 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.966 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.967 09:29:15 -- accel/accel.sh@21 -- # val= 00:05:52.967 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.967 09:29:15 -- accel/accel.sh@21 -- # val=xor 00:05:52.967 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.967 09:29:15 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.967 09:29:15 -- accel/accel.sh@21 -- # val=2 00:05:52.967 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.967 09:29:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:52.967 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.967 09:29:15 -- accel/accel.sh@21 -- # val= 00:05:52.967 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.967 09:29:15 -- accel/accel.sh@21 -- # val=software 00:05:52.967 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.967 09:29:15 -- accel/accel.sh@23 -- # accel_module=software 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.967 09:29:15 -- accel/accel.sh@21 -- # val=32 00:05:52.967 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.967 09:29:15 -- accel/accel.sh@21 -- # val=32 00:05:52.967 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.967 09:29:15 -- accel/accel.sh@21 -- # val=1 00:05:52.967 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.967 09:29:15 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:52.967 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.967 09:29:15 -- accel/accel.sh@21 -- # val=Yes 00:05:52.967 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.967 09:29:15 -- accel/accel.sh@21 -- # val= 00:05:52.967 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:52.967 09:29:15 -- accel/accel.sh@21 -- # val= 00:05:52.967 09:29:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # IFS=: 00:05:52.967 09:29:15 -- accel/accel.sh@20 -- # read -r var val 00:05:54.340 09:29:16 -- accel/accel.sh@21 -- # val= 00:05:54.340 09:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.340 09:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:54.340 09:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:54.340 09:29:16 -- accel/accel.sh@21 -- # val= 00:05:54.340 09:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.340 09:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:54.340 09:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:54.340 09:29:16 -- accel/accel.sh@21 -- # val= 00:05:54.340 09:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.340 09:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:54.340 09:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:54.340 09:29:16 -- accel/accel.sh@21 -- # val= 00:05:54.340 09:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.340 09:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:54.340 09:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:54.340 09:29:16 -- accel/accel.sh@21 -- # val= 00:05:54.340 09:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.340 09:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:54.340 09:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:54.340 09:29:16 -- accel/accel.sh@21 -- # val= 00:05:54.340 09:29:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.340 09:29:16 -- accel/accel.sh@20 -- # IFS=: 00:05:54.340 09:29:16 -- accel/accel.sh@20 -- # read -r var val 00:05:54.340 09:29:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:54.340 09:29:16 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:54.340 09:29:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:54.340 00:05:54.340 real 0m2.951s 00:05:54.340 user 0m2.661s 00:05:54.340 sys 0m0.281s 00:05:54.340 09:29:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:54.340 09:29:16 -- common/autotest_common.sh@10 -- # set +x 00:05:54.340 ************************************ 00:05:54.340 END TEST accel_xor 00:05:54.340 ************************************ 00:05:54.340 09:29:17 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:54.340 09:29:17 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:54.340 09:29:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.340 09:29:17 -- common/autotest_common.sh@10 -- # set +x 00:05:54.340 ************************************ 00:05:54.340 START TEST accel_xor 00:05:54.340 ************************************ 00:05:54.340 09:29:17 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:05:54.340 09:29:17 -- accel/accel.sh@16 -- # local accel_opc 00:05:54.340 09:29:17 -- accel/accel.sh@17 -- # local accel_module 00:05:54.340 09:29:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:54.340 09:29:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:54.340 09:29:17 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.340 09:29:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.340 09:29:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.340 09:29:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.340 09:29:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.340 09:29:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.340 09:29:17 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.340 09:29:17 -- accel/accel.sh@42 -- # jq -r . 00:05:54.340 [2024-11-29 09:29:17.033162] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.340 [2024-11-29 09:29:17.033245] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4110223 ] 00:05:54.340 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.340 [2024-11-29 09:29:17.094700] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.598 [2024-11-29 09:29:17.215913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.971 09:29:18 -- accel/accel.sh@18 -- # out=' 00:05:55.971 SPDK Configuration: 00:05:55.971 Core mask: 0x1 00:05:55.971 00:05:55.971 Accel Perf Configuration: 00:05:55.971 Workload Type: xor 00:05:55.971 Source buffers: 3 00:05:55.971 Transfer size: 4096 bytes 00:05:55.971 Vector count 1 00:05:55.971 Module: software 00:05:55.971 Queue depth: 32 00:05:55.971 Allocate depth: 32 00:05:55.971 # threads/core: 1 00:05:55.971 Run time: 1 seconds 00:05:55.971 Verify: Yes 00:05:55.971 00:05:55.971 Running for 1 seconds... 00:05:55.971 00:05:55.971 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:55.971 ------------------------------------------------------------------------------------ 00:05:55.971 0,0 182592/s 713 MiB/s 0 0 00:05:55.971 ==================================================================================== 00:05:55.971 Total 182592/s 713 MiB/s 0 0' 00:05:55.971 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.971 09:29:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:55.972 09:29:18 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.972 09:29:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.972 09:29:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.972 09:29:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.972 09:29:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.972 09:29:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.972 09:29:18 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.972 09:29:18 -- accel/accel.sh@42 -- # jq -r . 00:05:55.972 [2024-11-29 09:29:18.519915] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:55.972 [2024-11-29 09:29:18.520000] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4110361 ] 00:05:55.972 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.972 [2024-11-29 09:29:18.581493] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.972 [2024-11-29 09:29:18.702897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val= 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val= 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val=0x1 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val= 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val= 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val=xor 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val=3 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val= 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val=software 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@23 -- # accel_module=software 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val=32 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val=32 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val=1 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val=Yes 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val= 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:55.972 09:29:18 -- accel/accel.sh@21 -- # val= 00:05:55.972 09:29:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # IFS=: 00:05:55.972 09:29:18 -- accel/accel.sh@20 -- # read -r var val 00:05:57.344 09:29:19 -- accel/accel.sh@21 -- # val= 00:05:57.344 09:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.344 09:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:57.344 09:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:57.344 09:29:19 -- accel/accel.sh@21 -- # val= 00:05:57.344 09:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.344 09:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:57.344 09:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:57.344 09:29:19 -- accel/accel.sh@21 -- # val= 00:05:57.344 09:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.344 09:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:57.344 09:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:57.344 09:29:19 -- accel/accel.sh@21 -- # val= 00:05:57.344 09:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.344 09:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:57.344 09:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:57.344 09:29:19 -- accel/accel.sh@21 -- # val= 00:05:57.344 09:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.344 09:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:57.344 09:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:57.344 09:29:19 -- accel/accel.sh@21 -- # val= 00:05:57.344 09:29:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.345 09:29:19 -- accel/accel.sh@20 -- # IFS=: 00:05:57.345 09:29:19 -- accel/accel.sh@20 -- # read -r var val 00:05:57.345 09:29:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:57.345 09:29:19 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:57.345 09:29:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:57.345 00:05:57.345 real 0m2.969s 00:05:57.345 user 0m2.673s 00:05:57.345 sys 0m0.287s 00:05:57.345 09:29:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:57.345 09:29:19 -- common/autotest_common.sh@10 -- # set +x 00:05:57.345 ************************************ 00:05:57.345 END TEST accel_xor 00:05:57.345 ************************************ 00:05:57.345 09:29:20 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:57.345 09:29:20 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:57.345 09:29:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.345 09:29:20 -- common/autotest_common.sh@10 -- # set +x 00:05:57.345 ************************************ 00:05:57.345 START TEST accel_dif_verify 00:05:57.345 ************************************ 00:05:57.345 09:29:20 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:05:57.345 09:29:20 -- accel/accel.sh@16 -- # local accel_opc 00:05:57.345 09:29:20 -- accel/accel.sh@17 -- # local accel_module 00:05:57.345 09:29:20 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:57.345 09:29:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:57.345 09:29:20 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.345 09:29:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.345 09:29:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.345 09:29:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.345 09:29:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.345 09:29:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.345 09:29:20 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.345 09:29:20 -- accel/accel.sh@42 -- # jq -r . 00:05:57.345 [2024-11-29 09:29:20.023991] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.345 [2024-11-29 09:29:20.024114] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4110641 ] 00:05:57.345 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.345 [2024-11-29 09:29:20.087082] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.603 [2024-11-29 09:29:20.204648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.978 09:29:21 -- accel/accel.sh@18 -- # out=' 00:05:58.978 SPDK Configuration: 00:05:58.978 Core mask: 0x1 00:05:58.978 00:05:58.978 Accel Perf Configuration: 00:05:58.978 Workload Type: dif_verify 00:05:58.978 Vector size: 4096 bytes 00:05:58.978 Transfer size: 4096 bytes 00:05:58.978 Block size: 512 bytes 00:05:58.978 Metadata size: 8 bytes 00:05:58.978 Vector count 1 00:05:58.978 Module: software 00:05:58.978 Queue depth: 32 00:05:58.978 Allocate depth: 32 00:05:58.978 # threads/core: 1 00:05:58.978 Run time: 1 seconds 00:05:58.978 Verify: No 00:05:58.978 00:05:58.978 Running for 1 seconds... 00:05:58.978 00:05:58.978 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:58.978 ------------------------------------------------------------------------------------ 00:05:58.978 0,0 81376/s 322 MiB/s 0 0 00:05:58.978 ==================================================================================== 00:05:58.978 Total 81376/s 317 MiB/s 0 0' 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:58.978 09:29:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.978 09:29:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.978 09:29:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.978 09:29:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.978 09:29:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.978 09:29:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.978 09:29:21 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.978 09:29:21 -- accel/accel.sh@42 -- # jq -r . 00:05:58.978 [2024-11-29 09:29:21.499189] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:58.978 [2024-11-29 09:29:21.499271] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4110788 ] 00:05:58.978 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.978 [2024-11-29 09:29:21.561103] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.978 [2024-11-29 09:29:21.681280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val= 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val= 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val=0x1 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val= 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val= 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val=dif_verify 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val= 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val=software 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@23 -- # accel_module=software 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val=32 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val=32 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val=1 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val=No 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val= 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:05:58.978 09:29:21 -- accel/accel.sh@21 -- # val= 00:05:58.978 09:29:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # IFS=: 00:05:58.978 09:29:21 -- accel/accel.sh@20 -- # read -r var val 00:06:00.352 09:29:22 -- accel/accel.sh@21 -- # val= 00:06:00.352 09:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.352 09:29:22 -- accel/accel.sh@20 -- # IFS=: 00:06:00.352 09:29:22 -- accel/accel.sh@20 -- # read -r var val 00:06:00.352 09:29:22 -- accel/accel.sh@21 -- # val= 00:06:00.352 09:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.352 09:29:22 -- accel/accel.sh@20 -- # IFS=: 00:06:00.352 09:29:22 -- accel/accel.sh@20 -- # read -r var val 00:06:00.352 09:29:22 -- accel/accel.sh@21 -- # val= 00:06:00.352 09:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.352 09:29:22 -- accel/accel.sh@20 -- # IFS=: 00:06:00.352 09:29:22 -- accel/accel.sh@20 -- # read -r var val 00:06:00.352 09:29:22 -- accel/accel.sh@21 -- # val= 00:06:00.352 09:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.352 09:29:22 -- accel/accel.sh@20 -- # IFS=: 00:06:00.352 09:29:22 -- accel/accel.sh@20 -- # read -r var val 00:06:00.352 09:29:22 -- accel/accel.sh@21 -- # val= 00:06:00.352 09:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.352 09:29:22 -- accel/accel.sh@20 -- # IFS=: 00:06:00.352 09:29:22 -- accel/accel.sh@20 -- # read -r var val 00:06:00.352 09:29:22 -- accel/accel.sh@21 -- # val= 00:06:00.352 09:29:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.352 09:29:22 -- accel/accel.sh@20 -- # IFS=: 00:06:00.352 09:29:22 -- accel/accel.sh@20 -- # read -r var val 00:06:00.352 09:29:22 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:00.352 09:29:22 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:00.353 09:29:22 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:00.353 00:06:00.353 real 0m2.961s 00:06:00.353 user 0m2.656s 00:06:00.353 sys 0m0.299s 00:06:00.353 09:29:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.353 09:29:22 -- common/autotest_common.sh@10 -- # set +x 00:06:00.353 ************************************ 00:06:00.353 END TEST accel_dif_verify 00:06:00.353 ************************************ 00:06:00.353 09:29:22 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:00.353 09:29:22 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:00.353 09:29:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.353 09:29:22 -- common/autotest_common.sh@10 -- # set +x 00:06:00.353 ************************************ 00:06:00.353 START TEST accel_dif_generate 00:06:00.353 ************************************ 00:06:00.353 09:29:22 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:06:00.353 09:29:22 -- accel/accel.sh@16 -- # local accel_opc 00:06:00.353 09:29:22 -- accel/accel.sh@17 -- # local accel_module 00:06:00.353 09:29:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:00.353 09:29:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:00.353 09:29:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.353 09:29:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:00.353 09:29:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.353 09:29:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.353 09:29:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:00.353 09:29:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:00.353 09:29:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:00.353 09:29:22 -- accel/accel.sh@42 -- # jq -r . 00:06:00.353 [2024-11-29 09:29:23.012760] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:00.353 [2024-11-29 09:29:23.012843] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4110950 ] 00:06:00.353 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.353 [2024-11-29 09:29:23.078299] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.611 [2024-11-29 09:29:23.200867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.987 09:29:24 -- accel/accel.sh@18 -- # out=' 00:06:01.987 SPDK Configuration: 00:06:01.987 Core mask: 0x1 00:06:01.987 00:06:01.987 Accel Perf Configuration: 00:06:01.987 Workload Type: dif_generate 00:06:01.987 Vector size: 4096 bytes 00:06:01.987 Transfer size: 4096 bytes 00:06:01.987 Block size: 512 bytes 00:06:01.987 Metadata size: 8 bytes 00:06:01.987 Vector count 1 00:06:01.987 Module: software 00:06:01.987 Queue depth: 32 00:06:01.987 Allocate depth: 32 00:06:01.987 # threads/core: 1 00:06:01.987 Run time: 1 seconds 00:06:01.987 Verify: No 00:06:01.987 00:06:01.987 Running for 1 seconds... 00:06:01.987 00:06:01.987 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:01.987 ------------------------------------------------------------------------------------ 00:06:01.987 0,0 96288/s 382 MiB/s 0 0 00:06:01.987 ==================================================================================== 00:06:01.987 Total 96288/s 376 MiB/s 0 0' 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.987 09:29:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.987 09:29:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:01.987 09:29:24 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.987 09:29:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:01.987 09:29:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.987 09:29:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.987 09:29:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:01.987 09:29:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:01.987 09:29:24 -- accel/accel.sh@41 -- # local IFS=, 00:06:01.987 09:29:24 -- accel/accel.sh@42 -- # jq -r . 00:06:01.987 [2024-11-29 09:29:24.502345] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:01.987 [2024-11-29 09:29:24.502451] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4111149 ] 00:06:01.987 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.987 [2024-11-29 09:29:24.565204] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.987 [2024-11-29 09:29:24.685270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.987 09:29:24 -- accel/accel.sh@21 -- # val= 00:06:01.987 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.987 09:29:24 -- accel/accel.sh@21 -- # val= 00:06:01.987 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.987 09:29:24 -- accel/accel.sh@21 -- # val=0x1 00:06:01.987 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.987 09:29:24 -- accel/accel.sh@21 -- # val= 00:06:01.987 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.987 09:29:24 -- accel/accel.sh@21 -- # val= 00:06:01.987 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.987 09:29:24 -- accel/accel.sh@21 -- # val=dif_generate 00:06:01.987 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.987 09:29:24 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.987 09:29:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:01.987 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.987 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.988 09:29:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:01.988 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.988 09:29:24 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:01.988 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.988 09:29:24 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:01.988 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.988 09:29:24 -- accel/accel.sh@21 -- # val= 00:06:01.988 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.988 09:29:24 -- accel/accel.sh@21 -- # val=software 00:06:01.988 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.988 09:29:24 -- accel/accel.sh@23 -- # accel_module=software 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.988 09:29:24 -- accel/accel.sh@21 -- # val=32 00:06:01.988 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.988 09:29:24 -- accel/accel.sh@21 -- # val=32 00:06:01.988 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.988 09:29:24 -- accel/accel.sh@21 -- # val=1 00:06:01.988 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.988 09:29:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:01.988 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.988 09:29:24 -- accel/accel.sh@21 -- # val=No 00:06:01.988 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.988 09:29:24 -- accel/accel.sh@21 -- # val= 00:06:01.988 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:01.988 09:29:24 -- accel/accel.sh@21 -- # val= 00:06:01.988 09:29:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # IFS=: 00:06:01.988 09:29:24 -- accel/accel.sh@20 -- # read -r var val 00:06:03.369 09:29:25 -- accel/accel.sh@21 -- # val= 00:06:03.369 09:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.369 09:29:25 -- accel/accel.sh@20 -- # IFS=: 00:06:03.369 09:29:25 -- accel/accel.sh@20 -- # read -r var val 00:06:03.370 09:29:25 -- accel/accel.sh@21 -- # val= 00:06:03.370 09:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.370 09:29:25 -- accel/accel.sh@20 -- # IFS=: 00:06:03.370 09:29:25 -- accel/accel.sh@20 -- # read -r var val 00:06:03.370 09:29:25 -- accel/accel.sh@21 -- # val= 00:06:03.370 09:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.370 09:29:25 -- accel/accel.sh@20 -- # IFS=: 00:06:03.370 09:29:25 -- accel/accel.sh@20 -- # read -r var val 00:06:03.370 09:29:25 -- accel/accel.sh@21 -- # val= 00:06:03.370 09:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.370 09:29:25 -- accel/accel.sh@20 -- # IFS=: 00:06:03.370 09:29:25 -- accel/accel.sh@20 -- # read -r var val 00:06:03.370 09:29:25 -- accel/accel.sh@21 -- # val= 00:06:03.370 09:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.370 09:29:25 -- accel/accel.sh@20 -- # IFS=: 00:06:03.370 09:29:25 -- accel/accel.sh@20 -- # read -r var val 00:06:03.370 09:29:25 -- accel/accel.sh@21 -- # val= 00:06:03.370 09:29:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.370 09:29:25 -- accel/accel.sh@20 -- # IFS=: 00:06:03.370 09:29:25 -- accel/accel.sh@20 -- # read -r var val 00:06:03.370 09:29:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:03.370 09:29:25 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:03.370 09:29:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:03.370 00:06:03.370 real 0m2.970s 00:06:03.370 user 0m2.682s 00:06:03.370 sys 0m0.282s 00:06:03.370 09:29:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:03.370 09:29:25 -- common/autotest_common.sh@10 -- # set +x 00:06:03.370 ************************************ 00:06:03.370 END TEST accel_dif_generate 00:06:03.370 ************************************ 00:06:03.370 09:29:25 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:03.370 09:29:25 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:03.370 09:29:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.370 09:29:25 -- common/autotest_common.sh@10 -- # set +x 00:06:03.370 ************************************ 00:06:03.370 START TEST accel_dif_generate_copy 00:06:03.370 ************************************ 00:06:03.370 09:29:25 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:06:03.370 09:29:25 -- accel/accel.sh@16 -- # local accel_opc 00:06:03.370 09:29:25 -- accel/accel.sh@17 -- # local accel_module 00:06:03.370 09:29:25 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:03.370 09:29:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:03.370 09:29:25 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.370 09:29:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:03.370 09:29:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.370 09:29:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.370 09:29:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:03.370 09:29:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:03.370 09:29:25 -- accel/accel.sh@41 -- # local IFS=, 00:06:03.370 09:29:25 -- accel/accel.sh@42 -- # jq -r . 00:06:03.370 [2024-11-29 09:29:26.010403] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:03.370 [2024-11-29 09:29:26.010484] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4111372 ] 00:06:03.370 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.370 [2024-11-29 09:29:26.071154] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.370 [2024-11-29 09:29:26.188434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.836 09:29:27 -- accel/accel.sh@18 -- # out=' 00:06:04.836 SPDK Configuration: 00:06:04.836 Core mask: 0x1 00:06:04.836 00:06:04.836 Accel Perf Configuration: 00:06:04.836 Workload Type: dif_generate_copy 00:06:04.836 Vector size: 4096 bytes 00:06:04.836 Transfer size: 4096 bytes 00:06:04.836 Vector count 1 00:06:04.836 Module: software 00:06:04.836 Queue depth: 32 00:06:04.836 Allocate depth: 32 00:06:04.836 # threads/core: 1 00:06:04.836 Run time: 1 seconds 00:06:04.836 Verify: No 00:06:04.836 00:06:04.836 Running for 1 seconds... 00:06:04.836 00:06:04.836 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:04.836 ------------------------------------------------------------------------------------ 00:06:04.836 0,0 76256/s 302 MiB/s 0 0 00:06:04.836 ==================================================================================== 00:06:04.836 Total 76256/s 297 MiB/s 0 0' 00:06:04.836 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:04.836 09:29:27 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:04.836 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:04.836 09:29:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:04.836 09:29:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.836 09:29:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.836 09:29:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.836 09:29:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.836 09:29:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.836 09:29:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.836 09:29:27 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.836 09:29:27 -- accel/accel.sh@42 -- # jq -r . 00:06:04.836 [2024-11-29 09:29:27.482833] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:04.836 [2024-11-29 09:29:27.482921] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4111519 ] 00:06:04.836 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.836 [2024-11-29 09:29:27.545495] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.836 [2024-11-29 09:29:27.665143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.094 09:29:27 -- accel/accel.sh@21 -- # val= 00:06:05.094 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.094 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.094 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.094 09:29:27 -- accel/accel.sh@21 -- # val= 00:06:05.094 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.094 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.094 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.094 09:29:27 -- accel/accel.sh@21 -- # val=0x1 00:06:05.094 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.094 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.094 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.094 09:29:27 -- accel/accel.sh@21 -- # val= 00:06:05.094 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.094 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.094 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.094 09:29:27 -- accel/accel.sh@21 -- # val= 00:06:05.094 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.094 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.094 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.095 09:29:27 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:05.095 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.095 09:29:27 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.095 09:29:27 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:05.095 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.095 09:29:27 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:05.095 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.095 09:29:27 -- accel/accel.sh@21 -- # val= 00:06:05.095 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.095 09:29:27 -- accel/accel.sh@21 -- # val=software 00:06:05.095 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.095 09:29:27 -- accel/accel.sh@23 -- # accel_module=software 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.095 09:29:27 -- accel/accel.sh@21 -- # val=32 00:06:05.095 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.095 09:29:27 -- accel/accel.sh@21 -- # val=32 00:06:05.095 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.095 09:29:27 -- accel/accel.sh@21 -- # val=1 00:06:05.095 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.095 09:29:27 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:05.095 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.095 09:29:27 -- accel/accel.sh@21 -- # val=No 00:06:05.095 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.095 09:29:27 -- accel/accel.sh@21 -- # val= 00:06:05.095 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:05.095 09:29:27 -- accel/accel.sh@21 -- # val= 00:06:05.095 09:29:27 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # IFS=: 00:06:05.095 09:29:27 -- accel/accel.sh@20 -- # read -r var val 00:06:06.468 09:29:28 -- accel/accel.sh@21 -- # val= 00:06:06.468 09:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.468 09:29:28 -- accel/accel.sh@20 -- # IFS=: 00:06:06.468 09:29:28 -- accel/accel.sh@20 -- # read -r var val 00:06:06.468 09:29:28 -- accel/accel.sh@21 -- # val= 00:06:06.468 09:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.468 09:29:28 -- accel/accel.sh@20 -- # IFS=: 00:06:06.468 09:29:28 -- accel/accel.sh@20 -- # read -r var val 00:06:06.468 09:29:28 -- accel/accel.sh@21 -- # val= 00:06:06.468 09:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.468 09:29:28 -- accel/accel.sh@20 -- # IFS=: 00:06:06.468 09:29:28 -- accel/accel.sh@20 -- # read -r var val 00:06:06.468 09:29:28 -- accel/accel.sh@21 -- # val= 00:06:06.468 09:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.469 09:29:28 -- accel/accel.sh@20 -- # IFS=: 00:06:06.469 09:29:28 -- accel/accel.sh@20 -- # read -r var val 00:06:06.469 09:29:28 -- accel/accel.sh@21 -- # val= 00:06:06.469 09:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.469 09:29:28 -- accel/accel.sh@20 -- # IFS=: 00:06:06.469 09:29:28 -- accel/accel.sh@20 -- # read -r var val 00:06:06.469 09:29:28 -- accel/accel.sh@21 -- # val= 00:06:06.469 09:29:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.469 09:29:28 -- accel/accel.sh@20 -- # IFS=: 00:06:06.469 09:29:28 -- accel/accel.sh@20 -- # read -r var val 00:06:06.469 09:29:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:06.469 09:29:28 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:06.469 09:29:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:06.469 00:06:06.469 real 0m2.961s 00:06:06.469 user 0m2.659s 00:06:06.469 sys 0m0.294s 00:06:06.469 09:29:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.469 09:29:28 -- common/autotest_common.sh@10 -- # set +x 00:06:06.469 ************************************ 00:06:06.469 END TEST accel_dif_generate_copy 00:06:06.469 ************************************ 00:06:06.469 09:29:28 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:06.469 09:29:28 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:06.469 09:29:28 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:06.469 09:29:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.469 09:29:28 -- common/autotest_common.sh@10 -- # set +x 00:06:06.469 ************************************ 00:06:06.469 START TEST accel_comp 00:06:06.469 ************************************ 00:06:06.469 09:29:28 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:06.469 09:29:28 -- accel/accel.sh@16 -- # local accel_opc 00:06:06.469 09:29:28 -- accel/accel.sh@17 -- # local accel_module 00:06:06.469 09:29:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:06.469 09:29:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:06.469 09:29:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.469 09:29:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:06.469 09:29:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.469 09:29:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.469 09:29:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:06.469 09:29:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:06.469 09:29:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:06.469 09:29:28 -- accel/accel.sh@42 -- # jq -r . 00:06:06.469 [2024-11-29 09:29:29.001190] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:06.469 [2024-11-29 09:29:29.001275] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4111686 ] 00:06:06.469 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.469 [2024-11-29 09:29:29.063930] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.469 [2024-11-29 09:29:29.184231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.843 09:29:30 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:07.843 00:06:07.843 SPDK Configuration: 00:06:07.843 Core mask: 0x1 00:06:07.843 00:06:07.843 Accel Perf Configuration: 00:06:07.843 Workload Type: compress 00:06:07.843 Transfer size: 4096 bytes 00:06:07.843 Vector count 1 00:06:07.843 Module: software 00:06:07.843 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:07.843 Queue depth: 32 00:06:07.843 Allocate depth: 32 00:06:07.843 # threads/core: 1 00:06:07.843 Run time: 1 seconds 00:06:07.843 Verify: No 00:06:07.843 00:06:07.843 Running for 1 seconds... 00:06:07.843 00:06:07.843 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:07.843 ------------------------------------------------------------------------------------ 00:06:07.843 0,0 31488/s 131 MiB/s 0 0 00:06:07.843 ==================================================================================== 00:06:07.843 Total 31488/s 123 MiB/s 0 0' 00:06:07.843 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:07.843 09:29:30 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:07.843 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:07.843 09:29:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:07.843 09:29:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.843 09:29:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:07.843 09:29:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.843 09:29:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.843 09:29:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:07.843 09:29:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:07.843 09:29:30 -- accel/accel.sh@41 -- # local IFS=, 00:06:07.843 09:29:30 -- accel/accel.sh@42 -- # jq -r . 00:06:07.843 [2024-11-29 09:29:30.492572] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:07.843 [2024-11-29 09:29:30.492657] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4111939 ] 00:06:07.843 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.843 [2024-11-29 09:29:30.555419] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.843 [2024-11-29 09:29:30.674065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val= 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val= 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val= 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val=0x1 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val= 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val= 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val=compress 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val= 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val=software 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@23 -- # accel_module=software 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val=32 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val=32 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val=1 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val=No 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val= 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:08.102 09:29:30 -- accel/accel.sh@21 -- # val= 00:06:08.102 09:29:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # IFS=: 00:06:08.102 09:29:30 -- accel/accel.sh@20 -- # read -r var val 00:06:09.475 09:29:31 -- accel/accel.sh@21 -- # val= 00:06:09.475 09:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.475 09:29:31 -- accel/accel.sh@20 -- # IFS=: 00:06:09.475 09:29:31 -- accel/accel.sh@20 -- # read -r var val 00:06:09.475 09:29:31 -- accel/accel.sh@21 -- # val= 00:06:09.475 09:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.475 09:29:31 -- accel/accel.sh@20 -- # IFS=: 00:06:09.475 09:29:31 -- accel/accel.sh@20 -- # read -r var val 00:06:09.475 09:29:31 -- accel/accel.sh@21 -- # val= 00:06:09.475 09:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.475 09:29:31 -- accel/accel.sh@20 -- # IFS=: 00:06:09.475 09:29:31 -- accel/accel.sh@20 -- # read -r var val 00:06:09.475 09:29:31 -- accel/accel.sh@21 -- # val= 00:06:09.475 09:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.475 09:29:31 -- accel/accel.sh@20 -- # IFS=: 00:06:09.475 09:29:31 -- accel/accel.sh@20 -- # read -r var val 00:06:09.475 09:29:31 -- accel/accel.sh@21 -- # val= 00:06:09.475 09:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.475 09:29:31 -- accel/accel.sh@20 -- # IFS=: 00:06:09.475 09:29:31 -- accel/accel.sh@20 -- # read -r var val 00:06:09.475 09:29:31 -- accel/accel.sh@21 -- # val= 00:06:09.475 09:29:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.475 09:29:31 -- accel/accel.sh@20 -- # IFS=: 00:06:09.475 09:29:31 -- accel/accel.sh@20 -- # read -r var val 00:06:09.475 09:29:31 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:09.475 09:29:31 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:09.475 09:29:31 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:09.475 00:06:09.475 real 0m2.979s 00:06:09.475 user 0m2.669s 00:06:09.475 sys 0m0.302s 00:06:09.475 09:29:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:09.475 09:29:31 -- common/autotest_common.sh@10 -- # set +x 00:06:09.475 ************************************ 00:06:09.475 END TEST accel_comp 00:06:09.475 ************************************ 00:06:09.475 09:29:31 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:09.475 09:29:31 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:09.475 09:29:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.475 09:29:31 -- common/autotest_common.sh@10 -- # set +x 00:06:09.475 ************************************ 00:06:09.475 START TEST accel_decomp 00:06:09.475 ************************************ 00:06:09.475 09:29:31 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:09.475 09:29:31 -- accel/accel.sh@16 -- # local accel_opc 00:06:09.475 09:29:31 -- accel/accel.sh@17 -- # local accel_module 00:06:09.475 09:29:31 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:09.475 09:29:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:09.475 09:29:31 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.475 09:29:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.475 09:29:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.475 09:29:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.475 09:29:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.475 09:29:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.475 09:29:31 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.475 09:29:31 -- accel/accel.sh@42 -- # jq -r . 00:06:09.475 [2024-11-29 09:29:32.004334] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.475 [2024-11-29 09:29:32.004425] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4112107 ] 00:06:09.475 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.475 [2024-11-29 09:29:32.065423] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.475 [2024-11-29 09:29:32.185694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.848 09:29:33 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:10.848 00:06:10.848 SPDK Configuration: 00:06:10.848 Core mask: 0x1 00:06:10.848 00:06:10.848 Accel Perf Configuration: 00:06:10.848 Workload Type: decompress 00:06:10.848 Transfer size: 4096 bytes 00:06:10.848 Vector count 1 00:06:10.848 Module: software 00:06:10.848 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:10.848 Queue depth: 32 00:06:10.848 Allocate depth: 32 00:06:10.848 # threads/core: 1 00:06:10.848 Run time: 1 seconds 00:06:10.848 Verify: Yes 00:06:10.848 00:06:10.848 Running for 1 seconds... 00:06:10.848 00:06:10.848 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:10.848 ------------------------------------------------------------------------------------ 00:06:10.848 0,0 55424/s 102 MiB/s 0 0 00:06:10.848 ==================================================================================== 00:06:10.848 Total 55424/s 216 MiB/s 0 0' 00:06:10.848 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:10.848 09:29:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:10.848 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:10.848 09:29:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:10.848 09:29:33 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.848 09:29:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:10.848 09:29:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.848 09:29:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.848 09:29:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:10.848 09:29:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:10.849 09:29:33 -- accel/accel.sh@41 -- # local IFS=, 00:06:10.849 09:29:33 -- accel/accel.sh@42 -- # jq -r . 00:06:10.849 [2024-11-29 09:29:33.493238] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:10.849 [2024-11-29 09:29:33.493327] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4112246 ] 00:06:10.849 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.849 [2024-11-29 09:29:33.555348] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.849 [2024-11-29 09:29:33.676283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.107 09:29:33 -- accel/accel.sh@21 -- # val= 00:06:11.107 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.107 09:29:33 -- accel/accel.sh@21 -- # val= 00:06:11.107 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.107 09:29:33 -- accel/accel.sh@21 -- # val= 00:06:11.107 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.107 09:29:33 -- accel/accel.sh@21 -- # val=0x1 00:06:11.107 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.107 09:29:33 -- accel/accel.sh@21 -- # val= 00:06:11.107 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.107 09:29:33 -- accel/accel.sh@21 -- # val= 00:06:11.107 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.107 09:29:33 -- accel/accel.sh@21 -- # val=decompress 00:06:11.107 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.107 09:29:33 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.107 09:29:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:11.107 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.107 09:29:33 -- accel/accel.sh@21 -- # val= 00:06:11.107 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.107 09:29:33 -- accel/accel.sh@21 -- # val=software 00:06:11.107 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.107 09:29:33 -- accel/accel.sh@23 -- # accel_module=software 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.107 09:29:33 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:11.107 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.107 09:29:33 -- accel/accel.sh@21 -- # val=32 00:06:11.107 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.107 09:29:33 -- accel/accel.sh@21 -- # val=32 00:06:11.107 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.107 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.108 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.108 09:29:33 -- accel/accel.sh@21 -- # val=1 00:06:11.108 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.108 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.108 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.108 09:29:33 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:11.108 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.108 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.108 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.108 09:29:33 -- accel/accel.sh@21 -- # val=Yes 00:06:11.108 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.108 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.108 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.108 09:29:33 -- accel/accel.sh@21 -- # val= 00:06:11.108 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.108 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.108 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:11.108 09:29:33 -- accel/accel.sh@21 -- # val= 00:06:11.108 09:29:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.108 09:29:33 -- accel/accel.sh@20 -- # IFS=: 00:06:11.108 09:29:33 -- accel/accel.sh@20 -- # read -r var val 00:06:12.484 09:29:34 -- accel/accel.sh@21 -- # val= 00:06:12.484 09:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.484 09:29:34 -- accel/accel.sh@20 -- # IFS=: 00:06:12.484 09:29:34 -- accel/accel.sh@20 -- # read -r var val 00:06:12.484 09:29:34 -- accel/accel.sh@21 -- # val= 00:06:12.484 09:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.484 09:29:34 -- accel/accel.sh@20 -- # IFS=: 00:06:12.484 09:29:34 -- accel/accel.sh@20 -- # read -r var val 00:06:12.484 09:29:34 -- accel/accel.sh@21 -- # val= 00:06:12.484 09:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.484 09:29:34 -- accel/accel.sh@20 -- # IFS=: 00:06:12.484 09:29:34 -- accel/accel.sh@20 -- # read -r var val 00:06:12.484 09:29:34 -- accel/accel.sh@21 -- # val= 00:06:12.484 09:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.484 09:29:34 -- accel/accel.sh@20 -- # IFS=: 00:06:12.484 09:29:34 -- accel/accel.sh@20 -- # read -r var val 00:06:12.484 09:29:34 -- accel/accel.sh@21 -- # val= 00:06:12.484 09:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.484 09:29:34 -- accel/accel.sh@20 -- # IFS=: 00:06:12.484 09:29:34 -- accel/accel.sh@20 -- # read -r var val 00:06:12.484 09:29:34 -- accel/accel.sh@21 -- # val= 00:06:12.484 09:29:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.484 09:29:34 -- accel/accel.sh@20 -- # IFS=: 00:06:12.484 09:29:34 -- accel/accel.sh@20 -- # read -r var val 00:06:12.484 09:29:34 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:12.484 09:29:34 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:12.484 09:29:34 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:12.484 00:06:12.484 real 0m2.977s 00:06:12.484 user 0m2.678s 00:06:12.484 sys 0m0.292s 00:06:12.484 09:29:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:12.484 09:29:34 -- common/autotest_common.sh@10 -- # set +x 00:06:12.484 ************************************ 00:06:12.484 END TEST accel_decomp 00:06:12.485 ************************************ 00:06:12.485 09:29:34 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:12.485 09:29:34 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:12.485 09:29:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.485 09:29:34 -- common/autotest_common.sh@10 -- # set +x 00:06:12.485 ************************************ 00:06:12.485 START TEST accel_decmop_full 00:06:12.485 ************************************ 00:06:12.485 09:29:34 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:12.485 09:29:34 -- accel/accel.sh@16 -- # local accel_opc 00:06:12.485 09:29:34 -- accel/accel.sh@17 -- # local accel_module 00:06:12.485 09:29:34 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:12.485 09:29:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:12.485 09:29:34 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.485 09:29:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.485 09:29:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.485 09:29:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.485 09:29:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.485 09:29:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.485 09:29:34 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.485 09:29:34 -- accel/accel.sh@42 -- # jq -r . 00:06:12.485 [2024-11-29 09:29:35.007290] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:12.485 [2024-11-29 09:29:35.007376] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4112526 ] 00:06:12.485 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.485 [2024-11-29 09:29:35.073541] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.485 [2024-11-29 09:29:35.192071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.855 09:29:36 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:13.855 00:06:13.855 SPDK Configuration: 00:06:13.855 Core mask: 0x1 00:06:13.855 00:06:13.855 Accel Perf Configuration: 00:06:13.855 Workload Type: decompress 00:06:13.855 Transfer size: 111250 bytes 00:06:13.855 Vector count 1 00:06:13.855 Module: software 00:06:13.855 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:13.855 Queue depth: 32 00:06:13.855 Allocate depth: 32 00:06:13.855 # threads/core: 1 00:06:13.855 Run time: 1 seconds 00:06:13.855 Verify: Yes 00:06:13.855 00:06:13.855 Running for 1 seconds... 00:06:13.855 00:06:13.855 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:13.855 ------------------------------------------------------------------------------------ 00:06:13.855 0,0 3808/s 157 MiB/s 0 0 00:06:13.855 ==================================================================================== 00:06:13.855 Total 3808/s 404 MiB/s 0 0' 00:06:13.855 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:13.855 09:29:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:13.855 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:13.855 09:29:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:13.855 09:29:36 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.856 09:29:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:13.856 09:29:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.856 09:29:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.856 09:29:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:13.856 09:29:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:13.856 09:29:36 -- accel/accel.sh@41 -- # local IFS=, 00:06:13.856 09:29:36 -- accel/accel.sh@42 -- # jq -r . 00:06:13.856 [2024-11-29 09:29:36.503636] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:13.856 [2024-11-29 09:29:36.503725] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4112669 ] 00:06:13.856 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.856 [2024-11-29 09:29:36.566811] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.856 [2024-11-29 09:29:36.685171] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val= 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val= 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val= 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val=0x1 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val= 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val= 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val=decompress 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val= 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val=software 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@23 -- # accel_module=software 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val=32 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val=32 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val=1 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val=Yes 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val= 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:14.137 09:29:36 -- accel/accel.sh@21 -- # val= 00:06:14.137 09:29:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # IFS=: 00:06:14.137 09:29:36 -- accel/accel.sh@20 -- # read -r var val 00:06:15.511 09:29:37 -- accel/accel.sh@21 -- # val= 00:06:15.511 09:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.511 09:29:37 -- accel/accel.sh@20 -- # IFS=: 00:06:15.511 09:29:37 -- accel/accel.sh@20 -- # read -r var val 00:06:15.511 09:29:37 -- accel/accel.sh@21 -- # val= 00:06:15.511 09:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.511 09:29:37 -- accel/accel.sh@20 -- # IFS=: 00:06:15.511 09:29:37 -- accel/accel.sh@20 -- # read -r var val 00:06:15.511 09:29:37 -- accel/accel.sh@21 -- # val= 00:06:15.511 09:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.511 09:29:37 -- accel/accel.sh@20 -- # IFS=: 00:06:15.511 09:29:37 -- accel/accel.sh@20 -- # read -r var val 00:06:15.511 09:29:37 -- accel/accel.sh@21 -- # val= 00:06:15.511 09:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.511 09:29:37 -- accel/accel.sh@20 -- # IFS=: 00:06:15.511 09:29:37 -- accel/accel.sh@20 -- # read -r var val 00:06:15.511 09:29:37 -- accel/accel.sh@21 -- # val= 00:06:15.511 09:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.511 09:29:37 -- accel/accel.sh@20 -- # IFS=: 00:06:15.511 09:29:37 -- accel/accel.sh@20 -- # read -r var val 00:06:15.511 09:29:37 -- accel/accel.sh@21 -- # val= 00:06:15.511 09:29:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.511 09:29:37 -- accel/accel.sh@20 -- # IFS=: 00:06:15.511 09:29:37 -- accel/accel.sh@20 -- # read -r var val 00:06:15.511 09:29:37 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:15.511 09:29:37 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:15.511 09:29:37 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:15.511 00:06:15.511 real 0m2.995s 00:06:15.511 user 0m2.700s 00:06:15.511 sys 0m0.287s 00:06:15.511 09:29:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:15.511 09:29:37 -- common/autotest_common.sh@10 -- # set +x 00:06:15.511 ************************************ 00:06:15.511 END TEST accel_decmop_full 00:06:15.511 ************************************ 00:06:15.511 09:29:38 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:15.511 09:29:38 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:15.511 09:29:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:15.511 09:29:38 -- common/autotest_common.sh@10 -- # set +x 00:06:15.511 ************************************ 00:06:15.511 START TEST accel_decomp_mcore 00:06:15.511 ************************************ 00:06:15.511 09:29:38 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:15.511 09:29:38 -- accel/accel.sh@16 -- # local accel_opc 00:06:15.511 09:29:38 -- accel/accel.sh@17 -- # local accel_module 00:06:15.511 09:29:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:15.511 09:29:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:15.511 09:29:38 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.511 09:29:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.511 09:29:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.511 09:29:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.511 09:29:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.511 09:29:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.511 09:29:38 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.511 09:29:38 -- accel/accel.sh@42 -- # jq -r . 00:06:15.511 [2024-11-29 09:29:38.027406] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.511 [2024-11-29 09:29:38.027504] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4112829 ] 00:06:15.511 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.511 [2024-11-29 09:29:38.089930] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:15.511 [2024-11-29 09:29:38.214126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:15.511 [2024-11-29 09:29:38.214180] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:15.511 [2024-11-29 09:29:38.214248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:15.511 [2024-11-29 09:29:38.214252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.884 09:29:39 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:16.884 00:06:16.884 SPDK Configuration: 00:06:16.884 Core mask: 0xf 00:06:16.884 00:06:16.884 Accel Perf Configuration: 00:06:16.884 Workload Type: decompress 00:06:16.884 Transfer size: 4096 bytes 00:06:16.884 Vector count 1 00:06:16.884 Module: software 00:06:16.884 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.884 Queue depth: 32 00:06:16.884 Allocate depth: 32 00:06:16.884 # threads/core: 1 00:06:16.884 Run time: 1 seconds 00:06:16.884 Verify: Yes 00:06:16.884 00:06:16.884 Running for 1 seconds... 00:06:16.884 00:06:16.884 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:16.884 ------------------------------------------------------------------------------------ 00:06:16.884 0,0 52384/s 96 MiB/s 0 0 00:06:16.884 3,0 52960/s 97 MiB/s 0 0 00:06:16.884 2,0 52928/s 97 MiB/s 0 0 00:06:16.884 1,0 52640/s 97 MiB/s 0 0 00:06:16.884 ==================================================================================== 00:06:16.884 Total 210912/s 823 MiB/s 0 0' 00:06:16.884 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:16.884 09:29:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:16.884 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:16.884 09:29:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:16.884 09:29:39 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.884 09:29:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:16.884 09:29:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.884 09:29:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.884 09:29:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:16.884 09:29:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:16.884 09:29:39 -- accel/accel.sh@41 -- # local IFS=, 00:06:16.884 09:29:39 -- accel/accel.sh@42 -- # jq -r . 00:06:16.884 [2024-11-29 09:29:39.518580] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:16.884 [2024-11-29 09:29:39.518668] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4113095 ] 00:06:16.884 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.884 [2024-11-29 09:29:39.582161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:16.884 [2024-11-29 09:29:39.706030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:16.884 [2024-11-29 09:29:39.706085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:16.884 [2024-11-29 09:29:39.706140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:16.884 [2024-11-29 09:29:39.706143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.144 09:29:39 -- accel/accel.sh@21 -- # val= 00:06:17.144 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.144 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.144 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val= 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val= 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val=0xf 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val= 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val= 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val=decompress 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val= 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val=software 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@23 -- # accel_module=software 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val=32 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val=32 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val=1 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val=Yes 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val= 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:17.145 09:29:39 -- accel/accel.sh@21 -- # val= 00:06:17.145 09:29:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # IFS=: 00:06:17.145 09:29:39 -- accel/accel.sh@20 -- # read -r var val 00:06:18.518 09:29:40 -- accel/accel.sh@21 -- # val= 00:06:18.518 09:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # IFS=: 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # read -r var val 00:06:18.518 09:29:40 -- accel/accel.sh@21 -- # val= 00:06:18.518 09:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # IFS=: 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # read -r var val 00:06:18.518 09:29:40 -- accel/accel.sh@21 -- # val= 00:06:18.518 09:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # IFS=: 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # read -r var val 00:06:18.518 09:29:40 -- accel/accel.sh@21 -- # val= 00:06:18.518 09:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # IFS=: 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # read -r var val 00:06:18.518 09:29:40 -- accel/accel.sh@21 -- # val= 00:06:18.518 09:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # IFS=: 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # read -r var val 00:06:18.518 09:29:40 -- accel/accel.sh@21 -- # val= 00:06:18.518 09:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # IFS=: 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # read -r var val 00:06:18.518 09:29:40 -- accel/accel.sh@21 -- # val= 00:06:18.518 09:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # IFS=: 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # read -r var val 00:06:18.518 09:29:40 -- accel/accel.sh@21 -- # val= 00:06:18.518 09:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # IFS=: 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # read -r var val 00:06:18.518 09:29:40 -- accel/accel.sh@21 -- # val= 00:06:18.518 09:29:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # IFS=: 00:06:18.518 09:29:40 -- accel/accel.sh@20 -- # read -r var val 00:06:18.518 09:29:40 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:18.518 09:29:40 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:18.518 09:29:40 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:18.518 00:06:18.518 real 0m2.990s 00:06:18.518 user 0m9.576s 00:06:18.518 sys 0m0.314s 00:06:18.518 09:29:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:18.518 09:29:40 -- common/autotest_common.sh@10 -- # set +x 00:06:18.518 ************************************ 00:06:18.518 END TEST accel_decomp_mcore 00:06:18.518 ************************************ 00:06:18.518 09:29:41 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:18.518 09:29:41 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:18.518 09:29:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.518 09:29:41 -- common/autotest_common.sh@10 -- # set +x 00:06:18.518 ************************************ 00:06:18.518 START TEST accel_decomp_full_mcore 00:06:18.518 ************************************ 00:06:18.518 09:29:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:18.518 09:29:41 -- accel/accel.sh@16 -- # local accel_opc 00:06:18.518 09:29:41 -- accel/accel.sh@17 -- # local accel_module 00:06:18.518 09:29:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:18.518 09:29:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:18.518 09:29:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.518 09:29:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.518 09:29:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.518 09:29:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.518 09:29:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.518 09:29:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.518 09:29:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.518 09:29:41 -- accel/accel.sh@42 -- # jq -r . 00:06:18.518 [2024-11-29 09:29:41.047195] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:18.518 [2024-11-29 09:29:41.047278] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4113258 ] 00:06:18.518 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.518 [2024-11-29 09:29:41.114252] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:18.518 [2024-11-29 09:29:41.238557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:18.518 [2024-11-29 09:29:41.238616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:18.518 [2024-11-29 09:29:41.238671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:18.518 [2024-11-29 09:29:41.238675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.891 09:29:42 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:19.891 00:06:19.891 SPDK Configuration: 00:06:19.891 Core mask: 0xf 00:06:19.891 00:06:19.891 Accel Perf Configuration: 00:06:19.891 Workload Type: decompress 00:06:19.891 Transfer size: 111250 bytes 00:06:19.891 Vector count 1 00:06:19.891 Module: software 00:06:19.891 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:19.891 Queue depth: 32 00:06:19.891 Allocate depth: 32 00:06:19.891 # threads/core: 1 00:06:19.891 Run time: 1 seconds 00:06:19.891 Verify: Yes 00:06:19.891 00:06:19.891 Running for 1 seconds... 00:06:19.891 00:06:19.891 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:19.891 ------------------------------------------------------------------------------------ 00:06:19.891 0,0 3776/s 155 MiB/s 0 0 00:06:19.891 3,0 3776/s 155 MiB/s 0 0 00:06:19.891 2,0 3776/s 155 MiB/s 0 0 00:06:19.891 1,0 3808/s 157 MiB/s 0 0 00:06:19.891 ==================================================================================== 00:06:19.891 Total 15136/s 1605 MiB/s 0 0' 00:06:19.891 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:19.891 09:29:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:19.891 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:19.891 09:29:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:19.891 09:29:42 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.891 09:29:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:19.891 09:29:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.891 09:29:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.891 09:29:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:19.891 09:29:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:19.891 09:29:42 -- accel/accel.sh@41 -- # local IFS=, 00:06:19.891 09:29:42 -- accel/accel.sh@42 -- # jq -r . 00:06:19.891 [2024-11-29 09:29:42.562533] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.891 [2024-11-29 09:29:42.562615] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4113409 ] 00:06:19.891 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.891 [2024-11-29 09:29:42.624243] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:20.150 [2024-11-29 09:29:42.745615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:20.150 [2024-11-29 09:29:42.745672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:20.150 [2024-11-29 09:29:42.745727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:20.150 [2024-11-29 09:29:42.745730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val= 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val= 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val= 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val=0xf 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val= 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val= 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val=decompress 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val= 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val=software 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@23 -- # accel_module=software 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val=32 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val=32 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val=1 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val=Yes 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val= 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:20.150 09:29:42 -- accel/accel.sh@21 -- # val= 00:06:20.150 09:29:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # IFS=: 00:06:20.150 09:29:42 -- accel/accel.sh@20 -- # read -r var val 00:06:21.522 09:29:44 -- accel/accel.sh@21 -- # val= 00:06:21.522 09:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # IFS=: 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # read -r var val 00:06:21.522 09:29:44 -- accel/accel.sh@21 -- # val= 00:06:21.522 09:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # IFS=: 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # read -r var val 00:06:21.522 09:29:44 -- accel/accel.sh@21 -- # val= 00:06:21.522 09:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # IFS=: 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # read -r var val 00:06:21.522 09:29:44 -- accel/accel.sh@21 -- # val= 00:06:21.522 09:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # IFS=: 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # read -r var val 00:06:21.522 09:29:44 -- accel/accel.sh@21 -- # val= 00:06:21.522 09:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # IFS=: 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # read -r var val 00:06:21.522 09:29:44 -- accel/accel.sh@21 -- # val= 00:06:21.522 09:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # IFS=: 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # read -r var val 00:06:21.522 09:29:44 -- accel/accel.sh@21 -- # val= 00:06:21.522 09:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # IFS=: 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # read -r var val 00:06:21.522 09:29:44 -- accel/accel.sh@21 -- # val= 00:06:21.522 09:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # IFS=: 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # read -r var val 00:06:21.522 09:29:44 -- accel/accel.sh@21 -- # val= 00:06:21.522 09:29:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # IFS=: 00:06:21.522 09:29:44 -- accel/accel.sh@20 -- # read -r var val 00:06:21.522 09:29:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:21.522 09:29:44 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:21.522 09:29:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:21.522 00:06:21.522 real 0m3.020s 00:06:21.522 user 0m9.701s 00:06:21.522 sys 0m0.319s 00:06:21.522 09:29:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:21.522 09:29:44 -- common/autotest_common.sh@10 -- # set +x 00:06:21.522 ************************************ 00:06:21.522 END TEST accel_decomp_full_mcore 00:06:21.522 ************************************ 00:06:21.522 09:29:44 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:21.522 09:29:44 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:21.522 09:29:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.522 09:29:44 -- common/autotest_common.sh@10 -- # set +x 00:06:21.522 ************************************ 00:06:21.522 START TEST accel_decomp_mthread 00:06:21.522 ************************************ 00:06:21.522 09:29:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:21.522 09:29:44 -- accel/accel.sh@16 -- # local accel_opc 00:06:21.522 09:29:44 -- accel/accel.sh@17 -- # local accel_module 00:06:21.522 09:29:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:21.522 09:29:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:21.522 09:29:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.522 09:29:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.522 09:29:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.522 09:29:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.522 09:29:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.522 09:29:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.522 09:29:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.522 09:29:44 -- accel/accel.sh@42 -- # jq -r . 00:06:21.522 [2024-11-29 09:29:44.099851] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:21.522 [2024-11-29 09:29:44.099939] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4113687 ] 00:06:21.522 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.522 [2024-11-29 09:29:44.165390] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.522 [2024-11-29 09:29:44.284435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.892 09:29:45 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:22.892 00:06:22.892 SPDK Configuration: 00:06:22.892 Core mask: 0x1 00:06:22.892 00:06:22.892 Accel Perf Configuration: 00:06:22.892 Workload Type: decompress 00:06:22.892 Transfer size: 4096 bytes 00:06:22.892 Vector count 1 00:06:22.892 Module: software 00:06:22.892 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:22.892 Queue depth: 32 00:06:22.892 Allocate depth: 32 00:06:22.892 # threads/core: 2 00:06:22.892 Run time: 1 seconds 00:06:22.892 Verify: Yes 00:06:22.892 00:06:22.892 Running for 1 seconds... 00:06:22.892 00:06:22.892 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:22.892 ------------------------------------------------------------------------------------ 00:06:22.892 0,1 28064/s 51 MiB/s 0 0 00:06:22.892 0,0 27968/s 51 MiB/s 0 0 00:06:22.892 ==================================================================================== 00:06:22.892 Total 56032/s 218 MiB/s 0 0' 00:06:22.892 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:22.892 09:29:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:22.892 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:22.892 09:29:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:22.892 09:29:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:22.892 09:29:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:22.892 09:29:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.892 09:29:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.892 09:29:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:22.892 09:29:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:22.892 09:29:45 -- accel/accel.sh@41 -- # local IFS=, 00:06:22.892 09:29:45 -- accel/accel.sh@42 -- # jq -r . 00:06:22.892 [2024-11-29 09:29:45.589950] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:22.892 [2024-11-29 09:29:45.590040] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4113835 ] 00:06:22.892 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.892 [2024-11-29 09:29:45.653719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.150 [2024-11-29 09:29:45.775332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.150 09:29:45 -- accel/accel.sh@21 -- # val= 00:06:23.150 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.150 09:29:45 -- accel/accel.sh@21 -- # val= 00:06:23.150 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.150 09:29:45 -- accel/accel.sh@21 -- # val= 00:06:23.150 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.150 09:29:45 -- accel/accel.sh@21 -- # val=0x1 00:06:23.150 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.150 09:29:45 -- accel/accel.sh@21 -- # val= 00:06:23.150 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.150 09:29:45 -- accel/accel.sh@21 -- # val= 00:06:23.150 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.150 09:29:45 -- accel/accel.sh@21 -- # val=decompress 00:06:23.150 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.150 09:29:45 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.150 09:29:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:23.150 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.150 09:29:45 -- accel/accel.sh@21 -- # val= 00:06:23.150 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.150 09:29:45 -- accel/accel.sh@21 -- # val=software 00:06:23.150 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.150 09:29:45 -- accel/accel.sh@23 -- # accel_module=software 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.150 09:29:45 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:23.150 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.150 09:29:45 -- accel/accel.sh@21 -- # val=32 00:06:23.150 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.150 09:29:45 -- accel/accel.sh@21 -- # val=32 00:06:23.150 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.150 09:29:45 -- accel/accel.sh@21 -- # val=2 00:06:23.150 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.150 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.151 09:29:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:23.151 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.151 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.151 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.151 09:29:45 -- accel/accel.sh@21 -- # val=Yes 00:06:23.151 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.151 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.151 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.151 09:29:45 -- accel/accel.sh@21 -- # val= 00:06:23.151 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.151 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.151 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:23.151 09:29:45 -- accel/accel.sh@21 -- # val= 00:06:23.151 09:29:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.151 09:29:45 -- accel/accel.sh@20 -- # IFS=: 00:06:23.151 09:29:45 -- accel/accel.sh@20 -- # read -r var val 00:06:24.524 09:29:47 -- accel/accel.sh@21 -- # val= 00:06:24.524 09:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.524 09:29:47 -- accel/accel.sh@20 -- # IFS=: 00:06:24.524 09:29:47 -- accel/accel.sh@20 -- # read -r var val 00:06:24.524 09:29:47 -- accel/accel.sh@21 -- # val= 00:06:24.524 09:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.524 09:29:47 -- accel/accel.sh@20 -- # IFS=: 00:06:24.524 09:29:47 -- accel/accel.sh@20 -- # read -r var val 00:06:24.524 09:29:47 -- accel/accel.sh@21 -- # val= 00:06:24.524 09:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.524 09:29:47 -- accel/accel.sh@20 -- # IFS=: 00:06:24.524 09:29:47 -- accel/accel.sh@20 -- # read -r var val 00:06:24.524 09:29:47 -- accel/accel.sh@21 -- # val= 00:06:24.524 09:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.524 09:29:47 -- accel/accel.sh@20 -- # IFS=: 00:06:24.524 09:29:47 -- accel/accel.sh@20 -- # read -r var val 00:06:24.524 09:29:47 -- accel/accel.sh@21 -- # val= 00:06:24.524 09:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.524 09:29:47 -- accel/accel.sh@20 -- # IFS=: 00:06:24.524 09:29:47 -- accel/accel.sh@20 -- # read -r var val 00:06:24.524 09:29:47 -- accel/accel.sh@21 -- # val= 00:06:24.524 09:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.524 09:29:47 -- accel/accel.sh@20 -- # IFS=: 00:06:24.524 09:29:47 -- accel/accel.sh@20 -- # read -r var val 00:06:24.524 09:29:47 -- accel/accel.sh@21 -- # val= 00:06:24.524 09:29:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.524 09:29:47 -- accel/accel.sh@20 -- # IFS=: 00:06:24.524 09:29:47 -- accel/accel.sh@20 -- # read -r var val 00:06:24.524 09:29:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:24.524 09:29:47 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:24.524 09:29:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:24.524 00:06:24.524 real 0m2.990s 00:06:24.524 user 0m2.685s 00:06:24.524 sys 0m0.296s 00:06:24.524 09:29:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.524 09:29:47 -- common/autotest_common.sh@10 -- # set +x 00:06:24.524 ************************************ 00:06:24.524 END TEST accel_decomp_mthread 00:06:24.524 ************************************ 00:06:24.524 09:29:47 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:24.524 09:29:47 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:24.524 09:29:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.524 09:29:47 -- common/autotest_common.sh@10 -- # set +x 00:06:24.524 ************************************ 00:06:24.524 START TEST accel_deomp_full_mthread 00:06:24.524 ************************************ 00:06:24.524 09:29:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:24.524 09:29:47 -- accel/accel.sh@16 -- # local accel_opc 00:06:24.524 09:29:47 -- accel/accel.sh@17 -- # local accel_module 00:06:24.524 09:29:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:24.524 09:29:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:24.524 09:29:47 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.524 09:29:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.524 09:29:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.524 09:29:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.524 09:29:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.524 09:29:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.524 09:29:47 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.524 09:29:47 -- accel/accel.sh@42 -- # jq -r . 00:06:24.524 [2024-11-29 09:29:47.115814] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.524 [2024-11-29 09:29:47.115899] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4113991 ] 00:06:24.524 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.524 [2024-11-29 09:29:47.180241] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.524 [2024-11-29 09:29:47.303364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.898 09:29:48 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:25.898 00:06:25.898 SPDK Configuration: 00:06:25.898 Core mask: 0x1 00:06:25.898 00:06:25.898 Accel Perf Configuration: 00:06:25.898 Workload Type: decompress 00:06:25.898 Transfer size: 111250 bytes 00:06:25.898 Vector count 1 00:06:25.898 Module: software 00:06:25.898 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:25.898 Queue depth: 32 00:06:25.898 Allocate depth: 32 00:06:25.898 # threads/core: 2 00:06:25.898 Run time: 1 seconds 00:06:25.898 Verify: Yes 00:06:25.898 00:06:25.898 Running for 1 seconds... 00:06:25.898 00:06:25.898 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:25.898 ------------------------------------------------------------------------------------ 00:06:25.898 0,1 1952/s 80 MiB/s 0 0 00:06:25.898 0,0 1920/s 79 MiB/s 0 0 00:06:25.898 ==================================================================================== 00:06:25.898 Total 3872/s 410 MiB/s 0 0' 00:06:25.898 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:25.898 09:29:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:25.898 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:25.898 09:29:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:25.898 09:29:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:25.898 09:29:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:25.898 09:29:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:25.898 09:29:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:25.898 09:29:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:25.898 09:29:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:25.899 09:29:48 -- accel/accel.sh@41 -- # local IFS=, 00:06:25.899 09:29:48 -- accel/accel.sh@42 -- # jq -r . 00:06:25.899 [2024-11-29 09:29:48.624159] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:25.899 [2024-11-29 09:29:48.624249] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4114259 ] 00:06:25.899 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.899 [2024-11-29 09:29:48.686103] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.157 [2024-11-29 09:29:48.806988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.157 09:29:48 -- accel/accel.sh@21 -- # val= 00:06:26.157 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.157 09:29:48 -- accel/accel.sh@21 -- # val= 00:06:26.157 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.157 09:29:48 -- accel/accel.sh@21 -- # val= 00:06:26.157 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.157 09:29:48 -- accel/accel.sh@21 -- # val=0x1 00:06:26.157 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.157 09:29:48 -- accel/accel.sh@21 -- # val= 00:06:26.157 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.157 09:29:48 -- accel/accel.sh@21 -- # val= 00:06:26.157 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.157 09:29:48 -- accel/accel.sh@21 -- # val=decompress 00:06:26.157 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.157 09:29:48 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.157 09:29:48 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:26.157 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.157 09:29:48 -- accel/accel.sh@21 -- # val= 00:06:26.157 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.157 09:29:48 -- accel/accel.sh@21 -- # val=software 00:06:26.157 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.157 09:29:48 -- accel/accel.sh@23 -- # accel_module=software 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.157 09:29:48 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:26.157 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.157 09:29:48 -- accel/accel.sh@21 -- # val=32 00:06:26.157 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.157 09:29:48 -- accel/accel.sh@21 -- # val=32 00:06:26.157 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.157 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.157 09:29:48 -- accel/accel.sh@21 -- # val=2 00:06:26.158 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.158 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.158 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.158 09:29:48 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:26.158 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.158 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.158 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.158 09:29:48 -- accel/accel.sh@21 -- # val=Yes 00:06:26.158 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.158 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.158 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.158 09:29:48 -- accel/accel.sh@21 -- # val= 00:06:26.158 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.158 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.158 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:26.158 09:29:48 -- accel/accel.sh@21 -- # val= 00:06:26.158 09:29:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.158 09:29:48 -- accel/accel.sh@20 -- # IFS=: 00:06:26.158 09:29:48 -- accel/accel.sh@20 -- # read -r var val 00:06:27.531 09:29:50 -- accel/accel.sh@21 -- # val= 00:06:27.531 09:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.531 09:29:50 -- accel/accel.sh@20 -- # IFS=: 00:06:27.531 09:29:50 -- accel/accel.sh@20 -- # read -r var val 00:06:27.531 09:29:50 -- accel/accel.sh@21 -- # val= 00:06:27.531 09:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.531 09:29:50 -- accel/accel.sh@20 -- # IFS=: 00:06:27.531 09:29:50 -- accel/accel.sh@20 -- # read -r var val 00:06:27.531 09:29:50 -- accel/accel.sh@21 -- # val= 00:06:27.531 09:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.531 09:29:50 -- accel/accel.sh@20 -- # IFS=: 00:06:27.531 09:29:50 -- accel/accel.sh@20 -- # read -r var val 00:06:27.531 09:29:50 -- accel/accel.sh@21 -- # val= 00:06:27.531 09:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.531 09:29:50 -- accel/accel.sh@20 -- # IFS=: 00:06:27.531 09:29:50 -- accel/accel.sh@20 -- # read -r var val 00:06:27.531 09:29:50 -- accel/accel.sh@21 -- # val= 00:06:27.531 09:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.531 09:29:50 -- accel/accel.sh@20 -- # IFS=: 00:06:27.531 09:29:50 -- accel/accel.sh@20 -- # read -r var val 00:06:27.531 09:29:50 -- accel/accel.sh@21 -- # val= 00:06:27.531 09:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.531 09:29:50 -- accel/accel.sh@20 -- # IFS=: 00:06:27.531 09:29:50 -- accel/accel.sh@20 -- # read -r var val 00:06:27.531 09:29:50 -- accel/accel.sh@21 -- # val= 00:06:27.531 09:29:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.531 09:29:50 -- accel/accel.sh@20 -- # IFS=: 00:06:27.531 09:29:50 -- accel/accel.sh@20 -- # read -r var val 00:06:27.531 09:29:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:27.531 09:29:50 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:27.531 09:29:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:27.531 00:06:27.531 real 0m3.032s 00:06:27.531 user 0m2.734s 00:06:27.531 sys 0m0.290s 00:06:27.531 09:29:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.531 09:29:50 -- common/autotest_common.sh@10 -- # set +x 00:06:27.531 ************************************ 00:06:27.531 END TEST accel_deomp_full_mthread 00:06:27.531 ************************************ 00:06:27.531 09:29:50 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:27.531 09:29:50 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:27.531 09:29:50 -- accel/accel.sh@129 -- # build_accel_config 00:06:27.531 09:29:50 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:27.531 09:29:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.531 09:29:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.531 09:29:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.531 09:29:50 -- common/autotest_common.sh@10 -- # set +x 00:06:27.531 09:29:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.531 09:29:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.531 09:29:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.531 09:29:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.531 09:29:50 -- accel/accel.sh@42 -- # jq -r . 00:06:27.531 ************************************ 00:06:27.531 START TEST accel_dif_functional_tests 00:06:27.531 ************************************ 00:06:27.531 09:29:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:27.531 [2024-11-29 09:29:50.189955] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.531 [2024-11-29 09:29:50.190024] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4114420 ] 00:06:27.531 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.531 [2024-11-29 09:29:50.253829] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:27.789 [2024-11-29 09:29:50.379683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:27.789 [2024-11-29 09:29:50.379737] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:27.789 [2024-11-29 09:29:50.379741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.789 00:06:27.789 00:06:27.789 CUnit - A unit testing framework for C - Version 2.1-3 00:06:27.789 http://cunit.sourceforge.net/ 00:06:27.789 00:06:27.789 00:06:27.789 Suite: accel_dif 00:06:27.789 Test: verify: DIF generated, GUARD check ...passed 00:06:27.789 Test: verify: DIF generated, APPTAG check ...passed 00:06:27.789 Test: verify: DIF generated, REFTAG check ...passed 00:06:27.789 Test: verify: DIF not generated, GUARD check ...[2024-11-29 09:29:50.484412] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:27.789 [2024-11-29 09:29:50.484488] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:27.789 passed 00:06:27.789 Test: verify: DIF not generated, APPTAG check ...[2024-11-29 09:29:50.484534] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:27.789 [2024-11-29 09:29:50.484565] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:27.789 passed 00:06:27.789 Test: verify: DIF not generated, REFTAG check ...[2024-11-29 09:29:50.484601] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:27.789 [2024-11-29 09:29:50.484630] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:27.789 passed 00:06:27.789 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:27.789 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-29 09:29:50.484700] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:27.789 passed 00:06:27.789 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:27.789 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:27.789 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:27.789 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-29 09:29:50.484852] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:27.789 passed 00:06:27.789 Test: generate copy: DIF generated, GUARD check ...passed 00:06:27.789 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:27.789 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:27.789 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:27.789 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:27.789 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:27.789 Test: generate copy: iovecs-len validate ...[2024-11-29 09:29:50.485114] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:27.789 passed 00:06:27.789 Test: generate copy: buffer alignment validate ...passed 00:06:27.789 00:06:27.789 Run Summary: Type Total Ran Passed Failed Inactive 00:06:27.789 suites 1 1 n/a 0 0 00:06:27.789 tests 20 20 20 0 0 00:06:27.789 asserts 204 204 204 0 n/a 00:06:27.789 00:06:27.789 Elapsed time = 0.003 seconds 00:06:28.048 00:06:28.048 real 0m0.596s 00:06:28.048 user 0m0.902s 00:06:28.048 sys 0m0.184s 00:06:28.048 09:29:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:28.048 09:29:50 -- common/autotest_common.sh@10 -- # set +x 00:06:28.048 ************************************ 00:06:28.048 END TEST accel_dif_functional_tests 00:06:28.048 ************************************ 00:06:28.048 00:06:28.048 real 1m3.447s 00:06:28.048 user 1m11.232s 00:06:28.048 sys 0m7.350s 00:06:28.048 09:29:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:28.048 09:29:50 -- common/autotest_common.sh@10 -- # set +x 00:06:28.048 ************************************ 00:06:28.048 END TEST accel 00:06:28.048 ************************************ 00:06:28.048 09:29:50 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:28.048 09:29:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:28.048 09:29:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:28.048 09:29:50 -- common/autotest_common.sh@10 -- # set +x 00:06:28.048 ************************************ 00:06:28.048 START TEST accel_rpc 00:06:28.048 ************************************ 00:06:28.048 09:29:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:28.048 * Looking for test storage... 00:06:28.048 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:28.048 09:29:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:28.048 09:29:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:28.048 09:29:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:28.307 09:29:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:28.307 09:29:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:28.307 09:29:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:28.307 09:29:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:28.307 09:29:50 -- scripts/common.sh@335 -- # IFS=.-: 00:06:28.307 09:29:50 -- scripts/common.sh@335 -- # read -ra ver1 00:06:28.307 09:29:50 -- scripts/common.sh@336 -- # IFS=.-: 00:06:28.307 09:29:50 -- scripts/common.sh@336 -- # read -ra ver2 00:06:28.307 09:29:50 -- scripts/common.sh@337 -- # local 'op=<' 00:06:28.307 09:29:50 -- scripts/common.sh@339 -- # ver1_l=2 00:06:28.307 09:29:50 -- scripts/common.sh@340 -- # ver2_l=1 00:06:28.307 09:29:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:28.307 09:29:50 -- scripts/common.sh@343 -- # case "$op" in 00:06:28.307 09:29:50 -- scripts/common.sh@344 -- # : 1 00:06:28.307 09:29:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:28.307 09:29:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:28.307 09:29:50 -- scripts/common.sh@364 -- # decimal 1 00:06:28.307 09:29:50 -- scripts/common.sh@352 -- # local d=1 00:06:28.307 09:29:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:28.307 09:29:50 -- scripts/common.sh@354 -- # echo 1 00:06:28.307 09:29:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:28.307 09:29:50 -- scripts/common.sh@365 -- # decimal 2 00:06:28.307 09:29:50 -- scripts/common.sh@352 -- # local d=2 00:06:28.307 09:29:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:28.307 09:29:50 -- scripts/common.sh@354 -- # echo 2 00:06:28.307 09:29:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:28.307 09:29:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:28.307 09:29:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:28.307 09:29:50 -- scripts/common.sh@367 -- # return 0 00:06:28.307 09:29:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:28.307 09:29:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:28.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:28.307 --rc genhtml_branch_coverage=1 00:06:28.307 --rc genhtml_function_coverage=1 00:06:28.307 --rc genhtml_legend=1 00:06:28.307 --rc geninfo_all_blocks=1 00:06:28.307 --rc geninfo_unexecuted_blocks=1 00:06:28.307 00:06:28.307 ' 00:06:28.307 09:29:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:28.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:28.307 --rc genhtml_branch_coverage=1 00:06:28.307 --rc genhtml_function_coverage=1 00:06:28.307 --rc genhtml_legend=1 00:06:28.307 --rc geninfo_all_blocks=1 00:06:28.307 --rc geninfo_unexecuted_blocks=1 00:06:28.307 00:06:28.307 ' 00:06:28.307 09:29:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:28.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:28.307 --rc genhtml_branch_coverage=1 00:06:28.307 --rc genhtml_function_coverage=1 00:06:28.307 --rc genhtml_legend=1 00:06:28.307 --rc geninfo_all_blocks=1 00:06:28.307 --rc geninfo_unexecuted_blocks=1 00:06:28.307 00:06:28.307 ' 00:06:28.307 09:29:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:28.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:28.307 --rc genhtml_branch_coverage=1 00:06:28.307 --rc genhtml_function_coverage=1 00:06:28.307 --rc genhtml_legend=1 00:06:28.307 --rc geninfo_all_blocks=1 00:06:28.307 --rc geninfo_unexecuted_blocks=1 00:06:28.307 00:06:28.307 ' 00:06:28.307 09:29:50 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:28.307 09:29:50 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=4114617 00:06:28.307 09:29:50 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:28.307 09:29:50 -- accel/accel_rpc.sh@15 -- # waitforlisten 4114617 00:06:28.307 09:29:50 -- common/autotest_common.sh@829 -- # '[' -z 4114617 ']' 00:06:28.307 09:29:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:28.307 09:29:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:28.307 09:29:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:28.307 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:28.307 09:29:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:28.307 09:29:50 -- common/autotest_common.sh@10 -- # set +x 00:06:28.307 [2024-11-29 09:29:50.974769] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:28.307 [2024-11-29 09:29:50.974848] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4114617 ] 00:06:28.307 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.307 [2024-11-29 09:29:51.030985] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:28.307 [2024-11-29 09:29:51.140127] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:28.307 [2024-11-29 09:29:51.140317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.566 09:29:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:28.566 09:29:51 -- common/autotest_common.sh@862 -- # return 0 00:06:28.566 09:29:51 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:28.566 09:29:51 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:28.566 09:29:51 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:28.566 09:29:51 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:28.566 09:29:51 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:28.566 09:29:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:28.566 09:29:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:28.566 09:29:51 -- common/autotest_common.sh@10 -- # set +x 00:06:28.566 ************************************ 00:06:28.566 START TEST accel_assign_opcode 00:06:28.566 ************************************ 00:06:28.566 09:29:51 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:28.566 09:29:51 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:28.566 09:29:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.566 09:29:51 -- common/autotest_common.sh@10 -- # set +x 00:06:28.566 [2024-11-29 09:29:51.188861] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:28.566 09:29:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.566 09:29:51 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:28.566 09:29:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.566 09:29:51 -- common/autotest_common.sh@10 -- # set +x 00:06:28.566 [2024-11-29 09:29:51.196877] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:28.566 09:29:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.566 09:29:51 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:28.566 09:29:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.566 09:29:51 -- common/autotest_common.sh@10 -- # set +x 00:06:28.824 09:29:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.824 09:29:51 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:28.824 09:29:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.824 09:29:51 -- common/autotest_common.sh@10 -- # set +x 00:06:28.824 09:29:51 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:28.824 09:29:51 -- accel/accel_rpc.sh@42 -- # grep software 00:06:28.824 09:29:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.824 software 00:06:28.824 00:06:28.824 real 0m0.305s 00:06:28.824 user 0m0.040s 00:06:28.824 sys 0m0.008s 00:06:28.824 09:29:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:28.824 09:29:51 -- common/autotest_common.sh@10 -- # set +x 00:06:28.824 ************************************ 00:06:28.824 END TEST accel_assign_opcode 00:06:28.824 ************************************ 00:06:28.824 09:29:51 -- accel/accel_rpc.sh@55 -- # killprocess 4114617 00:06:28.824 09:29:51 -- common/autotest_common.sh@936 -- # '[' -z 4114617 ']' 00:06:28.824 09:29:51 -- common/autotest_common.sh@940 -- # kill -0 4114617 00:06:28.824 09:29:51 -- common/autotest_common.sh@941 -- # uname 00:06:28.824 09:29:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:28.824 09:29:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4114617 00:06:28.824 09:29:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:28.824 09:29:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:28.824 09:29:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4114617' 00:06:28.824 killing process with pid 4114617 00:06:28.824 09:29:51 -- common/autotest_common.sh@955 -- # kill 4114617 00:06:28.824 09:29:51 -- common/autotest_common.sh@960 -- # wait 4114617 00:06:29.390 00:06:29.390 real 0m1.222s 00:06:29.390 user 0m1.146s 00:06:29.390 sys 0m0.431s 00:06:29.390 09:29:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.390 09:29:52 -- common/autotest_common.sh@10 -- # set +x 00:06:29.390 ************************************ 00:06:29.390 END TEST accel_rpc 00:06:29.390 ************************************ 00:06:29.390 09:29:52 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:29.390 09:29:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:29.390 09:29:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.390 09:29:52 -- common/autotest_common.sh@10 -- # set +x 00:06:29.390 ************************************ 00:06:29.390 START TEST app_cmdline 00:06:29.390 ************************************ 00:06:29.390 09:29:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:29.390 * Looking for test storage... 00:06:29.390 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:29.390 09:29:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:29.390 09:29:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:29.390 09:29:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:29.390 09:29:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:29.390 09:29:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:29.390 09:29:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:29.390 09:29:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:29.390 09:29:52 -- scripts/common.sh@335 -- # IFS=.-: 00:06:29.390 09:29:52 -- scripts/common.sh@335 -- # read -ra ver1 00:06:29.390 09:29:52 -- scripts/common.sh@336 -- # IFS=.-: 00:06:29.390 09:29:52 -- scripts/common.sh@336 -- # read -ra ver2 00:06:29.390 09:29:52 -- scripts/common.sh@337 -- # local 'op=<' 00:06:29.390 09:29:52 -- scripts/common.sh@339 -- # ver1_l=2 00:06:29.390 09:29:52 -- scripts/common.sh@340 -- # ver2_l=1 00:06:29.390 09:29:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:29.390 09:29:52 -- scripts/common.sh@343 -- # case "$op" in 00:06:29.390 09:29:52 -- scripts/common.sh@344 -- # : 1 00:06:29.390 09:29:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:29.390 09:29:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:29.390 09:29:52 -- scripts/common.sh@364 -- # decimal 1 00:06:29.390 09:29:52 -- scripts/common.sh@352 -- # local d=1 00:06:29.390 09:29:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:29.390 09:29:52 -- scripts/common.sh@354 -- # echo 1 00:06:29.391 09:29:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:29.391 09:29:52 -- scripts/common.sh@365 -- # decimal 2 00:06:29.391 09:29:52 -- scripts/common.sh@352 -- # local d=2 00:06:29.391 09:29:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:29.391 09:29:52 -- scripts/common.sh@354 -- # echo 2 00:06:29.391 09:29:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:29.391 09:29:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:29.391 09:29:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:29.391 09:29:52 -- scripts/common.sh@367 -- # return 0 00:06:29.391 09:29:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:29.391 09:29:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:29.391 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.391 --rc genhtml_branch_coverage=1 00:06:29.391 --rc genhtml_function_coverage=1 00:06:29.391 --rc genhtml_legend=1 00:06:29.391 --rc geninfo_all_blocks=1 00:06:29.391 --rc geninfo_unexecuted_blocks=1 00:06:29.391 00:06:29.391 ' 00:06:29.391 09:29:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:29.391 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.391 --rc genhtml_branch_coverage=1 00:06:29.391 --rc genhtml_function_coverage=1 00:06:29.391 --rc genhtml_legend=1 00:06:29.391 --rc geninfo_all_blocks=1 00:06:29.391 --rc geninfo_unexecuted_blocks=1 00:06:29.391 00:06:29.391 ' 00:06:29.391 09:29:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:29.391 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.391 --rc genhtml_branch_coverage=1 00:06:29.391 --rc genhtml_function_coverage=1 00:06:29.391 --rc genhtml_legend=1 00:06:29.391 --rc geninfo_all_blocks=1 00:06:29.391 --rc geninfo_unexecuted_blocks=1 00:06:29.391 00:06:29.391 ' 00:06:29.391 09:29:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:29.391 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.391 --rc genhtml_branch_coverage=1 00:06:29.391 --rc genhtml_function_coverage=1 00:06:29.391 --rc genhtml_legend=1 00:06:29.391 --rc geninfo_all_blocks=1 00:06:29.391 --rc geninfo_unexecuted_blocks=1 00:06:29.391 00:06:29.391 ' 00:06:29.391 09:29:52 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:29.391 09:29:52 -- app/cmdline.sh@17 -- # spdk_tgt_pid=4114831 00:06:29.391 09:29:52 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:29.391 09:29:52 -- app/cmdline.sh@18 -- # waitforlisten 4114831 00:06:29.391 09:29:52 -- common/autotest_common.sh@829 -- # '[' -z 4114831 ']' 00:06:29.391 09:29:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:29.391 09:29:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:29.391 09:29:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:29.391 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:29.391 09:29:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:29.391 09:29:52 -- common/autotest_common.sh@10 -- # set +x 00:06:29.391 [2024-11-29 09:29:52.226591] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.391 [2024-11-29 09:29:52.226695] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4114831 ] 00:06:29.649 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.649 [2024-11-29 09:29:52.292772] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.649 [2024-11-29 09:29:52.410358] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:29.649 [2024-11-29 09:29:52.410562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.583 09:29:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:30.583 09:29:53 -- common/autotest_common.sh@862 -- # return 0 00:06:30.583 09:29:53 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:30.840 { 00:06:30.840 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:30.840 "fields": { 00:06:30.840 "major": 24, 00:06:30.840 "minor": 1, 00:06:30.840 "patch": 1, 00:06:30.840 "suffix": "-pre", 00:06:30.840 "commit": "c13c99a5e" 00:06:30.840 } 00:06:30.840 } 00:06:30.840 09:29:53 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:30.840 09:29:53 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:30.840 09:29:53 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:30.840 09:29:53 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:30.840 09:29:53 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:30.840 09:29:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:30.840 09:29:53 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:30.840 09:29:53 -- common/autotest_common.sh@10 -- # set +x 00:06:30.840 09:29:53 -- app/cmdline.sh@26 -- # sort 00:06:30.840 09:29:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.840 09:29:53 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:30.840 09:29:53 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:30.840 09:29:53 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:30.840 09:29:53 -- common/autotest_common.sh@650 -- # local es=0 00:06:30.840 09:29:53 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:30.840 09:29:53 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:30.840 09:29:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:30.840 09:29:53 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:30.840 09:29:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:30.840 09:29:53 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:30.840 09:29:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:30.840 09:29:53 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:30.840 09:29:53 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:30.840 09:29:53 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:31.098 request: 00:06:31.098 { 00:06:31.098 "method": "env_dpdk_get_mem_stats", 00:06:31.098 "req_id": 1 00:06:31.098 } 00:06:31.098 Got JSON-RPC error response 00:06:31.098 response: 00:06:31.098 { 00:06:31.098 "code": -32601, 00:06:31.098 "message": "Method not found" 00:06:31.098 } 00:06:31.098 09:29:53 -- common/autotest_common.sh@653 -- # es=1 00:06:31.098 09:29:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:31.098 09:29:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:31.098 09:29:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:31.098 09:29:53 -- app/cmdline.sh@1 -- # killprocess 4114831 00:06:31.098 09:29:53 -- common/autotest_common.sh@936 -- # '[' -z 4114831 ']' 00:06:31.098 09:29:53 -- common/autotest_common.sh@940 -- # kill -0 4114831 00:06:31.098 09:29:53 -- common/autotest_common.sh@941 -- # uname 00:06:31.098 09:29:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:31.098 09:29:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4114831 00:06:31.098 09:29:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:31.098 09:29:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:31.098 09:29:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4114831' 00:06:31.098 killing process with pid 4114831 00:06:31.098 09:29:53 -- common/autotest_common.sh@955 -- # kill 4114831 00:06:31.098 09:29:53 -- common/autotest_common.sh@960 -- # wait 4114831 00:06:31.663 00:06:31.663 real 0m2.336s 00:06:31.663 user 0m2.961s 00:06:31.663 sys 0m0.552s 00:06:31.663 09:29:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:31.663 09:29:54 -- common/autotest_common.sh@10 -- # set +x 00:06:31.663 ************************************ 00:06:31.663 END TEST app_cmdline 00:06:31.663 ************************************ 00:06:31.663 09:29:54 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:31.663 09:29:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:31.663 09:29:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.663 09:29:54 -- common/autotest_common.sh@10 -- # set +x 00:06:31.663 ************************************ 00:06:31.663 START TEST version 00:06:31.663 ************************************ 00:06:31.663 09:29:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:31.663 * Looking for test storage... 00:06:31.663 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:31.663 09:29:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:31.663 09:29:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:31.663 09:29:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:31.922 09:29:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:31.922 09:29:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:31.922 09:29:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:31.922 09:29:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:31.922 09:29:54 -- scripts/common.sh@335 -- # IFS=.-: 00:06:31.922 09:29:54 -- scripts/common.sh@335 -- # read -ra ver1 00:06:31.922 09:29:54 -- scripts/common.sh@336 -- # IFS=.-: 00:06:31.922 09:29:54 -- scripts/common.sh@336 -- # read -ra ver2 00:06:31.922 09:29:54 -- scripts/common.sh@337 -- # local 'op=<' 00:06:31.922 09:29:54 -- scripts/common.sh@339 -- # ver1_l=2 00:06:31.922 09:29:54 -- scripts/common.sh@340 -- # ver2_l=1 00:06:31.922 09:29:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:31.922 09:29:54 -- scripts/common.sh@343 -- # case "$op" in 00:06:31.922 09:29:54 -- scripts/common.sh@344 -- # : 1 00:06:31.922 09:29:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:31.922 09:29:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:31.922 09:29:54 -- scripts/common.sh@364 -- # decimal 1 00:06:31.922 09:29:54 -- scripts/common.sh@352 -- # local d=1 00:06:31.922 09:29:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:31.922 09:29:54 -- scripts/common.sh@354 -- # echo 1 00:06:31.922 09:29:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:31.922 09:29:54 -- scripts/common.sh@365 -- # decimal 2 00:06:31.922 09:29:54 -- scripts/common.sh@352 -- # local d=2 00:06:31.922 09:29:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:31.922 09:29:54 -- scripts/common.sh@354 -- # echo 2 00:06:31.922 09:29:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:31.922 09:29:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:31.922 09:29:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:31.922 09:29:54 -- scripts/common.sh@367 -- # return 0 00:06:31.922 09:29:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:31.922 09:29:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:31.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.922 --rc genhtml_branch_coverage=1 00:06:31.922 --rc genhtml_function_coverage=1 00:06:31.922 --rc genhtml_legend=1 00:06:31.922 --rc geninfo_all_blocks=1 00:06:31.922 --rc geninfo_unexecuted_blocks=1 00:06:31.922 00:06:31.922 ' 00:06:31.922 09:29:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:31.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.922 --rc genhtml_branch_coverage=1 00:06:31.922 --rc genhtml_function_coverage=1 00:06:31.922 --rc genhtml_legend=1 00:06:31.922 --rc geninfo_all_blocks=1 00:06:31.922 --rc geninfo_unexecuted_blocks=1 00:06:31.922 00:06:31.922 ' 00:06:31.922 09:29:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:31.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.922 --rc genhtml_branch_coverage=1 00:06:31.922 --rc genhtml_function_coverage=1 00:06:31.922 --rc genhtml_legend=1 00:06:31.922 --rc geninfo_all_blocks=1 00:06:31.922 --rc geninfo_unexecuted_blocks=1 00:06:31.922 00:06:31.922 ' 00:06:31.922 09:29:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:31.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.922 --rc genhtml_branch_coverage=1 00:06:31.922 --rc genhtml_function_coverage=1 00:06:31.922 --rc genhtml_legend=1 00:06:31.922 --rc geninfo_all_blocks=1 00:06:31.922 --rc geninfo_unexecuted_blocks=1 00:06:31.922 00:06:31.922 ' 00:06:31.922 09:29:54 -- app/version.sh@17 -- # get_header_version major 00:06:31.922 09:29:54 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:31.922 09:29:54 -- app/version.sh@14 -- # cut -f2 00:06:31.922 09:29:54 -- app/version.sh@14 -- # tr -d '"' 00:06:31.922 09:29:54 -- app/version.sh@17 -- # major=24 00:06:31.922 09:29:54 -- app/version.sh@18 -- # get_header_version minor 00:06:31.922 09:29:54 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:31.922 09:29:54 -- app/version.sh@14 -- # cut -f2 00:06:31.922 09:29:54 -- app/version.sh@14 -- # tr -d '"' 00:06:31.922 09:29:54 -- app/version.sh@18 -- # minor=1 00:06:31.922 09:29:54 -- app/version.sh@19 -- # get_header_version patch 00:06:31.922 09:29:54 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:31.922 09:29:54 -- app/version.sh@14 -- # cut -f2 00:06:31.922 09:29:54 -- app/version.sh@14 -- # tr -d '"' 00:06:31.922 09:29:54 -- app/version.sh@19 -- # patch=1 00:06:31.922 09:29:54 -- app/version.sh@20 -- # get_header_version suffix 00:06:31.922 09:29:54 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:31.922 09:29:54 -- app/version.sh@14 -- # cut -f2 00:06:31.922 09:29:54 -- app/version.sh@14 -- # tr -d '"' 00:06:31.922 09:29:54 -- app/version.sh@20 -- # suffix=-pre 00:06:31.922 09:29:54 -- app/version.sh@22 -- # version=24.1 00:06:31.922 09:29:54 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:31.922 09:29:54 -- app/version.sh@25 -- # version=24.1.1 00:06:31.922 09:29:54 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:31.922 09:29:54 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:31.922 09:29:54 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:31.922 09:29:54 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:31.922 09:29:54 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:31.922 00:06:31.922 real 0m0.189s 00:06:31.922 user 0m0.132s 00:06:31.922 sys 0m0.084s 00:06:31.922 09:29:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:31.922 09:29:54 -- common/autotest_common.sh@10 -- # set +x 00:06:31.922 ************************************ 00:06:31.922 END TEST version 00:06:31.922 ************************************ 00:06:31.922 09:29:54 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:31.922 09:29:54 -- spdk/autotest.sh@191 -- # uname -s 00:06:31.922 09:29:54 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:31.922 09:29:54 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:31.922 09:29:54 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:31.922 09:29:54 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:31.922 09:29:54 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:31.922 09:29:54 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:31.922 09:29:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:31.922 09:29:54 -- common/autotest_common.sh@10 -- # set +x 00:06:31.922 09:29:54 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:31.922 09:29:54 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:31.922 09:29:54 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:31.922 09:29:54 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:31.922 09:29:54 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:31.922 09:29:54 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:31.922 09:29:54 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:31.922 09:29:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:31.922 09:29:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.922 09:29:54 -- common/autotest_common.sh@10 -- # set +x 00:06:31.922 ************************************ 00:06:31.922 START TEST nvmf_tcp 00:06:31.922 ************************************ 00:06:31.922 09:29:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:31.922 * Looking for test storage... 00:06:31.922 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:31.923 09:29:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:31.923 09:29:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:31.923 09:29:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:32.217 09:29:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:32.217 09:29:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:32.217 09:29:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:32.217 09:29:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:32.217 09:29:54 -- scripts/common.sh@335 -- # IFS=.-: 00:06:32.217 09:29:54 -- scripts/common.sh@335 -- # read -ra ver1 00:06:32.217 09:29:54 -- scripts/common.sh@336 -- # IFS=.-: 00:06:32.217 09:29:54 -- scripts/common.sh@336 -- # read -ra ver2 00:06:32.217 09:29:54 -- scripts/common.sh@337 -- # local 'op=<' 00:06:32.217 09:29:54 -- scripts/common.sh@339 -- # ver1_l=2 00:06:32.217 09:29:54 -- scripts/common.sh@340 -- # ver2_l=1 00:06:32.217 09:29:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:32.217 09:29:54 -- scripts/common.sh@343 -- # case "$op" in 00:06:32.217 09:29:54 -- scripts/common.sh@344 -- # : 1 00:06:32.217 09:29:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:32.217 09:29:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:32.217 09:29:54 -- scripts/common.sh@364 -- # decimal 1 00:06:32.217 09:29:54 -- scripts/common.sh@352 -- # local d=1 00:06:32.217 09:29:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:32.218 09:29:54 -- scripts/common.sh@354 -- # echo 1 00:06:32.218 09:29:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:32.218 09:29:54 -- scripts/common.sh@365 -- # decimal 2 00:06:32.218 09:29:54 -- scripts/common.sh@352 -- # local d=2 00:06:32.218 09:29:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:32.218 09:29:54 -- scripts/common.sh@354 -- # echo 2 00:06:32.218 09:29:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:32.218 09:29:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:32.218 09:29:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:32.218 09:29:54 -- scripts/common.sh@367 -- # return 0 00:06:32.218 09:29:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:32.218 09:29:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:32.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.218 --rc genhtml_branch_coverage=1 00:06:32.218 --rc genhtml_function_coverage=1 00:06:32.218 --rc genhtml_legend=1 00:06:32.218 --rc geninfo_all_blocks=1 00:06:32.218 --rc geninfo_unexecuted_blocks=1 00:06:32.218 00:06:32.218 ' 00:06:32.218 09:29:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:32.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.218 --rc genhtml_branch_coverage=1 00:06:32.218 --rc genhtml_function_coverage=1 00:06:32.218 --rc genhtml_legend=1 00:06:32.218 --rc geninfo_all_blocks=1 00:06:32.218 --rc geninfo_unexecuted_blocks=1 00:06:32.218 00:06:32.218 ' 00:06:32.218 09:29:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:32.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.218 --rc genhtml_branch_coverage=1 00:06:32.218 --rc genhtml_function_coverage=1 00:06:32.218 --rc genhtml_legend=1 00:06:32.218 --rc geninfo_all_blocks=1 00:06:32.218 --rc geninfo_unexecuted_blocks=1 00:06:32.218 00:06:32.218 ' 00:06:32.218 09:29:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:32.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.218 --rc genhtml_branch_coverage=1 00:06:32.218 --rc genhtml_function_coverage=1 00:06:32.218 --rc genhtml_legend=1 00:06:32.218 --rc geninfo_all_blocks=1 00:06:32.218 --rc geninfo_unexecuted_blocks=1 00:06:32.218 00:06:32.218 ' 00:06:32.218 09:29:54 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:32.218 09:29:54 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:32.218 09:29:54 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:32.218 09:29:54 -- nvmf/common.sh@7 -- # uname -s 00:06:32.218 09:29:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:32.218 09:29:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:32.218 09:29:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:32.218 09:29:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:32.218 09:29:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:32.218 09:29:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:32.218 09:29:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:32.218 09:29:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:32.218 09:29:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:32.218 09:29:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:32.218 09:29:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:32.218 09:29:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:32.218 09:29:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:32.218 09:29:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:32.218 09:29:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:32.218 09:29:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:32.218 09:29:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:32.218 09:29:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:32.218 09:29:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:32.218 09:29:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.218 09:29:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.218 09:29:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.218 09:29:54 -- paths/export.sh@5 -- # export PATH 00:06:32.218 09:29:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.218 09:29:54 -- nvmf/common.sh@46 -- # : 0 00:06:32.218 09:29:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:32.218 09:29:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:32.218 09:29:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:32.218 09:29:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:32.218 09:29:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:32.218 09:29:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:32.218 09:29:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:32.218 09:29:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:32.218 09:29:54 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:32.218 09:29:54 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:32.218 09:29:54 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:32.218 09:29:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:32.218 09:29:54 -- common/autotest_common.sh@10 -- # set +x 00:06:32.218 09:29:54 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:32.218 09:29:54 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:32.218 09:29:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:32.218 09:29:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.218 09:29:54 -- common/autotest_common.sh@10 -- # set +x 00:06:32.218 ************************************ 00:06:32.218 START TEST nvmf_example 00:06:32.218 ************************************ 00:06:32.218 09:29:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:32.218 * Looking for test storage... 00:06:32.219 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:32.219 09:29:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:32.219 09:29:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:32.219 09:29:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:32.219 09:29:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:32.219 09:29:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:32.219 09:29:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:32.219 09:29:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:32.219 09:29:54 -- scripts/common.sh@335 -- # IFS=.-: 00:06:32.219 09:29:54 -- scripts/common.sh@335 -- # read -ra ver1 00:06:32.219 09:29:54 -- scripts/common.sh@336 -- # IFS=.-: 00:06:32.219 09:29:54 -- scripts/common.sh@336 -- # read -ra ver2 00:06:32.219 09:29:54 -- scripts/common.sh@337 -- # local 'op=<' 00:06:32.219 09:29:54 -- scripts/common.sh@339 -- # ver1_l=2 00:06:32.219 09:29:54 -- scripts/common.sh@340 -- # ver2_l=1 00:06:32.219 09:29:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:32.219 09:29:54 -- scripts/common.sh@343 -- # case "$op" in 00:06:32.219 09:29:54 -- scripts/common.sh@344 -- # : 1 00:06:32.219 09:29:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:32.219 09:29:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:32.219 09:29:54 -- scripts/common.sh@364 -- # decimal 1 00:06:32.219 09:29:54 -- scripts/common.sh@352 -- # local d=1 00:06:32.219 09:29:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:32.219 09:29:54 -- scripts/common.sh@354 -- # echo 1 00:06:32.219 09:29:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:32.219 09:29:54 -- scripts/common.sh@365 -- # decimal 2 00:06:32.219 09:29:54 -- scripts/common.sh@352 -- # local d=2 00:06:32.219 09:29:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:32.219 09:29:54 -- scripts/common.sh@354 -- # echo 2 00:06:32.219 09:29:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:32.219 09:29:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:32.219 09:29:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:32.219 09:29:54 -- scripts/common.sh@367 -- # return 0 00:06:32.219 09:29:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:32.219 09:29:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:32.219 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.219 --rc genhtml_branch_coverage=1 00:06:32.219 --rc genhtml_function_coverage=1 00:06:32.219 --rc genhtml_legend=1 00:06:32.219 --rc geninfo_all_blocks=1 00:06:32.219 --rc geninfo_unexecuted_blocks=1 00:06:32.219 00:06:32.219 ' 00:06:32.219 09:29:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:32.219 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.219 --rc genhtml_branch_coverage=1 00:06:32.219 --rc genhtml_function_coverage=1 00:06:32.219 --rc genhtml_legend=1 00:06:32.219 --rc geninfo_all_blocks=1 00:06:32.219 --rc geninfo_unexecuted_blocks=1 00:06:32.219 00:06:32.219 ' 00:06:32.219 09:29:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:32.219 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.219 --rc genhtml_branch_coverage=1 00:06:32.219 --rc genhtml_function_coverage=1 00:06:32.219 --rc genhtml_legend=1 00:06:32.219 --rc geninfo_all_blocks=1 00:06:32.219 --rc geninfo_unexecuted_blocks=1 00:06:32.219 00:06:32.219 ' 00:06:32.219 09:29:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:32.219 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.219 --rc genhtml_branch_coverage=1 00:06:32.219 --rc genhtml_function_coverage=1 00:06:32.219 --rc genhtml_legend=1 00:06:32.219 --rc geninfo_all_blocks=1 00:06:32.219 --rc geninfo_unexecuted_blocks=1 00:06:32.219 00:06:32.219 ' 00:06:32.219 09:29:54 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:32.219 09:29:54 -- nvmf/common.sh@7 -- # uname -s 00:06:32.219 09:29:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:32.219 09:29:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:32.219 09:29:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:32.219 09:29:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:32.219 09:29:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:32.219 09:29:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:32.219 09:29:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:32.219 09:29:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:32.219 09:29:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:32.219 09:29:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:32.219 09:29:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:32.219 09:29:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:32.219 09:29:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:32.219 09:29:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:32.219 09:29:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:32.219 09:29:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:32.219 09:29:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:32.219 09:29:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:32.219 09:29:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:32.219 09:29:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.219 09:29:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.219 09:29:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.219 09:29:54 -- paths/export.sh@5 -- # export PATH 00:06:32.220 09:29:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:32.220 09:29:54 -- nvmf/common.sh@46 -- # : 0 00:06:32.220 09:29:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:32.220 09:29:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:32.220 09:29:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:32.220 09:29:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:32.220 09:29:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:32.220 09:29:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:32.220 09:29:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:32.220 09:29:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:32.220 09:29:54 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:32.220 09:29:54 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:32.220 09:29:54 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:32.220 09:29:54 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:32.220 09:29:54 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:32.220 09:29:54 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:32.220 09:29:54 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:32.220 09:29:54 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:32.220 09:29:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:32.220 09:29:54 -- common/autotest_common.sh@10 -- # set +x 00:06:32.220 09:29:54 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:32.220 09:29:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:32.220 09:29:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:32.220 09:29:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:32.220 09:29:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:32.220 09:29:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:32.220 09:29:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:32.220 09:29:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:32.220 09:29:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:32.220 09:29:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:32.220 09:29:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:32.220 09:29:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:32.220 09:29:55 -- common/autotest_common.sh@10 -- # set +x 00:06:34.776 09:29:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:34.776 09:29:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:34.776 09:29:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:34.776 09:29:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:34.776 09:29:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:34.776 09:29:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:34.776 09:29:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:34.776 09:29:57 -- nvmf/common.sh@294 -- # net_devs=() 00:06:34.776 09:29:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:34.776 09:29:57 -- nvmf/common.sh@295 -- # e810=() 00:06:34.776 09:29:57 -- nvmf/common.sh@295 -- # local -ga e810 00:06:34.777 09:29:57 -- nvmf/common.sh@296 -- # x722=() 00:06:34.777 09:29:57 -- nvmf/common.sh@296 -- # local -ga x722 00:06:34.777 09:29:57 -- nvmf/common.sh@297 -- # mlx=() 00:06:34.777 09:29:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:34.777 09:29:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:34.777 09:29:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:34.777 09:29:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:34.777 09:29:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:34.777 09:29:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:34.777 09:29:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:34.777 09:29:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:34.777 09:29:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:34.777 09:29:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:34.777 09:29:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:34.777 09:29:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:34.777 09:29:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:34.777 09:29:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:34.777 09:29:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:34.777 09:29:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:34.777 09:29:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:34.777 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:34.777 09:29:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:34.777 09:29:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:34.777 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:34.777 09:29:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:34.777 09:29:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:34.777 09:29:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:34.777 09:29:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:34.777 09:29:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:34.777 09:29:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:34.777 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:34.777 09:29:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:34.777 09:29:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:34.777 09:29:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:34.777 09:29:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:34.777 09:29:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:34.777 09:29:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:34.777 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:34.777 09:29:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:34.777 09:29:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:34.777 09:29:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:34.777 09:29:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:34.777 09:29:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:34.777 09:29:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:34.777 09:29:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:34.777 09:29:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:34.777 09:29:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:34.777 09:29:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:34.777 09:29:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:34.777 09:29:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:34.777 09:29:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:34.777 09:29:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:34.777 09:29:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:34.777 09:29:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:34.777 09:29:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:34.777 09:29:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:34.777 09:29:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:34.777 09:29:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:34.777 09:29:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:34.777 09:29:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:34.777 09:29:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:34.777 09:29:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:34.777 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:34.777 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.350 ms 00:06:34.777 00:06:34.777 --- 10.0.0.2 ping statistics --- 00:06:34.777 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:34.777 rtt min/avg/max/mdev = 0.350/0.350/0.350/0.000 ms 00:06:34.777 09:29:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:34.777 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:34.777 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:06:34.777 00:06:34.777 --- 10.0.0.1 ping statistics --- 00:06:34.777 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:34.777 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:06:34.777 09:29:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:34.777 09:29:57 -- nvmf/common.sh@410 -- # return 0 00:06:34.777 09:29:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:34.777 09:29:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:34.777 09:29:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:34.777 09:29:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:34.777 09:29:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:34.777 09:29:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:34.777 09:29:57 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:34.777 09:29:57 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:34.777 09:29:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:34.777 09:29:57 -- common/autotest_common.sh@10 -- # set +x 00:06:34.777 09:29:57 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:34.777 09:29:57 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:34.777 09:29:57 -- target/nvmf_example.sh@34 -- # nvmfpid=4116898 00:06:34.777 09:29:57 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:34.777 09:29:57 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:34.777 09:29:57 -- target/nvmf_example.sh@36 -- # waitforlisten 4116898 00:06:34.777 09:29:57 -- common/autotest_common.sh@829 -- # '[' -z 4116898 ']' 00:06:34.777 09:29:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:34.777 09:29:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:34.777 09:29:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:34.777 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:34.777 09:29:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:34.777 09:29:57 -- common/autotest_common.sh@10 -- # set +x 00:06:34.777 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.715 09:29:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:35.715 09:29:58 -- common/autotest_common.sh@862 -- # return 0 00:06:35.715 09:29:58 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:35.715 09:29:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:35.715 09:29:58 -- common/autotest_common.sh@10 -- # set +x 00:06:35.715 09:29:58 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:35.715 09:29:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:35.715 09:29:58 -- common/autotest_common.sh@10 -- # set +x 00:06:35.715 09:29:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:35.715 09:29:58 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:35.715 09:29:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:35.715 09:29:58 -- common/autotest_common.sh@10 -- # set +x 00:06:35.715 09:29:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:35.715 09:29:58 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:35.715 09:29:58 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:35.715 09:29:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:35.715 09:29:58 -- common/autotest_common.sh@10 -- # set +x 00:06:35.715 09:29:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:35.715 09:29:58 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:35.715 09:29:58 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:35.715 09:29:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:35.715 09:29:58 -- common/autotest_common.sh@10 -- # set +x 00:06:35.715 09:29:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:35.715 09:29:58 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:35.715 09:29:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:35.715 09:29:58 -- common/autotest_common.sh@10 -- # set +x 00:06:35.715 09:29:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:35.715 09:29:58 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:35.715 09:29:58 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:35.715 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.693 Initializing NVMe Controllers 00:06:45.693 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:45.693 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:45.693 Initialization complete. Launching workers. 00:06:45.693 ======================================================== 00:06:45.693 Latency(us) 00:06:45.693 Device Information : IOPS MiB/s Average min max 00:06:45.693 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15819.90 61.80 4045.54 637.98 16013.10 00:06:45.693 ======================================================== 00:06:45.693 Total : 15819.90 61.80 4045.54 637.98 16013.10 00:06:45.693 00:06:45.693 09:30:08 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:45.693 09:30:08 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:45.693 09:30:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:45.693 09:30:08 -- nvmf/common.sh@116 -- # sync 00:06:45.693 09:30:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:45.693 09:30:08 -- nvmf/common.sh@119 -- # set +e 00:06:45.693 09:30:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:45.693 09:30:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:45.693 rmmod nvme_tcp 00:06:45.952 rmmod nvme_fabrics 00:06:45.952 rmmod nvme_keyring 00:06:45.952 09:30:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:45.952 09:30:08 -- nvmf/common.sh@123 -- # set -e 00:06:45.952 09:30:08 -- nvmf/common.sh@124 -- # return 0 00:06:45.952 09:30:08 -- nvmf/common.sh@477 -- # '[' -n 4116898 ']' 00:06:45.952 09:30:08 -- nvmf/common.sh@478 -- # killprocess 4116898 00:06:45.952 09:30:08 -- common/autotest_common.sh@936 -- # '[' -z 4116898 ']' 00:06:45.952 09:30:08 -- common/autotest_common.sh@940 -- # kill -0 4116898 00:06:45.952 09:30:08 -- common/autotest_common.sh@941 -- # uname 00:06:45.952 09:30:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:45.952 09:30:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4116898 00:06:45.952 09:30:08 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:45.952 09:30:08 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:45.952 09:30:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4116898' 00:06:45.952 killing process with pid 4116898 00:06:45.952 09:30:08 -- common/autotest_common.sh@955 -- # kill 4116898 00:06:45.952 09:30:08 -- common/autotest_common.sh@960 -- # wait 4116898 00:06:46.213 nvmf threads initialize successfully 00:06:46.213 bdev subsystem init successfully 00:06:46.213 created a nvmf target service 00:06:46.213 create targets's poll groups done 00:06:46.213 all subsystems of target started 00:06:46.213 nvmf target is running 00:06:46.213 all subsystems of target stopped 00:06:46.213 destroy targets's poll groups done 00:06:46.213 destroyed the nvmf target service 00:06:46.213 bdev subsystem finish successfully 00:06:46.213 nvmf threads destroy successfully 00:06:46.213 09:30:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:46.213 09:30:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:46.213 09:30:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:46.213 09:30:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:46.213 09:30:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:46.213 09:30:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:46.213 09:30:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:46.213 09:30:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:48.123 09:30:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:48.123 09:30:10 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:48.123 09:30:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:48.123 09:30:10 -- common/autotest_common.sh@10 -- # set +x 00:06:48.123 00:06:48.123 real 0m16.078s 00:06:48.123 user 0m45.328s 00:06:48.123 sys 0m3.278s 00:06:48.123 09:30:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:48.123 09:30:10 -- common/autotest_common.sh@10 -- # set +x 00:06:48.123 ************************************ 00:06:48.123 END TEST nvmf_example 00:06:48.123 ************************************ 00:06:48.123 09:30:10 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:48.123 09:30:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:48.123 09:30:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.123 09:30:10 -- common/autotest_common.sh@10 -- # set +x 00:06:48.123 ************************************ 00:06:48.123 START TEST nvmf_filesystem 00:06:48.123 ************************************ 00:06:48.123 09:30:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:48.383 * Looking for test storage... 00:06:48.383 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:48.383 09:30:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:48.383 09:30:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:48.383 09:30:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:48.383 09:30:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:48.383 09:30:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:48.383 09:30:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:48.383 09:30:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:48.383 09:30:11 -- scripts/common.sh@335 -- # IFS=.-: 00:06:48.383 09:30:11 -- scripts/common.sh@335 -- # read -ra ver1 00:06:48.383 09:30:11 -- scripts/common.sh@336 -- # IFS=.-: 00:06:48.383 09:30:11 -- scripts/common.sh@336 -- # read -ra ver2 00:06:48.383 09:30:11 -- scripts/common.sh@337 -- # local 'op=<' 00:06:48.383 09:30:11 -- scripts/common.sh@339 -- # ver1_l=2 00:06:48.383 09:30:11 -- scripts/common.sh@340 -- # ver2_l=1 00:06:48.383 09:30:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:48.383 09:30:11 -- scripts/common.sh@343 -- # case "$op" in 00:06:48.383 09:30:11 -- scripts/common.sh@344 -- # : 1 00:06:48.383 09:30:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:48.383 09:30:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:48.383 09:30:11 -- scripts/common.sh@364 -- # decimal 1 00:06:48.383 09:30:11 -- scripts/common.sh@352 -- # local d=1 00:06:48.383 09:30:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:48.383 09:30:11 -- scripts/common.sh@354 -- # echo 1 00:06:48.383 09:30:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:48.383 09:30:11 -- scripts/common.sh@365 -- # decimal 2 00:06:48.383 09:30:11 -- scripts/common.sh@352 -- # local d=2 00:06:48.383 09:30:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:48.383 09:30:11 -- scripts/common.sh@354 -- # echo 2 00:06:48.383 09:30:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:48.383 09:30:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:48.383 09:30:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:48.383 09:30:11 -- scripts/common.sh@367 -- # return 0 00:06:48.383 09:30:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:48.383 09:30:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:48.383 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.383 --rc genhtml_branch_coverage=1 00:06:48.383 --rc genhtml_function_coverage=1 00:06:48.383 --rc genhtml_legend=1 00:06:48.383 --rc geninfo_all_blocks=1 00:06:48.383 --rc geninfo_unexecuted_blocks=1 00:06:48.383 00:06:48.383 ' 00:06:48.383 09:30:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:48.383 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.383 --rc genhtml_branch_coverage=1 00:06:48.383 --rc genhtml_function_coverage=1 00:06:48.384 --rc genhtml_legend=1 00:06:48.384 --rc geninfo_all_blocks=1 00:06:48.384 --rc geninfo_unexecuted_blocks=1 00:06:48.384 00:06:48.384 ' 00:06:48.384 09:30:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:48.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.384 --rc genhtml_branch_coverage=1 00:06:48.384 --rc genhtml_function_coverage=1 00:06:48.384 --rc genhtml_legend=1 00:06:48.384 --rc geninfo_all_blocks=1 00:06:48.384 --rc geninfo_unexecuted_blocks=1 00:06:48.384 00:06:48.384 ' 00:06:48.384 09:30:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:48.384 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.384 --rc genhtml_branch_coverage=1 00:06:48.384 --rc genhtml_function_coverage=1 00:06:48.384 --rc genhtml_legend=1 00:06:48.384 --rc geninfo_all_blocks=1 00:06:48.384 --rc geninfo_unexecuted_blocks=1 00:06:48.384 00:06:48.384 ' 00:06:48.384 09:30:11 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:48.384 09:30:11 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:48.384 09:30:11 -- common/autotest_common.sh@34 -- # set -e 00:06:48.384 09:30:11 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:48.384 09:30:11 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:48.384 09:30:11 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:48.384 09:30:11 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:48.384 09:30:11 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:48.384 09:30:11 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:48.384 09:30:11 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:48.384 09:30:11 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:48.384 09:30:11 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:48.384 09:30:11 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:48.384 09:30:11 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:48.384 09:30:11 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:48.384 09:30:11 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:48.384 09:30:11 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:48.384 09:30:11 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:48.384 09:30:11 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:48.384 09:30:11 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:48.384 09:30:11 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:48.384 09:30:11 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:48.384 09:30:11 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:48.384 09:30:11 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:48.384 09:30:11 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:48.384 09:30:11 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:48.384 09:30:11 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:48.384 09:30:11 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:48.384 09:30:11 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:48.384 09:30:11 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:48.384 09:30:11 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:48.384 09:30:11 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:48.384 09:30:11 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:48.384 09:30:11 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:48.384 09:30:11 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:48.384 09:30:11 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:48.384 09:30:11 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:48.384 09:30:11 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:48.384 09:30:11 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:48.384 09:30:11 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:48.384 09:30:11 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:48.384 09:30:11 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:48.384 09:30:11 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:48.384 09:30:11 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:48.384 09:30:11 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:48.384 09:30:11 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:48.384 09:30:11 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:48.384 09:30:11 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:48.384 09:30:11 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:48.384 09:30:11 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:48.384 09:30:11 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:48.384 09:30:11 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:48.384 09:30:11 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:48.384 09:30:11 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:48.384 09:30:11 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:48.384 09:30:11 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:48.384 09:30:11 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:48.384 09:30:11 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:48.384 09:30:11 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:48.384 09:30:11 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:48.384 09:30:11 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:48.384 09:30:11 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:48.384 09:30:11 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:48.384 09:30:11 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:48.384 09:30:11 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:48.384 09:30:11 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:48.384 09:30:11 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:48.384 09:30:11 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:48.384 09:30:11 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:48.384 09:30:11 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:48.384 09:30:11 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:48.384 09:30:11 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:48.384 09:30:11 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:48.384 09:30:11 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:48.384 09:30:11 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:48.384 09:30:11 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:48.384 09:30:11 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:48.384 09:30:11 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:48.384 09:30:11 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:48.384 09:30:11 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:48.384 09:30:11 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:48.384 09:30:11 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:48.384 09:30:11 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:48.384 09:30:11 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:48.384 09:30:11 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:48.384 09:30:11 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:48.384 09:30:11 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:48.384 09:30:11 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:48.384 09:30:11 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:48.384 09:30:11 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:48.384 09:30:11 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:48.384 09:30:11 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:48.385 09:30:11 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:48.385 09:30:11 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:48.385 09:30:11 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:48.385 09:30:11 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:48.385 09:30:11 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:48.385 09:30:11 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:48.385 09:30:11 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:48.385 09:30:11 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:48.385 09:30:11 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:48.385 09:30:11 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:48.385 #define SPDK_CONFIG_H 00:06:48.385 #define SPDK_CONFIG_APPS 1 00:06:48.385 #define SPDK_CONFIG_ARCH native 00:06:48.385 #undef SPDK_CONFIG_ASAN 00:06:48.385 #undef SPDK_CONFIG_AVAHI 00:06:48.385 #undef SPDK_CONFIG_CET 00:06:48.385 #define SPDK_CONFIG_COVERAGE 1 00:06:48.385 #define SPDK_CONFIG_CROSS_PREFIX 00:06:48.385 #undef SPDK_CONFIG_CRYPTO 00:06:48.385 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:48.385 #undef SPDK_CONFIG_CUSTOMOCF 00:06:48.385 #undef SPDK_CONFIG_DAOS 00:06:48.385 #define SPDK_CONFIG_DAOS_DIR 00:06:48.385 #define SPDK_CONFIG_DEBUG 1 00:06:48.385 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:48.385 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:48.385 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:48.385 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:48.385 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:48.385 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:48.385 #define SPDK_CONFIG_EXAMPLES 1 00:06:48.385 #undef SPDK_CONFIG_FC 00:06:48.385 #define SPDK_CONFIG_FC_PATH 00:06:48.385 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:48.385 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:48.385 #undef SPDK_CONFIG_FUSE 00:06:48.385 #undef SPDK_CONFIG_FUZZER 00:06:48.385 #define SPDK_CONFIG_FUZZER_LIB 00:06:48.385 #undef SPDK_CONFIG_GOLANG 00:06:48.385 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:48.385 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:48.385 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:48.385 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:48.385 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:48.385 #define SPDK_CONFIG_IDXD 1 00:06:48.385 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:48.385 #undef SPDK_CONFIG_IPSEC_MB 00:06:48.385 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:48.385 #define SPDK_CONFIG_ISAL 1 00:06:48.385 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:48.385 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:48.385 #define SPDK_CONFIG_LIBDIR 00:06:48.385 #undef SPDK_CONFIG_LTO 00:06:48.385 #define SPDK_CONFIG_MAX_LCORES 00:06:48.385 #define SPDK_CONFIG_NVME_CUSE 1 00:06:48.385 #undef SPDK_CONFIG_OCF 00:06:48.385 #define SPDK_CONFIG_OCF_PATH 00:06:48.385 #define SPDK_CONFIG_OPENSSL_PATH 00:06:48.385 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:48.385 #undef SPDK_CONFIG_PGO_USE 00:06:48.385 #define SPDK_CONFIG_PREFIX /usr/local 00:06:48.385 #undef SPDK_CONFIG_RAID5F 00:06:48.385 #undef SPDK_CONFIG_RBD 00:06:48.385 #define SPDK_CONFIG_RDMA 1 00:06:48.385 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:48.385 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:48.385 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:48.385 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:48.385 #define SPDK_CONFIG_SHARED 1 00:06:48.385 #undef SPDK_CONFIG_SMA 00:06:48.385 #define SPDK_CONFIG_TESTS 1 00:06:48.385 #undef SPDK_CONFIG_TSAN 00:06:48.385 #define SPDK_CONFIG_UBLK 1 00:06:48.385 #define SPDK_CONFIG_UBSAN 1 00:06:48.385 #undef SPDK_CONFIG_UNIT_TESTS 00:06:48.385 #undef SPDK_CONFIG_URING 00:06:48.385 #define SPDK_CONFIG_URING_PATH 00:06:48.385 #undef SPDK_CONFIG_URING_ZNS 00:06:48.385 #undef SPDK_CONFIG_USDT 00:06:48.385 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:48.385 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:48.385 #undef SPDK_CONFIG_VFIO_USER 00:06:48.385 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:48.385 #define SPDK_CONFIG_VHOST 1 00:06:48.385 #define SPDK_CONFIG_VIRTIO 1 00:06:48.385 #undef SPDK_CONFIG_VTUNE 00:06:48.385 #define SPDK_CONFIG_VTUNE_DIR 00:06:48.385 #define SPDK_CONFIG_WERROR 1 00:06:48.385 #define SPDK_CONFIG_WPDK_DIR 00:06:48.385 #undef SPDK_CONFIG_XNVME 00:06:48.385 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:48.385 09:30:11 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:48.385 09:30:11 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:48.385 09:30:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:48.385 09:30:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:48.385 09:30:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:48.385 09:30:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:48.385 09:30:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:48.385 09:30:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:48.385 09:30:11 -- paths/export.sh@5 -- # export PATH 00:06:48.385 09:30:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:48.385 09:30:11 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:48.385 09:30:11 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:48.385 09:30:11 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:48.385 09:30:11 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:48.385 09:30:11 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:48.385 09:30:11 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:48.385 09:30:11 -- pm/common@16 -- # TEST_TAG=N/A 00:06:48.385 09:30:11 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:48.385 09:30:11 -- common/autotest_common.sh@52 -- # : 1 00:06:48.385 09:30:11 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:48.385 09:30:11 -- common/autotest_common.sh@56 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:48.386 09:30:11 -- common/autotest_common.sh@58 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:48.386 09:30:11 -- common/autotest_common.sh@60 -- # : 1 00:06:48.386 09:30:11 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:48.386 09:30:11 -- common/autotest_common.sh@62 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:48.386 09:30:11 -- common/autotest_common.sh@64 -- # : 00:06:48.386 09:30:11 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:48.386 09:30:11 -- common/autotest_common.sh@66 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:48.386 09:30:11 -- common/autotest_common.sh@68 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:48.386 09:30:11 -- common/autotest_common.sh@70 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:48.386 09:30:11 -- common/autotest_common.sh@72 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:48.386 09:30:11 -- common/autotest_common.sh@74 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:48.386 09:30:11 -- common/autotest_common.sh@76 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:48.386 09:30:11 -- common/autotest_common.sh@78 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:48.386 09:30:11 -- common/autotest_common.sh@80 -- # : 1 00:06:48.386 09:30:11 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:48.386 09:30:11 -- common/autotest_common.sh@82 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:48.386 09:30:11 -- common/autotest_common.sh@84 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:48.386 09:30:11 -- common/autotest_common.sh@86 -- # : 1 00:06:48.386 09:30:11 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:48.386 09:30:11 -- common/autotest_common.sh@88 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:48.386 09:30:11 -- common/autotest_common.sh@90 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:48.386 09:30:11 -- common/autotest_common.sh@92 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:48.386 09:30:11 -- common/autotest_common.sh@94 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:48.386 09:30:11 -- common/autotest_common.sh@96 -- # : tcp 00:06:48.386 09:30:11 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:48.386 09:30:11 -- common/autotest_common.sh@98 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:48.386 09:30:11 -- common/autotest_common.sh@100 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:48.386 09:30:11 -- common/autotest_common.sh@102 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:48.386 09:30:11 -- common/autotest_common.sh@104 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:48.386 09:30:11 -- common/autotest_common.sh@106 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:48.386 09:30:11 -- common/autotest_common.sh@108 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:48.386 09:30:11 -- common/autotest_common.sh@110 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:48.386 09:30:11 -- common/autotest_common.sh@112 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:48.386 09:30:11 -- common/autotest_common.sh@114 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:48.386 09:30:11 -- common/autotest_common.sh@116 -- # : 1 00:06:48.386 09:30:11 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:48.386 09:30:11 -- common/autotest_common.sh@118 -- # : 00:06:48.386 09:30:11 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:48.386 09:30:11 -- common/autotest_common.sh@120 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:48.386 09:30:11 -- common/autotest_common.sh@122 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:48.386 09:30:11 -- common/autotest_common.sh@124 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:48.386 09:30:11 -- common/autotest_common.sh@126 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:48.386 09:30:11 -- common/autotest_common.sh@128 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:48.386 09:30:11 -- common/autotest_common.sh@130 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:48.386 09:30:11 -- common/autotest_common.sh@132 -- # : 00:06:48.386 09:30:11 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:48.386 09:30:11 -- common/autotest_common.sh@134 -- # : true 00:06:48.386 09:30:11 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:48.386 09:30:11 -- common/autotest_common.sh@136 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:48.386 09:30:11 -- common/autotest_common.sh@138 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:48.386 09:30:11 -- common/autotest_common.sh@140 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:48.386 09:30:11 -- common/autotest_common.sh@142 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:48.386 09:30:11 -- common/autotest_common.sh@144 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:48.386 09:30:11 -- common/autotest_common.sh@146 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:48.386 09:30:11 -- common/autotest_common.sh@148 -- # : e810 00:06:48.386 09:30:11 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:48.386 09:30:11 -- common/autotest_common.sh@150 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:48.386 09:30:11 -- common/autotest_common.sh@152 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:48.386 09:30:11 -- common/autotest_common.sh@154 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:48.386 09:30:11 -- common/autotest_common.sh@156 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:48.386 09:30:11 -- common/autotest_common.sh@158 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:48.386 09:30:11 -- common/autotest_common.sh@160 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:48.386 09:30:11 -- common/autotest_common.sh@163 -- # : 00:06:48.386 09:30:11 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:48.386 09:30:11 -- common/autotest_common.sh@165 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:48.386 09:30:11 -- common/autotest_common.sh@167 -- # : 0 00:06:48.386 09:30:11 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:48.386 09:30:11 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:48.386 09:30:11 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:48.386 09:30:11 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:48.386 09:30:11 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:48.386 09:30:11 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:48.387 09:30:11 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:48.387 09:30:11 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:48.387 09:30:11 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:48.387 09:30:11 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:48.387 09:30:11 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:48.387 09:30:11 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:48.387 09:30:11 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:48.387 09:30:11 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:48.387 09:30:11 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:48.387 09:30:11 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:48.387 09:30:11 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:48.387 09:30:11 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:48.387 09:30:11 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:48.387 09:30:11 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:48.387 09:30:11 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:48.387 09:30:11 -- common/autotest_common.sh@196 -- # cat 00:06:48.387 09:30:11 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:48.387 09:30:11 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:48.387 09:30:11 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:48.387 09:30:11 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:48.387 09:30:11 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:48.387 09:30:11 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:48.387 09:30:11 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:48.387 09:30:11 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:48.387 09:30:11 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:48.387 09:30:11 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:48.387 09:30:11 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:48.387 09:30:11 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:48.387 09:30:11 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:48.387 09:30:11 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:48.387 09:30:11 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:48.387 09:30:11 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:48.387 09:30:11 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:48.387 09:30:11 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:48.387 09:30:11 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:48.387 09:30:11 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:48.387 09:30:11 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:48.387 09:30:11 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:48.387 09:30:11 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:48.387 09:30:11 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:48.387 09:30:11 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:48.387 09:30:11 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:48.387 09:30:11 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:48.387 09:30:11 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:48.387 09:30:11 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:48.387 09:30:11 -- common/autotest_common.sh@259 -- # valgrind= 00:06:48.387 09:30:11 -- common/autotest_common.sh@265 -- # uname -s 00:06:48.387 09:30:11 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:48.387 09:30:11 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:48.387 09:30:11 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:48.387 09:30:11 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:48.387 09:30:11 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:48.387 09:30:11 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:48.387 09:30:11 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:48.387 09:30:11 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:48.387 09:30:11 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:48.387 09:30:11 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:48.387 09:30:11 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:48.387 09:30:11 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:48.387 09:30:11 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:48.387 09:30:11 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:48.387 09:30:11 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:48.387 09:30:11 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:48.387 09:30:11 -- common/autotest_common.sh@319 -- # [[ -z 4119299 ]] 00:06:48.387 09:30:11 -- common/autotest_common.sh@319 -- # kill -0 4119299 00:06:48.387 09:30:11 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:48.387 09:30:11 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:48.387 09:30:11 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:48.387 09:30:11 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:48.387 09:30:11 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:48.387 09:30:11 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:48.387 09:30:11 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:48.387 09:30:11 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:48.387 09:30:11 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.ljC695 00:06:48.387 09:30:11 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:48.387 09:30:11 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:48.387 09:30:11 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:48.387 09:30:11 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.ljC695/tests/target /tmp/spdk.ljC695 00:06:48.387 09:30:11 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:48.388 09:30:11 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:48.388 09:30:11 -- common/autotest_common.sh@328 -- # df -T 00:06:48.388 09:30:11 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:48.388 09:30:11 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:48.388 09:30:11 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:48.388 09:30:11 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:48.388 09:30:11 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:48.388 09:30:11 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:48.388 09:30:11 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:48.388 09:30:11 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:48.388 09:30:11 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:48.388 09:30:11 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:48.388 09:30:11 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:48.388 09:30:11 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:48.388 09:30:11 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:48.388 09:30:11 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:48.388 09:30:11 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:48.388 09:30:11 -- common/autotest_common.sh@363 -- # avails["$mount"]=55263469568 00:06:48.388 09:30:11 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988519936 00:06:48.388 09:30:11 -- common/autotest_common.sh@364 -- # uses["$mount"]=6725050368 00:06:48.388 09:30:11 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:48.388 09:30:11 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:48.388 09:30:11 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:48.388 09:30:11 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991667200 00:06:48.388 09:30:11 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:06:48.388 09:30:11 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:48.388 09:30:11 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:48.388 09:30:11 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:48.388 09:30:11 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:48.388 09:30:11 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:06:48.388 09:30:11 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:06:48.388 09:30:11 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:48.388 09:30:11 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:48.388 09:30:11 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:48.388 09:30:11 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:48.388 09:30:11 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993690624 00:06:48.388 09:30:11 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:06:48.388 09:30:11 -- common/autotest_common.sh@364 -- # uses["$mount"]=569344 00:06:48.388 09:30:11 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:48.388 09:30:11 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:48.388 09:30:11 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:48.388 09:30:11 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:48.388 09:30:11 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:48.388 09:30:11 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:48.388 09:30:11 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:48.388 09:30:11 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:48.388 * Looking for test storage... 00:06:48.388 09:30:11 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:48.388 09:30:11 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:48.388 09:30:11 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:48.388 09:30:11 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:48.388 09:30:11 -- common/autotest_common.sh@373 -- # mount=/ 00:06:48.388 09:30:11 -- common/autotest_common.sh@375 -- # target_space=55263469568 00:06:48.388 09:30:11 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:48.388 09:30:11 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:48.388 09:30:11 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:48.388 09:30:11 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:48.388 09:30:11 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:48.388 09:30:11 -- common/autotest_common.sh@382 -- # new_size=8939642880 00:06:48.388 09:30:11 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:48.388 09:30:11 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:48.388 09:30:11 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:48.388 09:30:11 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:48.388 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:48.388 09:30:11 -- common/autotest_common.sh@390 -- # return 0 00:06:48.388 09:30:11 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:48.388 09:30:11 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:48.388 09:30:11 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:48.388 09:30:11 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:48.388 09:30:11 -- common/autotest_common.sh@1682 -- # true 00:06:48.388 09:30:11 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:48.388 09:30:11 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:48.388 09:30:11 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:48.388 09:30:11 -- common/autotest_common.sh@27 -- # exec 00:06:48.388 09:30:11 -- common/autotest_common.sh@29 -- # exec 00:06:48.388 09:30:11 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:48.388 09:30:11 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:48.388 09:30:11 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:48.388 09:30:11 -- common/autotest_common.sh@18 -- # set -x 00:06:48.388 09:30:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:48.388 09:30:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:48.388 09:30:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:48.647 09:30:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:48.647 09:30:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:48.647 09:30:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:48.647 09:30:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:48.647 09:30:11 -- scripts/common.sh@335 -- # IFS=.-: 00:06:48.647 09:30:11 -- scripts/common.sh@335 -- # read -ra ver1 00:06:48.647 09:30:11 -- scripts/common.sh@336 -- # IFS=.-: 00:06:48.647 09:30:11 -- scripts/common.sh@336 -- # read -ra ver2 00:06:48.647 09:30:11 -- scripts/common.sh@337 -- # local 'op=<' 00:06:48.647 09:30:11 -- scripts/common.sh@339 -- # ver1_l=2 00:06:48.647 09:30:11 -- scripts/common.sh@340 -- # ver2_l=1 00:06:48.647 09:30:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:48.647 09:30:11 -- scripts/common.sh@343 -- # case "$op" in 00:06:48.647 09:30:11 -- scripts/common.sh@344 -- # : 1 00:06:48.647 09:30:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:48.647 09:30:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:48.647 09:30:11 -- scripts/common.sh@364 -- # decimal 1 00:06:48.647 09:30:11 -- scripts/common.sh@352 -- # local d=1 00:06:48.647 09:30:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:48.647 09:30:11 -- scripts/common.sh@354 -- # echo 1 00:06:48.647 09:30:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:48.647 09:30:11 -- scripts/common.sh@365 -- # decimal 2 00:06:48.647 09:30:11 -- scripts/common.sh@352 -- # local d=2 00:06:48.647 09:30:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:48.647 09:30:11 -- scripts/common.sh@354 -- # echo 2 00:06:48.648 09:30:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:48.648 09:30:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:48.648 09:30:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:48.648 09:30:11 -- scripts/common.sh@367 -- # return 0 00:06:48.648 09:30:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:48.648 09:30:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:48.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.648 --rc genhtml_branch_coverage=1 00:06:48.648 --rc genhtml_function_coverage=1 00:06:48.648 --rc genhtml_legend=1 00:06:48.648 --rc geninfo_all_blocks=1 00:06:48.648 --rc geninfo_unexecuted_blocks=1 00:06:48.648 00:06:48.648 ' 00:06:48.648 09:30:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:48.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.648 --rc genhtml_branch_coverage=1 00:06:48.648 --rc genhtml_function_coverage=1 00:06:48.648 --rc genhtml_legend=1 00:06:48.648 --rc geninfo_all_blocks=1 00:06:48.648 --rc geninfo_unexecuted_blocks=1 00:06:48.648 00:06:48.648 ' 00:06:48.648 09:30:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:48.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.648 --rc genhtml_branch_coverage=1 00:06:48.648 --rc genhtml_function_coverage=1 00:06:48.648 --rc genhtml_legend=1 00:06:48.648 --rc geninfo_all_blocks=1 00:06:48.648 --rc geninfo_unexecuted_blocks=1 00:06:48.648 00:06:48.648 ' 00:06:48.648 09:30:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:48.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.648 --rc genhtml_branch_coverage=1 00:06:48.648 --rc genhtml_function_coverage=1 00:06:48.648 --rc genhtml_legend=1 00:06:48.648 --rc geninfo_all_blocks=1 00:06:48.648 --rc geninfo_unexecuted_blocks=1 00:06:48.648 00:06:48.648 ' 00:06:48.648 09:30:11 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:48.648 09:30:11 -- nvmf/common.sh@7 -- # uname -s 00:06:48.648 09:30:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:48.648 09:30:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:48.648 09:30:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:48.648 09:30:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:48.648 09:30:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:48.648 09:30:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:48.648 09:30:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:48.648 09:30:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:48.648 09:30:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:48.648 09:30:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:48.648 09:30:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:48.648 09:30:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:48.648 09:30:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:48.648 09:30:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:48.648 09:30:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:48.648 09:30:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:48.648 09:30:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:48.648 09:30:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:48.648 09:30:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:48.648 09:30:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:48.648 09:30:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:48.648 09:30:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:48.648 09:30:11 -- paths/export.sh@5 -- # export PATH 00:06:48.648 09:30:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:48.648 09:30:11 -- nvmf/common.sh@46 -- # : 0 00:06:48.648 09:30:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:48.648 09:30:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:48.648 09:30:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:48.648 09:30:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:48.648 09:30:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:48.648 09:30:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:48.648 09:30:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:48.648 09:30:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:48.648 09:30:11 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:48.648 09:30:11 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:48.648 09:30:11 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:48.648 09:30:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:48.648 09:30:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:48.648 09:30:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:48.648 09:30:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:48.648 09:30:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:48.648 09:30:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:48.648 09:30:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:48.648 09:30:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:48.648 09:30:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:48.648 09:30:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:48.648 09:30:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:48.648 09:30:11 -- common/autotest_common.sh@10 -- # set +x 00:06:50.557 09:30:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:50.557 09:30:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:50.557 09:30:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:50.557 09:30:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:50.557 09:30:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:50.557 09:30:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:50.557 09:30:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:50.557 09:30:13 -- nvmf/common.sh@294 -- # net_devs=() 00:06:50.557 09:30:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:50.557 09:30:13 -- nvmf/common.sh@295 -- # e810=() 00:06:50.557 09:30:13 -- nvmf/common.sh@295 -- # local -ga e810 00:06:50.557 09:30:13 -- nvmf/common.sh@296 -- # x722=() 00:06:50.557 09:30:13 -- nvmf/common.sh@296 -- # local -ga x722 00:06:50.557 09:30:13 -- nvmf/common.sh@297 -- # mlx=() 00:06:50.557 09:30:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:50.557 09:30:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:50.557 09:30:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:50.557 09:30:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:50.557 09:30:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:50.557 09:30:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:50.557 09:30:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:50.557 09:30:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:50.557 09:30:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:50.557 09:30:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:50.557 09:30:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:50.557 09:30:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:50.557 09:30:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:50.557 09:30:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:50.557 09:30:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:50.557 09:30:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:50.557 09:30:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:50.557 09:30:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:50.557 09:30:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:50.557 09:30:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:50.558 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:50.558 09:30:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:50.558 09:30:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:50.558 09:30:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:50.558 09:30:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:50.558 09:30:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:50.558 09:30:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:50.558 09:30:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:50.558 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:50.558 09:30:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:50.558 09:30:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:50.558 09:30:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:50.558 09:30:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:50.558 09:30:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:50.558 09:30:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:50.558 09:30:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:50.558 09:30:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:50.558 09:30:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:50.558 09:30:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:50.558 09:30:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:50.558 09:30:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:50.558 09:30:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:50.558 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:50.558 09:30:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:50.558 09:30:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:50.558 09:30:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:50.558 09:30:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:50.558 09:30:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:50.558 09:30:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:50.558 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:50.558 09:30:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:50.558 09:30:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:50.558 09:30:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:50.558 09:30:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:50.558 09:30:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:50.558 09:30:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:50.558 09:30:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:50.558 09:30:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:50.558 09:30:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:50.558 09:30:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:50.558 09:30:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:50.558 09:30:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:50.558 09:30:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:50.558 09:30:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:50.558 09:30:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:50.558 09:30:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:50.558 09:30:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:50.558 09:30:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:50.558 09:30:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:50.818 09:30:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:50.819 09:30:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:50.819 09:30:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:50.819 09:30:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:50.819 09:30:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:50.819 09:30:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:50.819 09:30:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:50.819 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:50.819 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.213 ms 00:06:50.819 00:06:50.819 --- 10.0.0.2 ping statistics --- 00:06:50.819 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:50.819 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:06:50.819 09:30:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:50.819 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:50.819 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:06:50.819 00:06:50.819 --- 10.0.0.1 ping statistics --- 00:06:50.819 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:50.819 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:06:50.819 09:30:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:50.819 09:30:13 -- nvmf/common.sh@410 -- # return 0 00:06:50.819 09:30:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:50.819 09:30:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:50.819 09:30:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:50.819 09:30:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:50.819 09:30:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:50.819 09:30:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:50.819 09:30:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:50.819 09:30:13 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:50.819 09:30:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:50.819 09:30:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.819 09:30:13 -- common/autotest_common.sh@10 -- # set +x 00:06:50.819 ************************************ 00:06:50.819 START TEST nvmf_filesystem_no_in_capsule 00:06:50.819 ************************************ 00:06:50.819 09:30:13 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:50.819 09:30:13 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:50.819 09:30:13 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:50.819 09:30:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:50.819 09:30:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:50.819 09:30:13 -- common/autotest_common.sh@10 -- # set +x 00:06:50.819 09:30:13 -- nvmf/common.sh@469 -- # nvmfpid=4121041 00:06:50.819 09:30:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:50.819 09:30:13 -- nvmf/common.sh@470 -- # waitforlisten 4121041 00:06:50.819 09:30:13 -- common/autotest_common.sh@829 -- # '[' -z 4121041 ']' 00:06:50.819 09:30:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:50.819 09:30:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:50.819 09:30:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:50.819 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:50.819 09:30:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:50.819 09:30:13 -- common/autotest_common.sh@10 -- # set +x 00:06:50.819 [2024-11-29 09:30:13.565358] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:50.819 [2024-11-29 09:30:13.565479] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:50.819 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.819 [2024-11-29 09:30:13.630959] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:51.079 [2024-11-29 09:30:13.738717] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:51.079 [2024-11-29 09:30:13.738861] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:51.079 [2024-11-29 09:30:13.738877] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:51.079 [2024-11-29 09:30:13.738890] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:51.079 [2024-11-29 09:30:13.738951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:51.079 [2024-11-29 09:30:13.739009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:51.079 [2024-11-29 09:30:13.739074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:51.079 [2024-11-29 09:30:13.739076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.018 09:30:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:52.018 09:30:14 -- common/autotest_common.sh@862 -- # return 0 00:06:52.018 09:30:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:52.018 09:30:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:52.018 09:30:14 -- common/autotest_common.sh@10 -- # set +x 00:06:52.018 09:30:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:52.018 09:30:14 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:52.018 09:30:14 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:52.018 09:30:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.018 09:30:14 -- common/autotest_common.sh@10 -- # set +x 00:06:52.018 [2024-11-29 09:30:14.601145] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:52.018 09:30:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.018 09:30:14 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:52.018 09:30:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.018 09:30:14 -- common/autotest_common.sh@10 -- # set +x 00:06:52.018 Malloc1 00:06:52.018 09:30:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.018 09:30:14 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:52.018 09:30:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.018 09:30:14 -- common/autotest_common.sh@10 -- # set +x 00:06:52.018 09:30:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.018 09:30:14 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:52.018 09:30:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.018 09:30:14 -- common/autotest_common.sh@10 -- # set +x 00:06:52.018 09:30:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.018 09:30:14 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:52.018 09:30:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.018 09:30:14 -- common/autotest_common.sh@10 -- # set +x 00:06:52.018 [2024-11-29 09:30:14.776952] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:52.018 09:30:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.018 09:30:14 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:52.018 09:30:14 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:52.018 09:30:14 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:52.018 09:30:14 -- common/autotest_common.sh@1369 -- # local bs 00:06:52.018 09:30:14 -- common/autotest_common.sh@1370 -- # local nb 00:06:52.018 09:30:14 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:52.018 09:30:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.018 09:30:14 -- common/autotest_common.sh@10 -- # set +x 00:06:52.018 09:30:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.018 09:30:14 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:52.018 { 00:06:52.018 "name": "Malloc1", 00:06:52.018 "aliases": [ 00:06:52.018 "9d34ab3b-0a15-42ab-a8fc-237cdcc22f5b" 00:06:52.018 ], 00:06:52.018 "product_name": "Malloc disk", 00:06:52.018 "block_size": 512, 00:06:52.018 "num_blocks": 1048576, 00:06:52.018 "uuid": "9d34ab3b-0a15-42ab-a8fc-237cdcc22f5b", 00:06:52.018 "assigned_rate_limits": { 00:06:52.018 "rw_ios_per_sec": 0, 00:06:52.018 "rw_mbytes_per_sec": 0, 00:06:52.018 "r_mbytes_per_sec": 0, 00:06:52.018 "w_mbytes_per_sec": 0 00:06:52.018 }, 00:06:52.018 "claimed": true, 00:06:52.018 "claim_type": "exclusive_write", 00:06:52.018 "zoned": false, 00:06:52.018 "supported_io_types": { 00:06:52.018 "read": true, 00:06:52.018 "write": true, 00:06:52.018 "unmap": true, 00:06:52.018 "write_zeroes": true, 00:06:52.019 "flush": true, 00:06:52.019 "reset": true, 00:06:52.019 "compare": false, 00:06:52.019 "compare_and_write": false, 00:06:52.019 "abort": true, 00:06:52.019 "nvme_admin": false, 00:06:52.019 "nvme_io": false 00:06:52.019 }, 00:06:52.019 "memory_domains": [ 00:06:52.019 { 00:06:52.019 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:52.019 "dma_device_type": 2 00:06:52.019 } 00:06:52.019 ], 00:06:52.019 "driver_specific": {} 00:06:52.019 } 00:06:52.019 ]' 00:06:52.019 09:30:14 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:52.019 09:30:14 -- common/autotest_common.sh@1372 -- # bs=512 00:06:52.019 09:30:14 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:52.278 09:30:14 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:52.279 09:30:14 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:52.279 09:30:14 -- common/autotest_common.sh@1377 -- # echo 512 00:06:52.279 09:30:14 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:52.279 09:30:14 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:52.847 09:30:15 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:52.847 09:30:15 -- common/autotest_common.sh@1187 -- # local i=0 00:06:52.847 09:30:15 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:52.847 09:30:15 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:52.847 09:30:15 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:54.757 09:30:17 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:54.757 09:30:17 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:54.757 09:30:17 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:54.757 09:30:17 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:54.757 09:30:17 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:54.757 09:30:17 -- common/autotest_common.sh@1197 -- # return 0 00:06:54.757 09:30:17 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:54.757 09:30:17 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:54.757 09:30:17 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:54.757 09:30:17 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:54.757 09:30:17 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:54.757 09:30:17 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:54.757 09:30:17 -- setup/common.sh@80 -- # echo 536870912 00:06:54.757 09:30:17 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:54.757 09:30:17 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:54.757 09:30:17 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:54.757 09:30:17 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:55.017 09:30:17 -- target/filesystem.sh@69 -- # partprobe 00:06:55.275 09:30:18 -- target/filesystem.sh@70 -- # sleep 1 00:06:56.215 09:30:19 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:56.215 09:30:19 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:56.215 09:30:19 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:56.215 09:30:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.215 09:30:19 -- common/autotest_common.sh@10 -- # set +x 00:06:56.215 ************************************ 00:06:56.215 START TEST filesystem_ext4 00:06:56.215 ************************************ 00:06:56.215 09:30:19 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:56.215 09:30:19 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:56.215 09:30:19 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:56.215 09:30:19 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:56.215 09:30:19 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:56.215 09:30:19 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:56.215 09:30:19 -- common/autotest_common.sh@914 -- # local i=0 00:06:56.215 09:30:19 -- common/autotest_common.sh@915 -- # local force 00:06:56.215 09:30:19 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:56.215 09:30:19 -- common/autotest_common.sh@918 -- # force=-F 00:06:56.215 09:30:19 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:56.215 mke2fs 1.47.0 (5-Feb-2023) 00:06:56.473 Discarding device blocks: 0/522240 done 00:06:56.473 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:56.473 Filesystem UUID: e49db51b-a782-4b77-89f1-01e8abd493ca 00:06:56.473 Superblock backups stored on blocks: 00:06:56.473 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:56.473 00:06:56.473 Allocating group tables: 0/64 done 00:06:56.473 Writing inode tables: 0/64 done 00:06:56.473 Creating journal (8192 blocks): done 00:06:56.473 Writing superblocks and filesystem accounting information: 0/64 done 00:06:56.473 00:06:56.473 09:30:19 -- common/autotest_common.sh@931 -- # return 0 00:06:56.473 09:30:19 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:03.051 09:30:25 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:03.051 09:30:25 -- target/filesystem.sh@25 -- # sync 00:07:03.051 09:30:25 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:03.051 09:30:25 -- target/filesystem.sh@27 -- # sync 00:07:03.051 09:30:25 -- target/filesystem.sh@29 -- # i=0 00:07:03.051 09:30:25 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:03.051 09:30:25 -- target/filesystem.sh@37 -- # kill -0 4121041 00:07:03.051 09:30:25 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:03.051 09:30:25 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:03.051 09:30:25 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:03.051 09:30:25 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:03.051 00:07:03.051 real 0m6.289s 00:07:03.051 user 0m0.021s 00:07:03.051 sys 0m0.055s 00:07:03.051 09:30:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:03.051 09:30:25 -- common/autotest_common.sh@10 -- # set +x 00:07:03.051 ************************************ 00:07:03.051 END TEST filesystem_ext4 00:07:03.051 ************************************ 00:07:03.051 09:30:25 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:03.051 09:30:25 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:03.051 09:30:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.051 09:30:25 -- common/autotest_common.sh@10 -- # set +x 00:07:03.051 ************************************ 00:07:03.051 START TEST filesystem_btrfs 00:07:03.051 ************************************ 00:07:03.051 09:30:25 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:03.051 09:30:25 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:03.051 09:30:25 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:03.051 09:30:25 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:03.051 09:30:25 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:03.051 09:30:25 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:03.051 09:30:25 -- common/autotest_common.sh@914 -- # local i=0 00:07:03.051 09:30:25 -- common/autotest_common.sh@915 -- # local force 00:07:03.051 09:30:25 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:03.051 09:30:25 -- common/autotest_common.sh@920 -- # force=-f 00:07:03.051 09:30:25 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:03.051 btrfs-progs v6.8.1 00:07:03.051 See https://btrfs.readthedocs.io for more information. 00:07:03.051 00:07:03.051 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:03.051 NOTE: several default settings have changed in version 5.15, please make sure 00:07:03.051 this does not affect your deployments: 00:07:03.051 - DUP for metadata (-m dup) 00:07:03.051 - enabled no-holes (-O no-holes) 00:07:03.051 - enabled free-space-tree (-R free-space-tree) 00:07:03.051 00:07:03.051 Label: (null) 00:07:03.051 UUID: db111976-264d-4aa9-93d3-c00027ea079e 00:07:03.051 Node size: 16384 00:07:03.051 Sector size: 4096 (CPU page size: 4096) 00:07:03.051 Filesystem size: 510.00MiB 00:07:03.051 Block group profiles: 00:07:03.051 Data: single 8.00MiB 00:07:03.051 Metadata: DUP 32.00MiB 00:07:03.051 System: DUP 8.00MiB 00:07:03.051 SSD detected: yes 00:07:03.051 Zoned device: no 00:07:03.051 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:03.051 Checksum: crc32c 00:07:03.051 Number of devices: 1 00:07:03.051 Devices: 00:07:03.051 ID SIZE PATH 00:07:03.051 1 510.00MiB /dev/nvme0n1p1 00:07:03.051 00:07:03.051 09:30:25 -- common/autotest_common.sh@931 -- # return 0 00:07:03.051 09:30:25 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:03.621 09:30:26 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:03.621 09:30:26 -- target/filesystem.sh@25 -- # sync 00:07:03.621 09:30:26 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:03.621 09:30:26 -- target/filesystem.sh@27 -- # sync 00:07:03.621 09:30:26 -- target/filesystem.sh@29 -- # i=0 00:07:03.621 09:30:26 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:03.621 09:30:26 -- target/filesystem.sh@37 -- # kill -0 4121041 00:07:03.621 09:30:26 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:03.621 09:30:26 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:03.621 09:30:26 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:03.621 09:30:26 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:03.621 00:07:03.621 real 0m1.114s 00:07:03.621 user 0m0.016s 00:07:03.621 sys 0m0.104s 00:07:03.621 09:30:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:03.621 09:30:26 -- common/autotest_common.sh@10 -- # set +x 00:07:03.621 ************************************ 00:07:03.621 END TEST filesystem_btrfs 00:07:03.621 ************************************ 00:07:03.881 09:30:26 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:03.881 09:30:26 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:03.881 09:30:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.881 09:30:26 -- common/autotest_common.sh@10 -- # set +x 00:07:03.881 ************************************ 00:07:03.881 START TEST filesystem_xfs 00:07:03.881 ************************************ 00:07:03.881 09:30:26 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:03.881 09:30:26 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:03.881 09:30:26 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:03.881 09:30:26 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:03.881 09:30:26 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:03.881 09:30:26 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:03.881 09:30:26 -- common/autotest_common.sh@914 -- # local i=0 00:07:03.881 09:30:26 -- common/autotest_common.sh@915 -- # local force 00:07:03.881 09:30:26 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:03.881 09:30:26 -- common/autotest_common.sh@920 -- # force=-f 00:07:03.881 09:30:26 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:03.881 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:03.881 = sectsz=512 attr=2, projid32bit=1 00:07:03.881 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:03.881 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:03.881 data = bsize=4096 blocks=130560, imaxpct=25 00:07:03.881 = sunit=0 swidth=0 blks 00:07:03.881 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:03.881 log =internal log bsize=4096 blocks=16384, version=2 00:07:03.881 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:03.881 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:04.820 Discarding blocks...Done. 00:07:04.820 09:30:27 -- common/autotest_common.sh@931 -- # return 0 00:07:04.820 09:30:27 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:07.366 09:30:29 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:07.366 09:30:29 -- target/filesystem.sh@25 -- # sync 00:07:07.366 09:30:29 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:07.366 09:30:29 -- target/filesystem.sh@27 -- # sync 00:07:07.366 09:30:29 -- target/filesystem.sh@29 -- # i=0 00:07:07.366 09:30:29 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:07.366 09:30:29 -- target/filesystem.sh@37 -- # kill -0 4121041 00:07:07.366 09:30:29 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:07.366 09:30:29 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:07.366 09:30:29 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:07.366 09:30:29 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:07.366 00:07:07.366 real 0m3.487s 00:07:07.366 user 0m0.010s 00:07:07.366 sys 0m0.070s 00:07:07.366 09:30:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.366 09:30:29 -- common/autotest_common.sh@10 -- # set +x 00:07:07.366 ************************************ 00:07:07.366 END TEST filesystem_xfs 00:07:07.366 ************************************ 00:07:07.366 09:30:29 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:07.366 09:30:30 -- target/filesystem.sh@93 -- # sync 00:07:07.366 09:30:30 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:07.366 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:07.366 09:30:30 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:07.366 09:30:30 -- common/autotest_common.sh@1208 -- # local i=0 00:07:07.366 09:30:30 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:07.366 09:30:30 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:07.366 09:30:30 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:07.366 09:30:30 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:07.366 09:30:30 -- common/autotest_common.sh@1220 -- # return 0 00:07:07.366 09:30:30 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:07.366 09:30:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.366 09:30:30 -- common/autotest_common.sh@10 -- # set +x 00:07:07.366 09:30:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.366 09:30:30 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:07.366 09:30:30 -- target/filesystem.sh@101 -- # killprocess 4121041 00:07:07.366 09:30:30 -- common/autotest_common.sh@936 -- # '[' -z 4121041 ']' 00:07:07.366 09:30:30 -- common/autotest_common.sh@940 -- # kill -0 4121041 00:07:07.366 09:30:30 -- common/autotest_common.sh@941 -- # uname 00:07:07.366 09:30:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:07.366 09:30:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4121041 00:07:07.366 09:30:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:07.366 09:30:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:07.366 09:30:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4121041' 00:07:07.366 killing process with pid 4121041 00:07:07.366 09:30:30 -- common/autotest_common.sh@955 -- # kill 4121041 00:07:07.366 09:30:30 -- common/autotest_common.sh@960 -- # wait 4121041 00:07:07.936 09:30:30 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:07.936 00:07:07.936 real 0m17.149s 00:07:07.936 user 1m6.405s 00:07:07.936 sys 0m2.102s 00:07:07.936 09:30:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.936 09:30:30 -- common/autotest_common.sh@10 -- # set +x 00:07:07.936 ************************************ 00:07:07.936 END TEST nvmf_filesystem_no_in_capsule 00:07:07.936 ************************************ 00:07:07.936 09:30:30 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:07.936 09:30:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:07.936 09:30:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.936 09:30:30 -- common/autotest_common.sh@10 -- # set +x 00:07:07.936 ************************************ 00:07:07.936 START TEST nvmf_filesystem_in_capsule 00:07:07.936 ************************************ 00:07:07.936 09:30:30 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:07.936 09:30:30 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:07.936 09:30:30 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:07.936 09:30:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:07.936 09:30:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:07.936 09:30:30 -- common/autotest_common.sh@10 -- # set +x 00:07:07.936 09:30:30 -- nvmf/common.sh@469 -- # nvmfpid=4123321 00:07:07.936 09:30:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:07.936 09:30:30 -- nvmf/common.sh@470 -- # waitforlisten 4123321 00:07:07.936 09:30:30 -- common/autotest_common.sh@829 -- # '[' -z 4123321 ']' 00:07:07.936 09:30:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:07.936 09:30:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:07.936 09:30:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:07.936 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:07.936 09:30:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:07.936 09:30:30 -- common/autotest_common.sh@10 -- # set +x 00:07:07.936 [2024-11-29 09:30:30.747023] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:07.936 [2024-11-29 09:30:30.747100] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:08.196 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.196 [2024-11-29 09:30:30.813585] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:08.196 [2024-11-29 09:30:30.922930] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:08.197 [2024-11-29 09:30:30.923079] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:08.197 [2024-11-29 09:30:30.923096] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:08.197 [2024-11-29 09:30:30.923108] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:08.197 [2024-11-29 09:30:30.923195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:08.197 [2024-11-29 09:30:30.923246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:08.197 [2024-11-29 09:30:30.923310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:08.197 [2024-11-29 09:30:30.923313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.134 09:30:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:09.134 09:30:31 -- common/autotest_common.sh@862 -- # return 0 00:07:09.134 09:30:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:09.134 09:30:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:09.134 09:30:31 -- common/autotest_common.sh@10 -- # set +x 00:07:09.134 09:30:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:09.134 09:30:31 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:09.134 09:30:31 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:09.134 09:30:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:09.134 09:30:31 -- common/autotest_common.sh@10 -- # set +x 00:07:09.134 [2024-11-29 09:30:31.773001] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:09.134 09:30:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:09.134 09:30:31 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:09.134 09:30:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:09.134 09:30:31 -- common/autotest_common.sh@10 -- # set +x 00:07:09.134 Malloc1 00:07:09.134 09:30:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:09.134 09:30:31 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:09.134 09:30:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:09.134 09:30:31 -- common/autotest_common.sh@10 -- # set +x 00:07:09.134 09:30:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:09.134 09:30:31 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:09.134 09:30:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:09.134 09:30:31 -- common/autotest_common.sh@10 -- # set +x 00:07:09.134 09:30:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:09.134 09:30:31 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:09.134 09:30:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:09.134 09:30:31 -- common/autotest_common.sh@10 -- # set +x 00:07:09.134 [2024-11-29 09:30:31.954055] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:09.134 09:30:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:09.134 09:30:31 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:09.134 09:30:31 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:09.134 09:30:31 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:09.134 09:30:31 -- common/autotest_common.sh@1369 -- # local bs 00:07:09.134 09:30:31 -- common/autotest_common.sh@1370 -- # local nb 00:07:09.134 09:30:31 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:09.134 09:30:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:09.134 09:30:31 -- common/autotest_common.sh@10 -- # set +x 00:07:09.134 09:30:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:09.134 09:30:31 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:09.134 { 00:07:09.134 "name": "Malloc1", 00:07:09.134 "aliases": [ 00:07:09.134 "28ad5052-bb73-493b-a37c-7fd55c121483" 00:07:09.134 ], 00:07:09.134 "product_name": "Malloc disk", 00:07:09.134 "block_size": 512, 00:07:09.134 "num_blocks": 1048576, 00:07:09.134 "uuid": "28ad5052-bb73-493b-a37c-7fd55c121483", 00:07:09.134 "assigned_rate_limits": { 00:07:09.134 "rw_ios_per_sec": 0, 00:07:09.134 "rw_mbytes_per_sec": 0, 00:07:09.134 "r_mbytes_per_sec": 0, 00:07:09.134 "w_mbytes_per_sec": 0 00:07:09.134 }, 00:07:09.134 "claimed": true, 00:07:09.134 "claim_type": "exclusive_write", 00:07:09.134 "zoned": false, 00:07:09.134 "supported_io_types": { 00:07:09.134 "read": true, 00:07:09.134 "write": true, 00:07:09.134 "unmap": true, 00:07:09.134 "write_zeroes": true, 00:07:09.134 "flush": true, 00:07:09.134 "reset": true, 00:07:09.134 "compare": false, 00:07:09.134 "compare_and_write": false, 00:07:09.134 "abort": true, 00:07:09.134 "nvme_admin": false, 00:07:09.135 "nvme_io": false 00:07:09.135 }, 00:07:09.135 "memory_domains": [ 00:07:09.135 { 00:07:09.135 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:09.135 "dma_device_type": 2 00:07:09.135 } 00:07:09.135 ], 00:07:09.135 "driver_specific": {} 00:07:09.135 } 00:07:09.135 ]' 00:07:09.135 09:30:31 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:09.394 09:30:32 -- common/autotest_common.sh@1372 -- # bs=512 00:07:09.394 09:30:32 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:09.394 09:30:32 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:09.394 09:30:32 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:09.394 09:30:32 -- common/autotest_common.sh@1377 -- # echo 512 00:07:09.394 09:30:32 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:09.394 09:30:32 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:09.961 09:30:32 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:09.961 09:30:32 -- common/autotest_common.sh@1187 -- # local i=0 00:07:09.961 09:30:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:09.961 09:30:32 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:09.961 09:30:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:11.938 09:30:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:11.938 09:30:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:11.938 09:30:34 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:11.938 09:30:34 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:11.938 09:30:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:11.938 09:30:34 -- common/autotest_common.sh@1197 -- # return 0 00:07:11.938 09:30:34 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:11.938 09:30:34 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:11.938 09:30:34 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:11.938 09:30:34 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:11.938 09:30:34 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:11.938 09:30:34 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:11.938 09:30:34 -- setup/common.sh@80 -- # echo 536870912 00:07:11.938 09:30:34 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:11.938 09:30:34 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:11.938 09:30:34 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:11.938 09:30:34 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:12.197 09:30:35 -- target/filesystem.sh@69 -- # partprobe 00:07:12.764 09:30:35 -- target/filesystem.sh@70 -- # sleep 1 00:07:14.147 09:30:36 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:14.147 09:30:36 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:14.147 09:30:36 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:14.148 09:30:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:14.148 09:30:36 -- common/autotest_common.sh@10 -- # set +x 00:07:14.148 ************************************ 00:07:14.148 START TEST filesystem_in_capsule_ext4 00:07:14.148 ************************************ 00:07:14.148 09:30:36 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:14.148 09:30:36 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:14.148 09:30:36 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:14.148 09:30:36 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:14.148 09:30:36 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:14.148 09:30:36 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:14.148 09:30:36 -- common/autotest_common.sh@914 -- # local i=0 00:07:14.148 09:30:36 -- common/autotest_common.sh@915 -- # local force 00:07:14.148 09:30:36 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:14.148 09:30:36 -- common/autotest_common.sh@918 -- # force=-F 00:07:14.148 09:30:36 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:14.148 mke2fs 1.47.0 (5-Feb-2023) 00:07:14.148 Discarding device blocks: 0/522240 done 00:07:14.148 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:14.148 Filesystem UUID: e5fefb4e-3116-41e0-8d50-967308aab537 00:07:14.148 Superblock backups stored on blocks: 00:07:14.148 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:14.148 00:07:14.148 Allocating group tables: 0/64 done 00:07:14.148 Writing inode tables: 0/64 done 00:07:16.053 Creating journal (8192 blocks): done 00:07:16.053 Writing superblocks and filesystem accounting information: 0/64 done 00:07:16.053 00:07:16.053 09:30:38 -- common/autotest_common.sh@931 -- # return 0 00:07:16.053 09:30:38 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:21.331 09:30:44 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:21.590 09:30:44 -- target/filesystem.sh@25 -- # sync 00:07:21.590 09:30:44 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:21.590 09:30:44 -- target/filesystem.sh@27 -- # sync 00:07:21.590 09:30:44 -- target/filesystem.sh@29 -- # i=0 00:07:21.590 09:30:44 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:21.590 09:30:44 -- target/filesystem.sh@37 -- # kill -0 4123321 00:07:21.590 09:30:44 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:21.590 09:30:44 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:21.590 09:30:44 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:21.590 09:30:44 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:21.590 00:07:21.590 real 0m7.698s 00:07:21.590 user 0m0.022s 00:07:21.590 sys 0m0.067s 00:07:21.590 09:30:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:21.590 09:30:44 -- common/autotest_common.sh@10 -- # set +x 00:07:21.590 ************************************ 00:07:21.590 END TEST filesystem_in_capsule_ext4 00:07:21.590 ************************************ 00:07:21.590 09:30:44 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:21.590 09:30:44 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:21.590 09:30:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.590 09:30:44 -- common/autotest_common.sh@10 -- # set +x 00:07:21.590 ************************************ 00:07:21.590 START TEST filesystem_in_capsule_btrfs 00:07:21.590 ************************************ 00:07:21.590 09:30:44 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:21.590 09:30:44 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:21.590 09:30:44 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:21.590 09:30:44 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:21.590 09:30:44 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:21.590 09:30:44 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:21.590 09:30:44 -- common/autotest_common.sh@914 -- # local i=0 00:07:21.590 09:30:44 -- common/autotest_common.sh@915 -- # local force 00:07:21.590 09:30:44 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:21.590 09:30:44 -- common/autotest_common.sh@920 -- # force=-f 00:07:21.590 09:30:44 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:21.849 btrfs-progs v6.8.1 00:07:21.849 See https://btrfs.readthedocs.io for more information. 00:07:21.849 00:07:21.849 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:21.849 NOTE: several default settings have changed in version 5.15, please make sure 00:07:21.849 this does not affect your deployments: 00:07:21.849 - DUP for metadata (-m dup) 00:07:21.849 - enabled no-holes (-O no-holes) 00:07:21.849 - enabled free-space-tree (-R free-space-tree) 00:07:21.849 00:07:21.849 Label: (null) 00:07:21.849 UUID: 040c7e79-01b4-4f60-ac7d-e650727975af 00:07:21.849 Node size: 16384 00:07:21.849 Sector size: 4096 (CPU page size: 4096) 00:07:21.849 Filesystem size: 510.00MiB 00:07:21.849 Block group profiles: 00:07:21.849 Data: single 8.00MiB 00:07:21.849 Metadata: DUP 32.00MiB 00:07:21.849 System: DUP 8.00MiB 00:07:21.849 SSD detected: yes 00:07:21.849 Zoned device: no 00:07:21.849 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:21.849 Checksum: crc32c 00:07:21.849 Number of devices: 1 00:07:21.849 Devices: 00:07:21.849 ID SIZE PATH 00:07:21.849 1 510.00MiB /dev/nvme0n1p1 00:07:21.849 00:07:21.849 09:30:44 -- common/autotest_common.sh@931 -- # return 0 00:07:21.849 09:30:44 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:22.109 09:30:44 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:22.109 09:30:44 -- target/filesystem.sh@25 -- # sync 00:07:22.109 09:30:44 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:22.109 09:30:44 -- target/filesystem.sh@27 -- # sync 00:07:22.109 09:30:44 -- target/filesystem.sh@29 -- # i=0 00:07:22.109 09:30:44 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:22.109 09:30:44 -- target/filesystem.sh@37 -- # kill -0 4123321 00:07:22.109 09:30:44 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:22.109 09:30:44 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:22.109 09:30:44 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:22.109 09:30:44 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:22.109 00:07:22.109 real 0m0.610s 00:07:22.109 user 0m0.023s 00:07:22.109 sys 0m0.097s 00:07:22.109 09:30:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:22.109 09:30:44 -- common/autotest_common.sh@10 -- # set +x 00:07:22.109 ************************************ 00:07:22.109 END TEST filesystem_in_capsule_btrfs 00:07:22.109 ************************************ 00:07:22.109 09:30:44 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:22.109 09:30:44 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:22.109 09:30:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:22.109 09:30:44 -- common/autotest_common.sh@10 -- # set +x 00:07:22.109 ************************************ 00:07:22.109 START TEST filesystem_in_capsule_xfs 00:07:22.109 ************************************ 00:07:22.109 09:30:44 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:22.109 09:30:44 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:22.109 09:30:44 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:22.109 09:30:44 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:22.109 09:30:44 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:22.109 09:30:44 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:22.109 09:30:44 -- common/autotest_common.sh@914 -- # local i=0 00:07:22.109 09:30:44 -- common/autotest_common.sh@915 -- # local force 00:07:22.109 09:30:44 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:22.109 09:30:44 -- common/autotest_common.sh@920 -- # force=-f 00:07:22.109 09:30:44 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:22.376 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:22.376 = sectsz=512 attr=2, projid32bit=1 00:07:22.376 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:22.376 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:22.376 data = bsize=4096 blocks=130560, imaxpct=25 00:07:22.376 = sunit=0 swidth=0 blks 00:07:22.376 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:22.377 log =internal log bsize=4096 blocks=16384, version=2 00:07:22.377 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:22.377 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:23.319 Discarding blocks...Done. 00:07:23.319 09:30:46 -- common/autotest_common.sh@931 -- # return 0 00:07:23.319 09:30:46 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:25.855 09:30:48 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:25.855 09:30:48 -- target/filesystem.sh@25 -- # sync 00:07:25.855 09:30:48 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:25.855 09:30:48 -- target/filesystem.sh@27 -- # sync 00:07:25.855 09:30:48 -- target/filesystem.sh@29 -- # i=0 00:07:25.855 09:30:48 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:25.855 09:30:48 -- target/filesystem.sh@37 -- # kill -0 4123321 00:07:25.855 09:30:48 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:25.855 09:30:48 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:25.855 09:30:48 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:25.855 09:30:48 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:25.855 00:07:25.855 real 0m3.670s 00:07:25.855 user 0m0.014s 00:07:25.855 sys 0m0.068s 00:07:25.855 09:30:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:25.855 09:30:48 -- common/autotest_common.sh@10 -- # set +x 00:07:25.855 ************************************ 00:07:25.855 END TEST filesystem_in_capsule_xfs 00:07:25.855 ************************************ 00:07:25.855 09:30:48 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:25.855 09:30:48 -- target/filesystem.sh@93 -- # sync 00:07:25.855 09:30:48 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:26.116 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:26.116 09:30:48 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:26.116 09:30:48 -- common/autotest_common.sh@1208 -- # local i=0 00:07:26.116 09:30:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:26.116 09:30:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:26.116 09:30:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:26.116 09:30:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:26.116 09:30:48 -- common/autotest_common.sh@1220 -- # return 0 00:07:26.116 09:30:48 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:26.116 09:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.116 09:30:48 -- common/autotest_common.sh@10 -- # set +x 00:07:26.116 09:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.116 09:30:48 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:26.116 09:30:48 -- target/filesystem.sh@101 -- # killprocess 4123321 00:07:26.116 09:30:48 -- common/autotest_common.sh@936 -- # '[' -z 4123321 ']' 00:07:26.116 09:30:48 -- common/autotest_common.sh@940 -- # kill -0 4123321 00:07:26.116 09:30:48 -- common/autotest_common.sh@941 -- # uname 00:07:26.116 09:30:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:26.116 09:30:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4123321 00:07:26.116 09:30:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:26.116 09:30:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:26.116 09:30:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4123321' 00:07:26.116 killing process with pid 4123321 00:07:26.116 09:30:48 -- common/autotest_common.sh@955 -- # kill 4123321 00:07:26.116 09:30:48 -- common/autotest_common.sh@960 -- # wait 4123321 00:07:26.688 09:30:49 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:26.688 00:07:26.688 real 0m18.689s 00:07:26.688 user 1m12.419s 00:07:26.688 sys 0m2.254s 00:07:26.688 09:30:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:26.688 09:30:49 -- common/autotest_common.sh@10 -- # set +x 00:07:26.688 ************************************ 00:07:26.688 END TEST nvmf_filesystem_in_capsule 00:07:26.688 ************************************ 00:07:26.688 09:30:49 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:26.688 09:30:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:26.688 09:30:49 -- nvmf/common.sh@116 -- # sync 00:07:26.688 09:30:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:26.688 09:30:49 -- nvmf/common.sh@119 -- # set +e 00:07:26.688 09:30:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:26.688 09:30:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:26.688 rmmod nvme_tcp 00:07:26.688 rmmod nvme_fabrics 00:07:26.688 rmmod nvme_keyring 00:07:26.688 09:30:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:26.688 09:30:49 -- nvmf/common.sh@123 -- # set -e 00:07:26.688 09:30:49 -- nvmf/common.sh@124 -- # return 0 00:07:26.688 09:30:49 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:26.688 09:30:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:26.688 09:30:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:26.688 09:30:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:26.688 09:30:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:26.688 09:30:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:26.688 09:30:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:26.688 09:30:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:26.688 09:30:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:29.236 09:30:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:29.236 00:07:29.236 real 0m40.570s 00:07:29.236 user 2m19.873s 00:07:29.236 sys 0m6.044s 00:07:29.236 09:30:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:29.236 09:30:51 -- common/autotest_common.sh@10 -- # set +x 00:07:29.236 ************************************ 00:07:29.236 END TEST nvmf_filesystem 00:07:29.236 ************************************ 00:07:29.236 09:30:51 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:29.236 09:30:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:29.236 09:30:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:29.236 09:30:51 -- common/autotest_common.sh@10 -- # set +x 00:07:29.236 ************************************ 00:07:29.236 START TEST nvmf_discovery 00:07:29.236 ************************************ 00:07:29.236 09:30:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:29.236 * Looking for test storage... 00:07:29.236 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:29.236 09:30:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:29.236 09:30:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:29.236 09:30:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:29.236 09:30:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:29.236 09:30:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:29.236 09:30:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:29.236 09:30:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:29.236 09:30:51 -- scripts/common.sh@335 -- # IFS=.-: 00:07:29.236 09:30:51 -- scripts/common.sh@335 -- # read -ra ver1 00:07:29.236 09:30:51 -- scripts/common.sh@336 -- # IFS=.-: 00:07:29.236 09:30:51 -- scripts/common.sh@336 -- # read -ra ver2 00:07:29.236 09:30:51 -- scripts/common.sh@337 -- # local 'op=<' 00:07:29.236 09:30:51 -- scripts/common.sh@339 -- # ver1_l=2 00:07:29.236 09:30:51 -- scripts/common.sh@340 -- # ver2_l=1 00:07:29.236 09:30:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:29.236 09:30:51 -- scripts/common.sh@343 -- # case "$op" in 00:07:29.236 09:30:51 -- scripts/common.sh@344 -- # : 1 00:07:29.236 09:30:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:29.236 09:30:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:29.236 09:30:51 -- scripts/common.sh@364 -- # decimal 1 00:07:29.236 09:30:51 -- scripts/common.sh@352 -- # local d=1 00:07:29.236 09:30:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:29.236 09:30:51 -- scripts/common.sh@354 -- # echo 1 00:07:29.236 09:30:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:29.236 09:30:51 -- scripts/common.sh@365 -- # decimal 2 00:07:29.236 09:30:51 -- scripts/common.sh@352 -- # local d=2 00:07:29.236 09:30:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:29.236 09:30:51 -- scripts/common.sh@354 -- # echo 2 00:07:29.236 09:30:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:29.236 09:30:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:29.236 09:30:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:29.236 09:30:51 -- scripts/common.sh@367 -- # return 0 00:07:29.236 09:30:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:29.236 09:30:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:29.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.236 --rc genhtml_branch_coverage=1 00:07:29.236 --rc genhtml_function_coverage=1 00:07:29.236 --rc genhtml_legend=1 00:07:29.236 --rc geninfo_all_blocks=1 00:07:29.236 --rc geninfo_unexecuted_blocks=1 00:07:29.236 00:07:29.236 ' 00:07:29.236 09:30:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:29.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.236 --rc genhtml_branch_coverage=1 00:07:29.236 --rc genhtml_function_coverage=1 00:07:29.236 --rc genhtml_legend=1 00:07:29.236 --rc geninfo_all_blocks=1 00:07:29.236 --rc geninfo_unexecuted_blocks=1 00:07:29.236 00:07:29.236 ' 00:07:29.236 09:30:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:29.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.236 --rc genhtml_branch_coverage=1 00:07:29.236 --rc genhtml_function_coverage=1 00:07:29.236 --rc genhtml_legend=1 00:07:29.236 --rc geninfo_all_blocks=1 00:07:29.236 --rc geninfo_unexecuted_blocks=1 00:07:29.236 00:07:29.236 ' 00:07:29.236 09:30:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:29.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.236 --rc genhtml_branch_coverage=1 00:07:29.236 --rc genhtml_function_coverage=1 00:07:29.236 --rc genhtml_legend=1 00:07:29.236 --rc geninfo_all_blocks=1 00:07:29.236 --rc geninfo_unexecuted_blocks=1 00:07:29.236 00:07:29.236 ' 00:07:29.236 09:30:51 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:29.236 09:30:51 -- nvmf/common.sh@7 -- # uname -s 00:07:29.236 09:30:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:29.236 09:30:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:29.236 09:30:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:29.236 09:30:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:29.236 09:30:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:29.236 09:30:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:29.236 09:30:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:29.236 09:30:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:29.236 09:30:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:29.236 09:30:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:29.236 09:30:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:29.236 09:30:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:29.236 09:30:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:29.236 09:30:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:29.236 09:30:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:29.236 09:30:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:29.236 09:30:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:29.236 09:30:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:29.236 09:30:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:29.236 09:30:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.236 09:30:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.236 09:30:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.236 09:30:51 -- paths/export.sh@5 -- # export PATH 00:07:29.236 09:30:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.236 09:30:51 -- nvmf/common.sh@46 -- # : 0 00:07:29.236 09:30:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:29.236 09:30:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:29.236 09:30:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:29.236 09:30:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:29.236 09:30:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:29.236 09:30:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:29.236 09:30:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:29.236 09:30:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:29.236 09:30:51 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:29.236 09:30:51 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:29.237 09:30:51 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:29.237 09:30:51 -- target/discovery.sh@15 -- # hash nvme 00:07:29.237 09:30:51 -- target/discovery.sh@20 -- # nvmftestinit 00:07:29.237 09:30:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:29.237 09:30:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:29.237 09:30:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:29.237 09:30:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:29.237 09:30:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:29.237 09:30:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:29.237 09:30:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:29.237 09:30:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:29.237 09:30:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:29.237 09:30:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:29.237 09:30:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:29.237 09:30:51 -- common/autotest_common.sh@10 -- # set +x 00:07:31.146 09:30:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:31.146 09:30:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:31.146 09:30:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:31.146 09:30:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:31.146 09:30:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:31.146 09:30:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:31.146 09:30:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:31.146 09:30:53 -- nvmf/common.sh@294 -- # net_devs=() 00:07:31.146 09:30:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:31.146 09:30:53 -- nvmf/common.sh@295 -- # e810=() 00:07:31.146 09:30:53 -- nvmf/common.sh@295 -- # local -ga e810 00:07:31.146 09:30:53 -- nvmf/common.sh@296 -- # x722=() 00:07:31.146 09:30:53 -- nvmf/common.sh@296 -- # local -ga x722 00:07:31.146 09:30:53 -- nvmf/common.sh@297 -- # mlx=() 00:07:31.146 09:30:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:31.146 09:30:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:31.146 09:30:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:31.146 09:30:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:31.146 09:30:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:31.146 09:30:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:31.146 09:30:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:31.146 09:30:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:31.146 09:30:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:31.146 09:30:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:31.146 09:30:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:31.146 09:30:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:31.146 09:30:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:31.146 09:30:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:31.146 09:30:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:31.146 09:30:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:31.146 09:30:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:31.146 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:31.146 09:30:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:31.146 09:30:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:31.146 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:31.146 09:30:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:31.146 09:30:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:31.146 09:30:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:31.146 09:30:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:31.146 09:30:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:31.146 09:30:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:31.146 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:31.146 09:30:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:31.146 09:30:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:31.146 09:30:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:31.146 09:30:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:31.146 09:30:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:31.146 09:30:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:31.146 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:31.146 09:30:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:31.146 09:30:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:31.146 09:30:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:31.146 09:30:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:31.146 09:30:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:31.146 09:30:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:31.146 09:30:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:31.146 09:30:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:31.146 09:30:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:31.146 09:30:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:31.146 09:30:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:31.146 09:30:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:31.146 09:30:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:31.146 09:30:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:31.146 09:30:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:31.146 09:30:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:31.146 09:30:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:31.146 09:30:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:31.146 09:30:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:31.146 09:30:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:31.146 09:30:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:31.146 09:30:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:31.146 09:30:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:31.146 09:30:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:31.146 09:30:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:31.146 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:31.146 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.296 ms 00:07:31.146 00:07:31.146 --- 10.0.0.2 ping statistics --- 00:07:31.146 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:31.146 rtt min/avg/max/mdev = 0.296/0.296/0.296/0.000 ms 00:07:31.146 09:30:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:31.146 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:31.146 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:07:31.146 00:07:31.146 --- 10.0.0.1 ping statistics --- 00:07:31.146 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:31.146 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:07:31.146 09:30:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:31.146 09:30:53 -- nvmf/common.sh@410 -- # return 0 00:07:31.146 09:30:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:31.146 09:30:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:31.147 09:30:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:31.147 09:30:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:31.147 09:30:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:31.147 09:30:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:31.147 09:30:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:31.147 09:30:53 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:31.147 09:30:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:31.147 09:30:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:31.147 09:30:53 -- common/autotest_common.sh@10 -- # set +x 00:07:31.147 09:30:53 -- nvmf/common.sh@469 -- # nvmfpid=4127696 00:07:31.147 09:30:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:31.147 09:30:53 -- nvmf/common.sh@470 -- # waitforlisten 4127696 00:07:31.147 09:30:53 -- common/autotest_common.sh@829 -- # '[' -z 4127696 ']' 00:07:31.147 09:30:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:31.147 09:30:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:31.147 09:30:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:31.147 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:31.147 09:30:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:31.147 09:30:53 -- common/autotest_common.sh@10 -- # set +x 00:07:31.404 [2024-11-29 09:30:54.021739] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:31.404 [2024-11-29 09:30:54.021817] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:31.404 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.404 [2024-11-29 09:30:54.087264] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:31.404 [2024-11-29 09:30:54.193999] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:31.404 [2024-11-29 09:30:54.194137] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:31.404 [2024-11-29 09:30:54.194154] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:31.404 [2024-11-29 09:30:54.194166] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:31.404 [2024-11-29 09:30:54.194224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:31.404 [2024-11-29 09:30:54.194286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:31.404 [2024-11-29 09:30:54.194349] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:31.404 [2024-11-29 09:30:54.194351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.341 09:30:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:32.341 09:30:55 -- common/autotest_common.sh@862 -- # return 0 00:07:32.341 09:30:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:32.341 09:30:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:32.341 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.341 09:30:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:32.341 09:30:55 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:32.341 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.341 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.341 [2024-11-29 09:30:55.072228] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:32.341 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.341 09:30:55 -- target/discovery.sh@26 -- # seq 1 4 00:07:32.341 09:30:55 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:32.341 09:30:55 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:32.341 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.341 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.341 Null1 00:07:32.341 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.341 09:30:55 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:32.341 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.341 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.341 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.341 09:30:55 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:32.341 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.341 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.341 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.341 09:30:55 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:32.341 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.341 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.341 [2024-11-29 09:30:55.112570] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:32.341 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.342 09:30:55 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:32.342 09:30:55 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:32.342 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.342 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.342 Null2 00:07:32.342 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.342 09:30:55 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:32.342 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.342 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.342 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.342 09:30:55 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:32.342 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.342 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.342 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.342 09:30:55 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:32.342 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.342 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.342 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.342 09:30:55 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:32.342 09:30:55 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:32.342 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.342 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.342 Null3 00:07:32.342 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.342 09:30:55 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:32.342 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.342 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.342 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.342 09:30:55 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:32.342 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.342 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.342 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.342 09:30:55 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:32.342 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.342 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.342 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.342 09:30:55 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:32.342 09:30:55 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:32.342 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.342 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.601 Null4 00:07:32.601 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.601 09:30:55 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:32.601 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.601 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.601 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.601 09:30:55 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:32.601 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.601 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.601 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.601 09:30:55 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:32.601 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.601 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.601 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.601 09:30:55 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:32.601 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.601 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.601 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.601 09:30:55 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:32.601 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.601 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.601 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.601 09:30:55 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:32.601 00:07:32.601 Discovery Log Number of Records 6, Generation counter 6 00:07:32.601 =====Discovery Log Entry 0====== 00:07:32.601 trtype: tcp 00:07:32.601 adrfam: ipv4 00:07:32.601 subtype: current discovery subsystem 00:07:32.601 treq: not required 00:07:32.601 portid: 0 00:07:32.601 trsvcid: 4420 00:07:32.601 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:32.601 traddr: 10.0.0.2 00:07:32.601 eflags: explicit discovery connections, duplicate discovery information 00:07:32.601 sectype: none 00:07:32.601 =====Discovery Log Entry 1====== 00:07:32.601 trtype: tcp 00:07:32.601 adrfam: ipv4 00:07:32.601 subtype: nvme subsystem 00:07:32.601 treq: not required 00:07:32.601 portid: 0 00:07:32.601 trsvcid: 4420 00:07:32.601 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:32.601 traddr: 10.0.0.2 00:07:32.601 eflags: none 00:07:32.601 sectype: none 00:07:32.601 =====Discovery Log Entry 2====== 00:07:32.601 trtype: tcp 00:07:32.601 adrfam: ipv4 00:07:32.601 subtype: nvme subsystem 00:07:32.601 treq: not required 00:07:32.601 portid: 0 00:07:32.601 trsvcid: 4420 00:07:32.601 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:32.601 traddr: 10.0.0.2 00:07:32.601 eflags: none 00:07:32.601 sectype: none 00:07:32.601 =====Discovery Log Entry 3====== 00:07:32.601 trtype: tcp 00:07:32.601 adrfam: ipv4 00:07:32.601 subtype: nvme subsystem 00:07:32.601 treq: not required 00:07:32.601 portid: 0 00:07:32.601 trsvcid: 4420 00:07:32.601 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:32.601 traddr: 10.0.0.2 00:07:32.601 eflags: none 00:07:32.601 sectype: none 00:07:32.601 =====Discovery Log Entry 4====== 00:07:32.601 trtype: tcp 00:07:32.601 adrfam: ipv4 00:07:32.601 subtype: nvme subsystem 00:07:32.601 treq: not required 00:07:32.601 portid: 0 00:07:32.601 trsvcid: 4420 00:07:32.601 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:32.601 traddr: 10.0.0.2 00:07:32.601 eflags: none 00:07:32.601 sectype: none 00:07:32.601 =====Discovery Log Entry 5====== 00:07:32.601 trtype: tcp 00:07:32.601 adrfam: ipv4 00:07:32.601 subtype: discovery subsystem referral 00:07:32.601 treq: not required 00:07:32.601 portid: 0 00:07:32.601 trsvcid: 4430 00:07:32.601 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:32.601 traddr: 10.0.0.2 00:07:32.601 eflags: none 00:07:32.601 sectype: none 00:07:32.601 09:30:55 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:32.601 Perform nvmf subsystem discovery via RPC 00:07:32.601 09:30:55 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:32.601 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.601 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.861 [2024-11-29 09:30:55.445439] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:32.861 [ 00:07:32.861 { 00:07:32.861 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:32.861 "subtype": "Discovery", 00:07:32.861 "listen_addresses": [ 00:07:32.861 { 00:07:32.861 "transport": "TCP", 00:07:32.861 "trtype": "TCP", 00:07:32.861 "adrfam": "IPv4", 00:07:32.861 "traddr": "10.0.0.2", 00:07:32.861 "trsvcid": "4420" 00:07:32.861 } 00:07:32.861 ], 00:07:32.861 "allow_any_host": true, 00:07:32.861 "hosts": [] 00:07:32.861 }, 00:07:32.861 { 00:07:32.861 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:32.861 "subtype": "NVMe", 00:07:32.861 "listen_addresses": [ 00:07:32.861 { 00:07:32.861 "transport": "TCP", 00:07:32.861 "trtype": "TCP", 00:07:32.861 "adrfam": "IPv4", 00:07:32.861 "traddr": "10.0.0.2", 00:07:32.861 "trsvcid": "4420" 00:07:32.861 } 00:07:32.861 ], 00:07:32.861 "allow_any_host": true, 00:07:32.861 "hosts": [], 00:07:32.861 "serial_number": "SPDK00000000000001", 00:07:32.861 "model_number": "SPDK bdev Controller", 00:07:32.861 "max_namespaces": 32, 00:07:32.861 "min_cntlid": 1, 00:07:32.861 "max_cntlid": 65519, 00:07:32.861 "namespaces": [ 00:07:32.861 { 00:07:32.861 "nsid": 1, 00:07:32.861 "bdev_name": "Null1", 00:07:32.861 "name": "Null1", 00:07:32.861 "nguid": "0943B8DA64DC4D499479F4BB5267A677", 00:07:32.861 "uuid": "0943b8da-64dc-4d49-9479-f4bb5267a677" 00:07:32.861 } 00:07:32.861 ] 00:07:32.861 }, 00:07:32.861 { 00:07:32.861 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:32.861 "subtype": "NVMe", 00:07:32.861 "listen_addresses": [ 00:07:32.861 { 00:07:32.861 "transport": "TCP", 00:07:32.861 "trtype": "TCP", 00:07:32.861 "adrfam": "IPv4", 00:07:32.861 "traddr": "10.0.0.2", 00:07:32.861 "trsvcid": "4420" 00:07:32.861 } 00:07:32.861 ], 00:07:32.861 "allow_any_host": true, 00:07:32.861 "hosts": [], 00:07:32.861 "serial_number": "SPDK00000000000002", 00:07:32.861 "model_number": "SPDK bdev Controller", 00:07:32.861 "max_namespaces": 32, 00:07:32.861 "min_cntlid": 1, 00:07:32.861 "max_cntlid": 65519, 00:07:32.861 "namespaces": [ 00:07:32.861 { 00:07:32.861 "nsid": 1, 00:07:32.861 "bdev_name": "Null2", 00:07:32.861 "name": "Null2", 00:07:32.861 "nguid": "DD12033B9A9745F88E4B28B0C17B2BA0", 00:07:32.861 "uuid": "dd12033b-9a97-45f8-8e4b-28b0c17b2ba0" 00:07:32.861 } 00:07:32.861 ] 00:07:32.861 }, 00:07:32.861 { 00:07:32.861 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:32.861 "subtype": "NVMe", 00:07:32.861 "listen_addresses": [ 00:07:32.861 { 00:07:32.861 "transport": "TCP", 00:07:32.861 "trtype": "TCP", 00:07:32.861 "adrfam": "IPv4", 00:07:32.861 "traddr": "10.0.0.2", 00:07:32.861 "trsvcid": "4420" 00:07:32.861 } 00:07:32.861 ], 00:07:32.861 "allow_any_host": true, 00:07:32.861 "hosts": [], 00:07:32.861 "serial_number": "SPDK00000000000003", 00:07:32.861 "model_number": "SPDK bdev Controller", 00:07:32.861 "max_namespaces": 32, 00:07:32.861 "min_cntlid": 1, 00:07:32.861 "max_cntlid": 65519, 00:07:32.861 "namespaces": [ 00:07:32.861 { 00:07:32.861 "nsid": 1, 00:07:32.861 "bdev_name": "Null3", 00:07:32.861 "name": "Null3", 00:07:32.861 "nguid": "787910D93FF143098F9D5D7ED9DA9F30", 00:07:32.861 "uuid": "787910d9-3ff1-4309-8f9d-5d7ed9da9f30" 00:07:32.861 } 00:07:32.861 ] 00:07:32.861 }, 00:07:32.861 { 00:07:32.861 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:32.861 "subtype": "NVMe", 00:07:32.861 "listen_addresses": [ 00:07:32.861 { 00:07:32.861 "transport": "TCP", 00:07:32.861 "trtype": "TCP", 00:07:32.861 "adrfam": "IPv4", 00:07:32.861 "traddr": "10.0.0.2", 00:07:32.861 "trsvcid": "4420" 00:07:32.861 } 00:07:32.861 ], 00:07:32.861 "allow_any_host": true, 00:07:32.861 "hosts": [], 00:07:32.861 "serial_number": "SPDK00000000000004", 00:07:32.861 "model_number": "SPDK bdev Controller", 00:07:32.861 "max_namespaces": 32, 00:07:32.861 "min_cntlid": 1, 00:07:32.861 "max_cntlid": 65519, 00:07:32.861 "namespaces": [ 00:07:32.861 { 00:07:32.861 "nsid": 1, 00:07:32.861 "bdev_name": "Null4", 00:07:32.861 "name": "Null4", 00:07:32.861 "nguid": "FF42CA6D986E4104AF55205F67A5ABF8", 00:07:32.861 "uuid": "ff42ca6d-986e-4104-af55-205f67a5abf8" 00:07:32.861 } 00:07:32.861 ] 00:07:32.861 } 00:07:32.861 ] 00:07:32.861 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.861 09:30:55 -- target/discovery.sh@42 -- # seq 1 4 00:07:32.861 09:30:55 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:32.861 09:30:55 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:32.861 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.861 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.861 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.861 09:30:55 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:32.861 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.861 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.861 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.861 09:30:55 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:32.861 09:30:55 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:32.861 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.861 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.861 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.861 09:30:55 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:32.861 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.861 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.861 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.861 09:30:55 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:32.861 09:30:55 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:32.861 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.861 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.861 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.861 09:30:55 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:32.861 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.861 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.861 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.861 09:30:55 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:32.861 09:30:55 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:32.861 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.861 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.861 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.861 09:30:55 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:32.861 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.861 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.861 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.861 09:30:55 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:32.861 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.861 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.861 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.861 09:30:55 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:32.861 09:30:55 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:32.861 09:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:32.861 09:30:55 -- common/autotest_common.sh@10 -- # set +x 00:07:32.861 09:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:32.861 09:30:55 -- target/discovery.sh@49 -- # check_bdevs= 00:07:32.861 09:30:55 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:32.861 09:30:55 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:32.861 09:30:55 -- target/discovery.sh@57 -- # nvmftestfini 00:07:32.861 09:30:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:32.861 09:30:55 -- nvmf/common.sh@116 -- # sync 00:07:32.861 09:30:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:32.861 09:30:55 -- nvmf/common.sh@119 -- # set +e 00:07:32.861 09:30:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:32.861 09:30:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:32.861 rmmod nvme_tcp 00:07:32.861 rmmod nvme_fabrics 00:07:32.861 rmmod nvme_keyring 00:07:32.861 09:30:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:32.861 09:30:55 -- nvmf/common.sh@123 -- # set -e 00:07:32.861 09:30:55 -- nvmf/common.sh@124 -- # return 0 00:07:32.861 09:30:55 -- nvmf/common.sh@477 -- # '[' -n 4127696 ']' 00:07:32.861 09:30:55 -- nvmf/common.sh@478 -- # killprocess 4127696 00:07:32.861 09:30:55 -- common/autotest_common.sh@936 -- # '[' -z 4127696 ']' 00:07:32.861 09:30:55 -- common/autotest_common.sh@940 -- # kill -0 4127696 00:07:32.861 09:30:55 -- common/autotest_common.sh@941 -- # uname 00:07:32.861 09:30:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:32.861 09:30:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4127696 00:07:32.861 09:30:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:32.861 09:30:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:32.861 09:30:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4127696' 00:07:32.861 killing process with pid 4127696 00:07:32.861 09:30:55 -- common/autotest_common.sh@955 -- # kill 4127696 00:07:32.861 [2024-11-29 09:30:55.683586] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:32.861 09:30:55 -- common/autotest_common.sh@960 -- # wait 4127696 00:07:33.121 09:30:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:33.121 09:30:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:33.121 09:30:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:33.121 09:30:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:33.121 09:30:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:33.121 09:30:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:33.121 09:30:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:33.121 09:30:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:35.665 09:30:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:35.665 00:07:35.665 real 0m6.461s 00:07:35.665 user 0m8.019s 00:07:35.665 sys 0m2.023s 00:07:35.665 09:30:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:35.665 09:30:58 -- common/autotest_common.sh@10 -- # set +x 00:07:35.665 ************************************ 00:07:35.665 END TEST nvmf_discovery 00:07:35.665 ************************************ 00:07:35.665 09:30:58 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:35.665 09:30:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:35.665 09:30:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:35.665 09:30:58 -- common/autotest_common.sh@10 -- # set +x 00:07:35.665 ************************************ 00:07:35.665 START TEST nvmf_referrals 00:07:35.665 ************************************ 00:07:35.665 09:30:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:35.665 * Looking for test storage... 00:07:35.665 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:35.665 09:30:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:35.665 09:30:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:35.665 09:30:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:35.665 09:30:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:35.665 09:30:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:35.665 09:30:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:35.665 09:30:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:35.665 09:30:58 -- scripts/common.sh@335 -- # IFS=.-: 00:07:35.665 09:30:58 -- scripts/common.sh@335 -- # read -ra ver1 00:07:35.665 09:30:58 -- scripts/common.sh@336 -- # IFS=.-: 00:07:35.665 09:30:58 -- scripts/common.sh@336 -- # read -ra ver2 00:07:35.665 09:30:58 -- scripts/common.sh@337 -- # local 'op=<' 00:07:35.665 09:30:58 -- scripts/common.sh@339 -- # ver1_l=2 00:07:35.665 09:30:58 -- scripts/common.sh@340 -- # ver2_l=1 00:07:35.665 09:30:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:35.665 09:30:58 -- scripts/common.sh@343 -- # case "$op" in 00:07:35.665 09:30:58 -- scripts/common.sh@344 -- # : 1 00:07:35.665 09:30:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:35.665 09:30:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:35.665 09:30:58 -- scripts/common.sh@364 -- # decimal 1 00:07:35.665 09:30:58 -- scripts/common.sh@352 -- # local d=1 00:07:35.665 09:30:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:35.665 09:30:58 -- scripts/common.sh@354 -- # echo 1 00:07:35.665 09:30:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:35.665 09:30:58 -- scripts/common.sh@365 -- # decimal 2 00:07:35.665 09:30:58 -- scripts/common.sh@352 -- # local d=2 00:07:35.665 09:30:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:35.665 09:30:58 -- scripts/common.sh@354 -- # echo 2 00:07:35.665 09:30:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:35.666 09:30:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:35.666 09:30:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:35.666 09:30:58 -- scripts/common.sh@367 -- # return 0 00:07:35.666 09:30:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:35.666 09:30:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:35.666 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:35.666 --rc genhtml_branch_coverage=1 00:07:35.666 --rc genhtml_function_coverage=1 00:07:35.666 --rc genhtml_legend=1 00:07:35.666 --rc geninfo_all_blocks=1 00:07:35.666 --rc geninfo_unexecuted_blocks=1 00:07:35.666 00:07:35.666 ' 00:07:35.666 09:30:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:35.666 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:35.666 --rc genhtml_branch_coverage=1 00:07:35.666 --rc genhtml_function_coverage=1 00:07:35.666 --rc genhtml_legend=1 00:07:35.666 --rc geninfo_all_blocks=1 00:07:35.666 --rc geninfo_unexecuted_blocks=1 00:07:35.666 00:07:35.666 ' 00:07:35.666 09:30:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:35.666 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:35.666 --rc genhtml_branch_coverage=1 00:07:35.666 --rc genhtml_function_coverage=1 00:07:35.666 --rc genhtml_legend=1 00:07:35.666 --rc geninfo_all_blocks=1 00:07:35.666 --rc geninfo_unexecuted_blocks=1 00:07:35.666 00:07:35.666 ' 00:07:35.666 09:30:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:35.666 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:35.666 --rc genhtml_branch_coverage=1 00:07:35.666 --rc genhtml_function_coverage=1 00:07:35.666 --rc genhtml_legend=1 00:07:35.666 --rc geninfo_all_blocks=1 00:07:35.666 --rc geninfo_unexecuted_blocks=1 00:07:35.666 00:07:35.666 ' 00:07:35.666 09:30:58 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:35.666 09:30:58 -- nvmf/common.sh@7 -- # uname -s 00:07:35.666 09:30:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:35.666 09:30:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:35.666 09:30:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:35.666 09:30:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:35.666 09:30:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:35.666 09:30:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:35.666 09:30:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:35.666 09:30:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:35.666 09:30:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:35.666 09:30:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:35.666 09:30:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:35.666 09:30:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:35.666 09:30:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:35.666 09:30:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:35.666 09:30:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:35.666 09:30:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:35.666 09:30:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:35.666 09:30:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:35.666 09:30:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:35.666 09:30:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:35.666 09:30:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:35.666 09:30:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:35.666 09:30:58 -- paths/export.sh@5 -- # export PATH 00:07:35.666 09:30:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:35.666 09:30:58 -- nvmf/common.sh@46 -- # : 0 00:07:35.666 09:30:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:35.666 09:30:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:35.666 09:30:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:35.666 09:30:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:35.666 09:30:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:35.666 09:30:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:35.666 09:30:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:35.666 09:30:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:35.666 09:30:58 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:35.666 09:30:58 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:35.666 09:30:58 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:35.666 09:30:58 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:35.666 09:30:58 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:35.666 09:30:58 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:35.666 09:30:58 -- target/referrals.sh@37 -- # nvmftestinit 00:07:35.666 09:30:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:35.666 09:30:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:35.666 09:30:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:35.666 09:30:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:35.666 09:30:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:35.666 09:30:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:35.666 09:30:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:35.666 09:30:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:35.666 09:30:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:35.666 09:30:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:35.666 09:30:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:35.666 09:30:58 -- common/autotest_common.sh@10 -- # set +x 00:07:37.582 09:31:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:37.582 09:31:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:37.582 09:31:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:37.582 09:31:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:37.582 09:31:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:37.582 09:31:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:37.582 09:31:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:37.582 09:31:00 -- nvmf/common.sh@294 -- # net_devs=() 00:07:37.582 09:31:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:37.582 09:31:00 -- nvmf/common.sh@295 -- # e810=() 00:07:37.582 09:31:00 -- nvmf/common.sh@295 -- # local -ga e810 00:07:37.582 09:31:00 -- nvmf/common.sh@296 -- # x722=() 00:07:37.582 09:31:00 -- nvmf/common.sh@296 -- # local -ga x722 00:07:37.582 09:31:00 -- nvmf/common.sh@297 -- # mlx=() 00:07:37.582 09:31:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:37.582 09:31:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:37.582 09:31:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:37.582 09:31:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:37.582 09:31:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:37.582 09:31:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:37.582 09:31:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:37.582 09:31:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:37.582 09:31:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:37.582 09:31:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:37.582 09:31:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:37.582 09:31:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:37.582 09:31:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:37.582 09:31:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:37.582 09:31:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:37.582 09:31:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:37.582 09:31:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:37.582 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:37.582 09:31:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:37.582 09:31:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:37.582 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:37.582 09:31:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:37.582 09:31:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:37.582 09:31:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:37.582 09:31:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:37.582 09:31:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:37.582 09:31:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:37.582 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:37.582 09:31:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:37.582 09:31:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:37.582 09:31:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:37.582 09:31:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:37.582 09:31:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:37.582 09:31:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:37.582 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:37.582 09:31:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:37.582 09:31:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:37.582 09:31:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:37.582 09:31:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:37.582 09:31:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:37.582 09:31:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:37.582 09:31:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:37.582 09:31:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:37.582 09:31:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:37.582 09:31:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:37.582 09:31:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:37.582 09:31:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:37.582 09:31:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:37.582 09:31:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:37.582 09:31:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:37.582 09:31:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:37.582 09:31:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:37.582 09:31:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:37.582 09:31:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:37.582 09:31:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:37.582 09:31:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:37.582 09:31:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:37.582 09:31:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:37.582 09:31:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:37.582 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:37.582 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:07:37.582 00:07:37.582 --- 10.0.0.2 ping statistics --- 00:07:37.582 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:37.582 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:07:37.582 09:31:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:37.582 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:37.582 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:07:37.582 00:07:37.582 --- 10.0.0.1 ping statistics --- 00:07:37.582 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:37.582 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:07:37.582 09:31:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:37.582 09:31:00 -- nvmf/common.sh@410 -- # return 0 00:07:37.582 09:31:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:37.582 09:31:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:37.582 09:31:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:37.582 09:31:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:37.582 09:31:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:37.582 09:31:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:37.582 09:31:00 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:37.582 09:31:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:37.582 09:31:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:37.582 09:31:00 -- common/autotest_common.sh@10 -- # set +x 00:07:37.582 09:31:00 -- nvmf/common.sh@469 -- # nvmfpid=4129952 00:07:37.582 09:31:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:37.583 09:31:00 -- nvmf/common.sh@470 -- # waitforlisten 4129952 00:07:37.583 09:31:00 -- common/autotest_common.sh@829 -- # '[' -z 4129952 ']' 00:07:37.583 09:31:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:37.583 09:31:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:37.583 09:31:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:37.583 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:37.583 09:31:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:37.583 09:31:00 -- common/autotest_common.sh@10 -- # set +x 00:07:37.843 [2024-11-29 09:31:00.428485] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:37.843 [2024-11-29 09:31:00.428552] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:37.843 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.843 [2024-11-29 09:31:00.499206] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:37.843 [2024-11-29 09:31:00.619157] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:37.843 [2024-11-29 09:31:00.619338] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:37.843 [2024-11-29 09:31:00.619358] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:37.843 [2024-11-29 09:31:00.619383] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:37.843 [2024-11-29 09:31:00.619451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:37.843 [2024-11-29 09:31:00.619507] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:37.843 [2024-11-29 09:31:00.619562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:37.843 [2024-11-29 09:31:00.619565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:38.785 09:31:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:38.785 09:31:01 -- common/autotest_common.sh@862 -- # return 0 00:07:38.785 09:31:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:38.785 09:31:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:38.785 09:31:01 -- common/autotest_common.sh@10 -- # set +x 00:07:38.785 09:31:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:38.785 09:31:01 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:38.785 09:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.785 09:31:01 -- common/autotest_common.sh@10 -- # set +x 00:07:38.785 [2024-11-29 09:31:01.476094] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:38.785 09:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.785 09:31:01 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:38.785 09:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.785 09:31:01 -- common/autotest_common.sh@10 -- # set +x 00:07:38.785 [2024-11-29 09:31:01.488271] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:38.785 09:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.785 09:31:01 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:38.785 09:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.785 09:31:01 -- common/autotest_common.sh@10 -- # set +x 00:07:38.785 09:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.785 09:31:01 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:38.785 09:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.785 09:31:01 -- common/autotest_common.sh@10 -- # set +x 00:07:38.785 09:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.785 09:31:01 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:38.785 09:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.785 09:31:01 -- common/autotest_common.sh@10 -- # set +x 00:07:38.785 09:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.785 09:31:01 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:38.785 09:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.785 09:31:01 -- target/referrals.sh@48 -- # jq length 00:07:38.785 09:31:01 -- common/autotest_common.sh@10 -- # set +x 00:07:38.785 09:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.785 09:31:01 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:38.785 09:31:01 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:38.785 09:31:01 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:38.785 09:31:01 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:38.785 09:31:01 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:38.785 09:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.785 09:31:01 -- common/autotest_common.sh@10 -- # set +x 00:07:38.785 09:31:01 -- target/referrals.sh@21 -- # sort 00:07:38.785 09:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.785 09:31:01 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:38.785 09:31:01 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:38.785 09:31:01 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:38.785 09:31:01 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:38.785 09:31:01 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:38.785 09:31:01 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:38.785 09:31:01 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:38.785 09:31:01 -- target/referrals.sh@26 -- # sort 00:07:39.044 09:31:01 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:39.044 09:31:01 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:39.044 09:31:01 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:39.044 09:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.044 09:31:01 -- common/autotest_common.sh@10 -- # set +x 00:07:39.044 09:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.044 09:31:01 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:39.044 09:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.044 09:31:01 -- common/autotest_common.sh@10 -- # set +x 00:07:39.044 09:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.044 09:31:01 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:39.045 09:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.045 09:31:01 -- common/autotest_common.sh@10 -- # set +x 00:07:39.045 09:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.045 09:31:01 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:39.045 09:31:01 -- target/referrals.sh@56 -- # jq length 00:07:39.045 09:31:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.045 09:31:01 -- common/autotest_common.sh@10 -- # set +x 00:07:39.045 09:31:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.045 09:31:01 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:39.045 09:31:01 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:39.045 09:31:01 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:39.045 09:31:01 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:39.045 09:31:01 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:39.045 09:31:01 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:39.045 09:31:01 -- target/referrals.sh@26 -- # sort 00:07:39.303 09:31:02 -- target/referrals.sh@26 -- # echo 00:07:39.303 09:31:02 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:39.303 09:31:02 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:39.303 09:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.303 09:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:39.303 09:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.303 09:31:02 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:39.303 09:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.303 09:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:39.303 09:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.303 09:31:02 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:39.303 09:31:02 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:39.303 09:31:02 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:39.303 09:31:02 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:39.303 09:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.303 09:31:02 -- target/referrals.sh@21 -- # sort 00:07:39.303 09:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:39.303 09:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.561 09:31:02 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:39.561 09:31:02 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:39.561 09:31:02 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:39.561 09:31:02 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:39.561 09:31:02 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:39.561 09:31:02 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:39.561 09:31:02 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:39.561 09:31:02 -- target/referrals.sh@26 -- # sort 00:07:39.561 09:31:02 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:39.561 09:31:02 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:39.561 09:31:02 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:39.561 09:31:02 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:39.561 09:31:02 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:39.561 09:31:02 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:39.561 09:31:02 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:39.819 09:31:02 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:39.819 09:31:02 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:39.819 09:31:02 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:39.819 09:31:02 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:39.819 09:31:02 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:39.819 09:31:02 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:39.819 09:31:02 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:39.819 09:31:02 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:39.819 09:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.819 09:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:39.819 09:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.819 09:31:02 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:39.819 09:31:02 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:39.819 09:31:02 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:39.819 09:31:02 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:39.819 09:31:02 -- target/referrals.sh@21 -- # sort 00:07:39.819 09:31:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:39.819 09:31:02 -- common/autotest_common.sh@10 -- # set +x 00:07:39.819 09:31:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:39.819 09:31:02 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:39.819 09:31:02 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:39.819 09:31:02 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:39.819 09:31:02 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:39.819 09:31:02 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:39.820 09:31:02 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:39.820 09:31:02 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:39.820 09:31:02 -- target/referrals.sh@26 -- # sort 00:07:40.080 09:31:02 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:40.080 09:31:02 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:40.080 09:31:02 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:40.080 09:31:02 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:40.080 09:31:02 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:40.080 09:31:02 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:40.080 09:31:02 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:40.339 09:31:02 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:40.339 09:31:02 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:40.339 09:31:02 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:40.339 09:31:02 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:40.339 09:31:02 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:40.339 09:31:02 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:40.339 09:31:03 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:40.339 09:31:03 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:40.339 09:31:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.339 09:31:03 -- common/autotest_common.sh@10 -- # set +x 00:07:40.339 09:31:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.339 09:31:03 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:40.339 09:31:03 -- target/referrals.sh@82 -- # jq length 00:07:40.339 09:31:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.339 09:31:03 -- common/autotest_common.sh@10 -- # set +x 00:07:40.339 09:31:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.598 09:31:03 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:40.598 09:31:03 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:40.598 09:31:03 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:40.598 09:31:03 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:40.599 09:31:03 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:40.599 09:31:03 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:40.599 09:31:03 -- target/referrals.sh@26 -- # sort 00:07:40.599 09:31:03 -- target/referrals.sh@26 -- # echo 00:07:40.599 09:31:03 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:40.599 09:31:03 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:40.599 09:31:03 -- target/referrals.sh@86 -- # nvmftestfini 00:07:40.599 09:31:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:40.599 09:31:03 -- nvmf/common.sh@116 -- # sync 00:07:40.599 09:31:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:40.599 09:31:03 -- nvmf/common.sh@119 -- # set +e 00:07:40.599 09:31:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:40.599 09:31:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:40.599 rmmod nvme_tcp 00:07:40.860 rmmod nvme_fabrics 00:07:40.861 rmmod nvme_keyring 00:07:40.861 09:31:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:40.861 09:31:03 -- nvmf/common.sh@123 -- # set -e 00:07:40.861 09:31:03 -- nvmf/common.sh@124 -- # return 0 00:07:40.861 09:31:03 -- nvmf/common.sh@477 -- # '[' -n 4129952 ']' 00:07:40.861 09:31:03 -- nvmf/common.sh@478 -- # killprocess 4129952 00:07:40.861 09:31:03 -- common/autotest_common.sh@936 -- # '[' -z 4129952 ']' 00:07:40.861 09:31:03 -- common/autotest_common.sh@940 -- # kill -0 4129952 00:07:40.861 09:31:03 -- common/autotest_common.sh@941 -- # uname 00:07:40.861 09:31:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:40.861 09:31:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4129952 00:07:40.861 09:31:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:40.861 09:31:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:40.861 09:31:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4129952' 00:07:40.861 killing process with pid 4129952 00:07:40.861 09:31:03 -- common/autotest_common.sh@955 -- # kill 4129952 00:07:40.861 09:31:03 -- common/autotest_common.sh@960 -- # wait 4129952 00:07:41.120 09:31:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:41.120 09:31:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:41.120 09:31:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:41.120 09:31:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:41.120 09:31:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:41.120 09:31:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:41.120 09:31:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:41.120 09:31:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:43.031 09:31:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:43.031 00:07:43.031 real 0m7.812s 00:07:43.031 user 0m14.265s 00:07:43.031 sys 0m2.272s 00:07:43.031 09:31:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:43.031 09:31:05 -- common/autotest_common.sh@10 -- # set +x 00:07:43.031 ************************************ 00:07:43.031 END TEST nvmf_referrals 00:07:43.031 ************************************ 00:07:43.031 09:31:05 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:43.031 09:31:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:43.031 09:31:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:43.031 09:31:05 -- common/autotest_common.sh@10 -- # set +x 00:07:43.031 ************************************ 00:07:43.031 START TEST nvmf_connect_disconnect 00:07:43.031 ************************************ 00:07:43.031 09:31:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:43.291 * Looking for test storage... 00:07:43.291 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:43.291 09:31:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:43.291 09:31:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:43.291 09:31:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:43.291 09:31:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:43.291 09:31:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:43.291 09:31:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:43.291 09:31:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:43.291 09:31:06 -- scripts/common.sh@335 -- # IFS=.-: 00:07:43.291 09:31:06 -- scripts/common.sh@335 -- # read -ra ver1 00:07:43.291 09:31:06 -- scripts/common.sh@336 -- # IFS=.-: 00:07:43.291 09:31:06 -- scripts/common.sh@336 -- # read -ra ver2 00:07:43.291 09:31:06 -- scripts/common.sh@337 -- # local 'op=<' 00:07:43.291 09:31:06 -- scripts/common.sh@339 -- # ver1_l=2 00:07:43.291 09:31:06 -- scripts/common.sh@340 -- # ver2_l=1 00:07:43.291 09:31:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:43.291 09:31:06 -- scripts/common.sh@343 -- # case "$op" in 00:07:43.291 09:31:06 -- scripts/common.sh@344 -- # : 1 00:07:43.291 09:31:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:43.291 09:31:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:43.291 09:31:06 -- scripts/common.sh@364 -- # decimal 1 00:07:43.291 09:31:06 -- scripts/common.sh@352 -- # local d=1 00:07:43.291 09:31:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:43.291 09:31:06 -- scripts/common.sh@354 -- # echo 1 00:07:43.291 09:31:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:43.291 09:31:06 -- scripts/common.sh@365 -- # decimal 2 00:07:43.291 09:31:06 -- scripts/common.sh@352 -- # local d=2 00:07:43.291 09:31:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:43.291 09:31:06 -- scripts/common.sh@354 -- # echo 2 00:07:43.291 09:31:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:43.291 09:31:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:43.291 09:31:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:43.291 09:31:06 -- scripts/common.sh@367 -- # return 0 00:07:43.291 09:31:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:43.291 09:31:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:43.291 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:43.291 --rc genhtml_branch_coverage=1 00:07:43.291 --rc genhtml_function_coverage=1 00:07:43.291 --rc genhtml_legend=1 00:07:43.291 --rc geninfo_all_blocks=1 00:07:43.291 --rc geninfo_unexecuted_blocks=1 00:07:43.291 00:07:43.291 ' 00:07:43.291 09:31:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:43.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:43.292 --rc genhtml_branch_coverage=1 00:07:43.292 --rc genhtml_function_coverage=1 00:07:43.292 --rc genhtml_legend=1 00:07:43.292 --rc geninfo_all_blocks=1 00:07:43.292 --rc geninfo_unexecuted_blocks=1 00:07:43.292 00:07:43.292 ' 00:07:43.292 09:31:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:43.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:43.292 --rc genhtml_branch_coverage=1 00:07:43.292 --rc genhtml_function_coverage=1 00:07:43.292 --rc genhtml_legend=1 00:07:43.292 --rc geninfo_all_blocks=1 00:07:43.292 --rc geninfo_unexecuted_blocks=1 00:07:43.292 00:07:43.292 ' 00:07:43.292 09:31:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:43.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:43.292 --rc genhtml_branch_coverage=1 00:07:43.292 --rc genhtml_function_coverage=1 00:07:43.292 --rc genhtml_legend=1 00:07:43.292 --rc geninfo_all_blocks=1 00:07:43.292 --rc geninfo_unexecuted_blocks=1 00:07:43.292 00:07:43.292 ' 00:07:43.292 09:31:06 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:43.292 09:31:06 -- nvmf/common.sh@7 -- # uname -s 00:07:43.292 09:31:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:43.292 09:31:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:43.292 09:31:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:43.292 09:31:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:43.292 09:31:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:43.292 09:31:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:43.292 09:31:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:43.292 09:31:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:43.292 09:31:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:43.292 09:31:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:43.292 09:31:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:43.292 09:31:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:43.292 09:31:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:43.292 09:31:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:43.292 09:31:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:43.292 09:31:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:43.292 09:31:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:43.292 09:31:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:43.292 09:31:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:43.292 09:31:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:43.292 09:31:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:43.292 09:31:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:43.292 09:31:06 -- paths/export.sh@5 -- # export PATH 00:07:43.292 09:31:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:43.292 09:31:06 -- nvmf/common.sh@46 -- # : 0 00:07:43.292 09:31:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:43.292 09:31:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:43.292 09:31:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:43.292 09:31:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:43.292 09:31:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:43.292 09:31:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:43.292 09:31:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:43.292 09:31:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:43.292 09:31:06 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:43.292 09:31:06 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:43.292 09:31:06 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:43.292 09:31:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:43.292 09:31:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:43.292 09:31:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:43.292 09:31:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:43.292 09:31:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:43.292 09:31:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:43.292 09:31:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:43.292 09:31:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:43.292 09:31:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:43.292 09:31:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:43.292 09:31:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:43.292 09:31:06 -- common/autotest_common.sh@10 -- # set +x 00:07:45.236 09:31:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:45.236 09:31:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:45.236 09:31:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:45.236 09:31:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:45.236 09:31:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:45.236 09:31:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:45.236 09:31:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:45.236 09:31:08 -- nvmf/common.sh@294 -- # net_devs=() 00:07:45.236 09:31:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:45.236 09:31:08 -- nvmf/common.sh@295 -- # e810=() 00:07:45.236 09:31:08 -- nvmf/common.sh@295 -- # local -ga e810 00:07:45.236 09:31:08 -- nvmf/common.sh@296 -- # x722=() 00:07:45.236 09:31:08 -- nvmf/common.sh@296 -- # local -ga x722 00:07:45.236 09:31:08 -- nvmf/common.sh@297 -- # mlx=() 00:07:45.236 09:31:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:45.236 09:31:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:45.236 09:31:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:45.236 09:31:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:45.236 09:31:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:45.236 09:31:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:45.236 09:31:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:45.236 09:31:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:45.236 09:31:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:45.236 09:31:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:45.236 09:31:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:45.236 09:31:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:45.236 09:31:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:45.236 09:31:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:45.236 09:31:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:45.236 09:31:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:45.236 09:31:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:45.236 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:45.236 09:31:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:45.236 09:31:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:45.236 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:45.236 09:31:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:45.236 09:31:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:45.236 09:31:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:45.236 09:31:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:45.236 09:31:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:45.236 09:31:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:45.236 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:45.236 09:31:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:45.236 09:31:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:45.236 09:31:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:45.236 09:31:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:45.236 09:31:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:45.236 09:31:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:45.236 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:45.236 09:31:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:45.236 09:31:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:45.236 09:31:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:45.236 09:31:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:45.236 09:31:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:45.236 09:31:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:45.236 09:31:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:45.236 09:31:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:45.236 09:31:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:45.236 09:31:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:45.236 09:31:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:45.236 09:31:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:45.236 09:31:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:45.236 09:31:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:45.236 09:31:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:45.236 09:31:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:45.236 09:31:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:45.236 09:31:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:45.495 09:31:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:45.495 09:31:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:45.495 09:31:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:45.495 09:31:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:45.495 09:31:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:45.495 09:31:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:45.495 09:31:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:45.495 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:45.495 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.213 ms 00:07:45.495 00:07:45.495 --- 10.0.0.2 ping statistics --- 00:07:45.495 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:45.495 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:07:45.495 09:31:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:45.495 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:45.495 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:07:45.495 00:07:45.495 --- 10.0.0.1 ping statistics --- 00:07:45.495 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:45.495 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:07:45.495 09:31:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:45.495 09:31:08 -- nvmf/common.sh@410 -- # return 0 00:07:45.495 09:31:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:45.495 09:31:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:45.495 09:31:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:45.495 09:31:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:45.495 09:31:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:45.495 09:31:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:45.495 09:31:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:45.496 09:31:08 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:45.496 09:31:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:45.496 09:31:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:45.496 09:31:08 -- common/autotest_common.sh@10 -- # set +x 00:07:45.496 09:31:08 -- nvmf/common.sh@469 -- # nvmfpid=4132405 00:07:45.496 09:31:08 -- nvmf/common.sh@470 -- # waitforlisten 4132405 00:07:45.496 09:31:08 -- common/autotest_common.sh@829 -- # '[' -z 4132405 ']' 00:07:45.496 09:31:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:45.496 09:31:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:45.496 09:31:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:45.496 09:31:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:45.496 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:45.496 09:31:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:45.496 09:31:08 -- common/autotest_common.sh@10 -- # set +x 00:07:45.496 [2024-11-29 09:31:08.246261] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:45.496 [2024-11-29 09:31:08.246340] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:45.496 EAL: No free 2048 kB hugepages reported on node 1 00:07:45.496 [2024-11-29 09:31:08.315196] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:45.756 [2024-11-29 09:31:08.434070] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:45.756 [2024-11-29 09:31:08.434253] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:45.756 [2024-11-29 09:31:08.434273] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:45.756 [2024-11-29 09:31:08.434288] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:45.756 [2024-11-29 09:31:08.434517] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:45.756 [2024-11-29 09:31:08.434576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:45.756 [2024-11-29 09:31:08.434629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:45.756 [2024-11-29 09:31:08.434632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.693 09:31:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:46.693 09:31:09 -- common/autotest_common.sh@862 -- # return 0 00:07:46.693 09:31:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:46.693 09:31:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:46.693 09:31:09 -- common/autotest_common.sh@10 -- # set +x 00:07:46.693 09:31:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:46.693 09:31:09 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:46.693 09:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.693 09:31:09 -- common/autotest_common.sh@10 -- # set +x 00:07:46.693 [2024-11-29 09:31:09.283131] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:46.693 09:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.693 09:31:09 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:46.693 09:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.693 09:31:09 -- common/autotest_common.sh@10 -- # set +x 00:07:46.693 09:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.693 09:31:09 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:46.693 09:31:09 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:46.693 09:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.693 09:31:09 -- common/autotest_common.sh@10 -- # set +x 00:07:46.693 09:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.693 09:31:09 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:46.693 09:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.693 09:31:09 -- common/autotest_common.sh@10 -- # set +x 00:07:46.693 09:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.693 09:31:09 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:46.693 09:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:46.693 09:31:09 -- common/autotest_common.sh@10 -- # set +x 00:07:46.693 [2024-11-29 09:31:09.337083] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:46.693 09:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:46.693 09:31:09 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:46.693 09:31:09 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:46.693 09:31:09 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:46.693 09:31:09 -- target/connect_disconnect.sh@34 -- # set +x 00:07:49.234 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:51.146 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:53.686 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:56.224 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:58.139 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:00.678 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:03.213 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:05.120 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:07.659 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:10.200 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:12.138 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.674 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:16.580 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:19.117 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:21.741 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:23.643 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:26.181 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:28.712 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.619 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.153 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:35.060 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.602 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:39.504 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:42.041 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.577 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.483 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.021 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.558 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.466 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:56.003 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.598 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.504 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.047 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:04.954 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.492 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.035 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.943 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.539 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.446 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.987 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.523 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.430 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.511 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.420 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.954 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.494 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.404 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.939 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.845 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.390 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.926 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.837 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.372 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.277 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.812 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.364 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.267 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.804 [2024-11-29 09:33:25.249124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1710420 is same with the state(5) to be set 00:10:02.804 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.343 [2024-11-29 09:33:27.572213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1710420 is same with the state(5) to be set 00:10:05.344 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.254 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.793 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.331 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.244 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.782 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.770 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.310 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.217 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.758 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.298 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.207 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.743 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.646 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.187 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.729 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.643 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.183 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.723 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.626 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:51.163 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.115 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.670 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.204 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.109 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.646 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.181 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.089 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.628 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.165 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.714 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.621 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:19.154 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.692 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.599 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.134 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.669 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.583 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.126 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.667 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.573 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.573 09:35:00 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:37.573 09:35:00 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:37.573 09:35:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:37.573 09:35:00 -- nvmf/common.sh@116 -- # sync 00:11:37.573 09:35:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:37.573 09:35:00 -- nvmf/common.sh@119 -- # set +e 00:11:37.573 09:35:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:37.573 09:35:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:37.573 rmmod nvme_tcp 00:11:37.573 rmmod nvme_fabrics 00:11:37.573 rmmod nvme_keyring 00:11:37.573 09:35:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:37.573 09:35:00 -- nvmf/common.sh@123 -- # set -e 00:11:37.573 09:35:00 -- nvmf/common.sh@124 -- # return 0 00:11:37.573 09:35:00 -- nvmf/common.sh@477 -- # '[' -n 4132405 ']' 00:11:37.573 09:35:00 -- nvmf/common.sh@478 -- # killprocess 4132405 00:11:37.573 09:35:00 -- common/autotest_common.sh@936 -- # '[' -z 4132405 ']' 00:11:37.573 09:35:00 -- common/autotest_common.sh@940 -- # kill -0 4132405 00:11:37.573 09:35:00 -- common/autotest_common.sh@941 -- # uname 00:11:37.573 09:35:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:37.573 09:35:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4132405 00:11:37.573 09:35:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:37.573 09:35:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:37.573 09:35:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4132405' 00:11:37.573 killing process with pid 4132405 00:11:37.573 09:35:00 -- common/autotest_common.sh@955 -- # kill 4132405 00:11:37.573 09:35:00 -- common/autotest_common.sh@960 -- # wait 4132405 00:11:37.831 09:35:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:37.831 09:35:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:37.831 09:35:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:37.831 09:35:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:37.831 09:35:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:37.831 09:35:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:37.831 09:35:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:37.831 09:35:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:39.741 09:35:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:40.002 00:11:40.002 real 3m56.712s 00:11:40.002 user 15m2.834s 00:11:40.002 sys 0m34.499s 00:11:40.002 09:35:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:40.002 09:35:02 -- common/autotest_common.sh@10 -- # set +x 00:11:40.002 ************************************ 00:11:40.002 END TEST nvmf_connect_disconnect 00:11:40.002 ************************************ 00:11:40.002 09:35:02 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:40.002 09:35:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:40.002 09:35:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:40.002 09:35:02 -- common/autotest_common.sh@10 -- # set +x 00:11:40.002 ************************************ 00:11:40.002 START TEST nvmf_multitarget 00:11:40.002 ************************************ 00:11:40.002 09:35:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:40.002 * Looking for test storage... 00:11:40.002 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:40.002 09:35:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:40.002 09:35:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:40.002 09:35:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:40.002 09:35:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:40.002 09:35:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:40.003 09:35:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:40.003 09:35:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:40.003 09:35:02 -- scripts/common.sh@335 -- # IFS=.-: 00:11:40.003 09:35:02 -- scripts/common.sh@335 -- # read -ra ver1 00:11:40.003 09:35:02 -- scripts/common.sh@336 -- # IFS=.-: 00:11:40.003 09:35:02 -- scripts/common.sh@336 -- # read -ra ver2 00:11:40.003 09:35:02 -- scripts/common.sh@337 -- # local 'op=<' 00:11:40.003 09:35:02 -- scripts/common.sh@339 -- # ver1_l=2 00:11:40.003 09:35:02 -- scripts/common.sh@340 -- # ver2_l=1 00:11:40.003 09:35:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:40.003 09:35:02 -- scripts/common.sh@343 -- # case "$op" in 00:11:40.003 09:35:02 -- scripts/common.sh@344 -- # : 1 00:11:40.003 09:35:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:40.003 09:35:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:40.003 09:35:02 -- scripts/common.sh@364 -- # decimal 1 00:11:40.003 09:35:02 -- scripts/common.sh@352 -- # local d=1 00:11:40.003 09:35:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:40.003 09:35:02 -- scripts/common.sh@354 -- # echo 1 00:11:40.003 09:35:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:40.003 09:35:02 -- scripts/common.sh@365 -- # decimal 2 00:11:40.003 09:35:02 -- scripts/common.sh@352 -- # local d=2 00:11:40.003 09:35:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:40.003 09:35:02 -- scripts/common.sh@354 -- # echo 2 00:11:40.003 09:35:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:40.003 09:35:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:40.003 09:35:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:40.003 09:35:02 -- scripts/common.sh@367 -- # return 0 00:11:40.003 09:35:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:40.003 09:35:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:40.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:40.003 --rc genhtml_branch_coverage=1 00:11:40.003 --rc genhtml_function_coverage=1 00:11:40.003 --rc genhtml_legend=1 00:11:40.003 --rc geninfo_all_blocks=1 00:11:40.003 --rc geninfo_unexecuted_blocks=1 00:11:40.003 00:11:40.003 ' 00:11:40.003 09:35:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:40.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:40.003 --rc genhtml_branch_coverage=1 00:11:40.003 --rc genhtml_function_coverage=1 00:11:40.003 --rc genhtml_legend=1 00:11:40.003 --rc geninfo_all_blocks=1 00:11:40.003 --rc geninfo_unexecuted_blocks=1 00:11:40.003 00:11:40.003 ' 00:11:40.003 09:35:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:40.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:40.003 --rc genhtml_branch_coverage=1 00:11:40.003 --rc genhtml_function_coverage=1 00:11:40.003 --rc genhtml_legend=1 00:11:40.003 --rc geninfo_all_blocks=1 00:11:40.003 --rc geninfo_unexecuted_blocks=1 00:11:40.003 00:11:40.003 ' 00:11:40.003 09:35:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:40.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:40.003 --rc genhtml_branch_coverage=1 00:11:40.003 --rc genhtml_function_coverage=1 00:11:40.003 --rc genhtml_legend=1 00:11:40.003 --rc geninfo_all_blocks=1 00:11:40.003 --rc geninfo_unexecuted_blocks=1 00:11:40.003 00:11:40.003 ' 00:11:40.003 09:35:02 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:40.003 09:35:02 -- nvmf/common.sh@7 -- # uname -s 00:11:40.003 09:35:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:40.003 09:35:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:40.003 09:35:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:40.003 09:35:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:40.003 09:35:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:40.003 09:35:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:40.003 09:35:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:40.003 09:35:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:40.003 09:35:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:40.003 09:35:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:40.003 09:35:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:40.003 09:35:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:40.003 09:35:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:40.003 09:35:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:40.003 09:35:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:40.003 09:35:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:40.003 09:35:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:40.003 09:35:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:40.003 09:35:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:40.003 09:35:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:40.003 09:35:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:40.003 09:35:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:40.003 09:35:02 -- paths/export.sh@5 -- # export PATH 00:11:40.003 09:35:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:40.003 09:35:02 -- nvmf/common.sh@46 -- # : 0 00:11:40.003 09:35:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:40.003 09:35:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:40.003 09:35:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:40.003 09:35:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:40.003 09:35:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:40.003 09:35:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:40.003 09:35:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:40.003 09:35:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:40.003 09:35:02 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:40.003 09:35:02 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:40.003 09:35:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:40.003 09:35:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:40.003 09:35:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:40.003 09:35:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:40.003 09:35:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:40.003 09:35:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:40.003 09:35:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:40.003 09:35:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:40.003 09:35:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:40.003 09:35:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:40.003 09:35:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:40.003 09:35:02 -- common/autotest_common.sh@10 -- # set +x 00:11:42.610 09:35:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:42.610 09:35:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:42.610 09:35:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:42.610 09:35:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:42.610 09:35:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:42.610 09:35:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:42.610 09:35:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:42.610 09:35:04 -- nvmf/common.sh@294 -- # net_devs=() 00:11:42.610 09:35:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:42.610 09:35:04 -- nvmf/common.sh@295 -- # e810=() 00:11:42.610 09:35:04 -- nvmf/common.sh@295 -- # local -ga e810 00:11:42.610 09:35:04 -- nvmf/common.sh@296 -- # x722=() 00:11:42.610 09:35:04 -- nvmf/common.sh@296 -- # local -ga x722 00:11:42.610 09:35:04 -- nvmf/common.sh@297 -- # mlx=() 00:11:42.610 09:35:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:42.610 09:35:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:42.610 09:35:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:42.610 09:35:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:42.610 09:35:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:42.610 09:35:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:42.610 09:35:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:42.610 09:35:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:42.610 09:35:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:42.610 09:35:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:42.610 09:35:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:42.610 09:35:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:42.610 09:35:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:42.610 09:35:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:42.610 09:35:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:42.610 09:35:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:42.610 09:35:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:42.610 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:42.610 09:35:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:42.610 09:35:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:42.610 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:42.610 09:35:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:42.610 09:35:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:42.610 09:35:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:42.610 09:35:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:42.610 09:35:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:42.610 09:35:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:42.610 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:42.610 09:35:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:42.610 09:35:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:42.610 09:35:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:42.610 09:35:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:42.610 09:35:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:42.610 09:35:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:42.610 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:42.610 09:35:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:42.610 09:35:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:42.610 09:35:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:42.610 09:35:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:42.610 09:35:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:42.610 09:35:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:42.610 09:35:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:42.610 09:35:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:42.610 09:35:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:42.610 09:35:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:42.610 09:35:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:42.610 09:35:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:42.610 09:35:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:42.610 09:35:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:42.610 09:35:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:42.610 09:35:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:42.610 09:35:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:42.610 09:35:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:42.610 09:35:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:42.610 09:35:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:42.610 09:35:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:42.610 09:35:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:42.610 09:35:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:42.610 09:35:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:42.610 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:42.610 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:11:42.610 00:11:42.610 --- 10.0.0.2 ping statistics --- 00:11:42.610 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:42.610 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:11:42.610 09:35:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:42.610 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:42.610 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:11:42.610 00:11:42.610 --- 10.0.0.1 ping statistics --- 00:11:42.610 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:42.610 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:11:42.610 09:35:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:42.610 09:35:04 -- nvmf/common.sh@410 -- # return 0 00:11:42.610 09:35:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:42.610 09:35:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:42.610 09:35:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:42.610 09:35:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:42.610 09:35:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:42.610 09:35:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:42.610 09:35:04 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:42.610 09:35:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:42.610 09:35:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:42.610 09:35:04 -- common/autotest_common.sh@10 -- # set +x 00:11:42.610 09:35:05 -- nvmf/common.sh@469 -- # nvmfpid=4164430 00:11:42.610 09:35:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:42.610 09:35:05 -- nvmf/common.sh@470 -- # waitforlisten 4164430 00:11:42.610 09:35:05 -- common/autotest_common.sh@829 -- # '[' -z 4164430 ']' 00:11:42.610 09:35:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:42.610 09:35:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:42.610 09:35:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:42.610 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:42.611 09:35:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:42.611 09:35:05 -- common/autotest_common.sh@10 -- # set +x 00:11:42.611 [2024-11-29 09:35:05.042954] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:42.611 [2024-11-29 09:35:05.043025] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:42.611 EAL: No free 2048 kB hugepages reported on node 1 00:11:42.611 [2024-11-29 09:35:05.107132] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:42.611 [2024-11-29 09:35:05.217471] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:42.611 [2024-11-29 09:35:05.217639] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:42.611 [2024-11-29 09:35:05.217655] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:42.611 [2024-11-29 09:35:05.217668] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:42.611 [2024-11-29 09:35:05.217732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:42.611 [2024-11-29 09:35:05.217794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:42.611 [2024-11-29 09:35:05.217860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:42.611 [2024-11-29 09:35:05.217863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:43.547 09:35:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:43.547 09:35:06 -- common/autotest_common.sh@862 -- # return 0 00:11:43.547 09:35:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:43.547 09:35:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:43.547 09:35:06 -- common/autotest_common.sh@10 -- # set +x 00:11:43.547 09:35:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:43.547 09:35:06 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:43.547 09:35:06 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:43.547 09:35:06 -- target/multitarget.sh@21 -- # jq length 00:11:43.547 09:35:06 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:43.547 09:35:06 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:43.547 "nvmf_tgt_1" 00:11:43.547 09:35:06 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:43.806 "nvmf_tgt_2" 00:11:43.806 09:35:06 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:43.806 09:35:06 -- target/multitarget.sh@28 -- # jq length 00:11:43.806 09:35:06 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:43.806 09:35:06 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:43.806 true 00:11:43.806 09:35:06 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:44.065 true 00:11:44.065 09:35:06 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:44.065 09:35:06 -- target/multitarget.sh@35 -- # jq length 00:11:44.065 09:35:06 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:44.065 09:35:06 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:44.065 09:35:06 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:44.065 09:35:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:44.065 09:35:06 -- nvmf/common.sh@116 -- # sync 00:11:44.065 09:35:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:44.065 09:35:06 -- nvmf/common.sh@119 -- # set +e 00:11:44.065 09:35:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:44.065 09:35:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:44.065 rmmod nvme_tcp 00:11:44.065 rmmod nvme_fabrics 00:11:44.065 rmmod nvme_keyring 00:11:44.325 09:35:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:44.325 09:35:06 -- nvmf/common.sh@123 -- # set -e 00:11:44.325 09:35:06 -- nvmf/common.sh@124 -- # return 0 00:11:44.325 09:35:06 -- nvmf/common.sh@477 -- # '[' -n 4164430 ']' 00:11:44.325 09:35:06 -- nvmf/common.sh@478 -- # killprocess 4164430 00:11:44.325 09:35:06 -- common/autotest_common.sh@936 -- # '[' -z 4164430 ']' 00:11:44.325 09:35:06 -- common/autotest_common.sh@940 -- # kill -0 4164430 00:11:44.325 09:35:06 -- common/autotest_common.sh@941 -- # uname 00:11:44.325 09:35:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:44.325 09:35:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4164430 00:11:44.325 09:35:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:44.325 09:35:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:44.325 09:35:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4164430' 00:11:44.325 killing process with pid 4164430 00:11:44.325 09:35:06 -- common/autotest_common.sh@955 -- # kill 4164430 00:11:44.325 09:35:06 -- common/autotest_common.sh@960 -- # wait 4164430 00:11:44.584 09:35:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:44.584 09:35:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:44.584 09:35:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:44.584 09:35:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:44.584 09:35:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:44.584 09:35:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:44.584 09:35:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:44.584 09:35:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:46.519 09:35:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:46.519 00:11:46.519 real 0m6.656s 00:11:46.519 user 0m9.710s 00:11:46.519 sys 0m2.013s 00:11:46.519 09:35:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:46.519 09:35:09 -- common/autotest_common.sh@10 -- # set +x 00:11:46.519 ************************************ 00:11:46.519 END TEST nvmf_multitarget 00:11:46.519 ************************************ 00:11:46.519 09:35:09 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:46.519 09:35:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:46.519 09:35:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:46.519 09:35:09 -- common/autotest_common.sh@10 -- # set +x 00:11:46.519 ************************************ 00:11:46.519 START TEST nvmf_rpc 00:11:46.519 ************************************ 00:11:46.519 09:35:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:46.519 * Looking for test storage... 00:11:46.519 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:46.519 09:35:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:46.519 09:35:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:46.519 09:35:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:46.778 09:35:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:46.778 09:35:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:46.778 09:35:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:46.778 09:35:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:46.778 09:35:09 -- scripts/common.sh@335 -- # IFS=.-: 00:11:46.778 09:35:09 -- scripts/common.sh@335 -- # read -ra ver1 00:11:46.778 09:35:09 -- scripts/common.sh@336 -- # IFS=.-: 00:11:46.778 09:35:09 -- scripts/common.sh@336 -- # read -ra ver2 00:11:46.778 09:35:09 -- scripts/common.sh@337 -- # local 'op=<' 00:11:46.778 09:35:09 -- scripts/common.sh@339 -- # ver1_l=2 00:11:46.778 09:35:09 -- scripts/common.sh@340 -- # ver2_l=1 00:11:46.778 09:35:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:46.778 09:35:09 -- scripts/common.sh@343 -- # case "$op" in 00:11:46.778 09:35:09 -- scripts/common.sh@344 -- # : 1 00:11:46.778 09:35:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:46.778 09:35:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:46.778 09:35:09 -- scripts/common.sh@364 -- # decimal 1 00:11:46.778 09:35:09 -- scripts/common.sh@352 -- # local d=1 00:11:46.778 09:35:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:46.778 09:35:09 -- scripts/common.sh@354 -- # echo 1 00:11:46.778 09:35:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:46.778 09:35:09 -- scripts/common.sh@365 -- # decimal 2 00:11:46.778 09:35:09 -- scripts/common.sh@352 -- # local d=2 00:11:46.778 09:35:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:46.778 09:35:09 -- scripts/common.sh@354 -- # echo 2 00:11:46.778 09:35:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:46.778 09:35:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:46.778 09:35:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:46.778 09:35:09 -- scripts/common.sh@367 -- # return 0 00:11:46.778 09:35:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:46.778 09:35:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:46.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.778 --rc genhtml_branch_coverage=1 00:11:46.778 --rc genhtml_function_coverage=1 00:11:46.778 --rc genhtml_legend=1 00:11:46.778 --rc geninfo_all_blocks=1 00:11:46.778 --rc geninfo_unexecuted_blocks=1 00:11:46.778 00:11:46.778 ' 00:11:46.778 09:35:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:46.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.778 --rc genhtml_branch_coverage=1 00:11:46.778 --rc genhtml_function_coverage=1 00:11:46.778 --rc genhtml_legend=1 00:11:46.778 --rc geninfo_all_blocks=1 00:11:46.778 --rc geninfo_unexecuted_blocks=1 00:11:46.778 00:11:46.778 ' 00:11:46.778 09:35:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:46.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.778 --rc genhtml_branch_coverage=1 00:11:46.778 --rc genhtml_function_coverage=1 00:11:46.778 --rc genhtml_legend=1 00:11:46.778 --rc geninfo_all_blocks=1 00:11:46.778 --rc geninfo_unexecuted_blocks=1 00:11:46.778 00:11:46.778 ' 00:11:46.778 09:35:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:46.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:46.778 --rc genhtml_branch_coverage=1 00:11:46.778 --rc genhtml_function_coverage=1 00:11:46.778 --rc genhtml_legend=1 00:11:46.778 --rc geninfo_all_blocks=1 00:11:46.778 --rc geninfo_unexecuted_blocks=1 00:11:46.778 00:11:46.778 ' 00:11:46.778 09:35:09 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:46.778 09:35:09 -- nvmf/common.sh@7 -- # uname -s 00:11:46.778 09:35:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:46.778 09:35:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:46.778 09:35:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:46.778 09:35:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:46.778 09:35:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:46.778 09:35:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:46.778 09:35:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:46.778 09:35:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:46.778 09:35:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:46.778 09:35:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:46.778 09:35:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:46.778 09:35:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:46.778 09:35:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:46.778 09:35:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:46.778 09:35:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:46.778 09:35:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:46.778 09:35:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:46.778 09:35:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:46.778 09:35:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:46.778 09:35:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.778 09:35:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.778 09:35:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.778 09:35:09 -- paths/export.sh@5 -- # export PATH 00:11:46.778 09:35:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:46.778 09:35:09 -- nvmf/common.sh@46 -- # : 0 00:11:46.778 09:35:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:46.778 09:35:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:46.778 09:35:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:46.778 09:35:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:46.778 09:35:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:46.778 09:35:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:46.779 09:35:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:46.779 09:35:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:46.779 09:35:09 -- target/rpc.sh@11 -- # loops=5 00:11:46.779 09:35:09 -- target/rpc.sh@23 -- # nvmftestinit 00:11:46.779 09:35:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:46.779 09:35:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:46.779 09:35:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:46.779 09:35:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:46.779 09:35:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:46.779 09:35:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:46.779 09:35:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:46.779 09:35:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:46.779 09:35:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:46.779 09:35:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:46.779 09:35:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:46.779 09:35:09 -- common/autotest_common.sh@10 -- # set +x 00:11:48.681 09:35:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:48.681 09:35:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:48.681 09:35:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:48.681 09:35:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:48.681 09:35:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:48.681 09:35:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:48.681 09:35:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:48.681 09:35:11 -- nvmf/common.sh@294 -- # net_devs=() 00:11:48.681 09:35:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:48.681 09:35:11 -- nvmf/common.sh@295 -- # e810=() 00:11:48.681 09:35:11 -- nvmf/common.sh@295 -- # local -ga e810 00:11:48.681 09:35:11 -- nvmf/common.sh@296 -- # x722=() 00:11:48.681 09:35:11 -- nvmf/common.sh@296 -- # local -ga x722 00:11:48.681 09:35:11 -- nvmf/common.sh@297 -- # mlx=() 00:11:48.681 09:35:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:48.681 09:35:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:48.681 09:35:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:48.681 09:35:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:48.681 09:35:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:48.681 09:35:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:48.681 09:35:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:48.681 09:35:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:48.681 09:35:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:48.681 09:35:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:48.681 09:35:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:48.681 09:35:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:48.681 09:35:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:48.681 09:35:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:48.681 09:35:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:48.681 09:35:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:48.681 09:35:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:48.681 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:48.681 09:35:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:48.681 09:35:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:48.681 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:48.681 09:35:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:48.681 09:35:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:48.681 09:35:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:48.681 09:35:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:48.681 09:35:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:48.681 09:35:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:48.682 09:35:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:48.682 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:48.682 09:35:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:48.682 09:35:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:48.682 09:35:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:48.682 09:35:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:48.682 09:35:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:48.682 09:35:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:48.682 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:48.682 09:35:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:48.682 09:35:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:48.682 09:35:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:48.682 09:35:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:48.682 09:35:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:48.682 09:35:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:48.682 09:35:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:48.682 09:35:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:48.682 09:35:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:48.682 09:35:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:48.682 09:35:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:48.682 09:35:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:48.682 09:35:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:48.682 09:35:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:48.682 09:35:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:48.682 09:35:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:48.682 09:35:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:48.682 09:35:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:48.682 09:35:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:48.939 09:35:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:48.939 09:35:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:48.939 09:35:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:48.939 09:35:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:48.940 09:35:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:48.940 09:35:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:48.940 09:35:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:48.940 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:48.940 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.241 ms 00:11:48.940 00:11:48.940 --- 10.0.0.2 ping statistics --- 00:11:48.940 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:48.940 rtt min/avg/max/mdev = 0.241/0.241/0.241/0.000 ms 00:11:48.940 09:35:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:48.940 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:48.940 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.086 ms 00:11:48.940 00:11:48.940 --- 10.0.0.1 ping statistics --- 00:11:48.940 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:48.940 rtt min/avg/max/mdev = 0.086/0.086/0.086/0.000 ms 00:11:48.940 09:35:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:48.940 09:35:11 -- nvmf/common.sh@410 -- # return 0 00:11:48.940 09:35:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:48.940 09:35:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:48.940 09:35:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:48.940 09:35:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:48.940 09:35:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:48.940 09:35:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:48.940 09:35:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:48.940 09:35:11 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:48.940 09:35:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:48.940 09:35:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:48.940 09:35:11 -- common/autotest_common.sh@10 -- # set +x 00:11:48.940 09:35:11 -- nvmf/common.sh@469 -- # nvmfpid=4166685 00:11:48.940 09:35:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:48.940 09:35:11 -- nvmf/common.sh@470 -- # waitforlisten 4166685 00:11:48.940 09:35:11 -- common/autotest_common.sh@829 -- # '[' -z 4166685 ']' 00:11:48.940 09:35:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:48.940 09:35:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:48.940 09:35:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:48.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:48.940 09:35:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:48.940 09:35:11 -- common/autotest_common.sh@10 -- # set +x 00:11:48.940 [2024-11-29 09:35:11.780481] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:48.940 [2024-11-29 09:35:11.780550] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:49.199 EAL: No free 2048 kB hugepages reported on node 1 00:11:49.199 [2024-11-29 09:35:11.852017] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:49.199 [2024-11-29 09:35:11.975596] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:49.199 [2024-11-29 09:35:11.975768] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:49.199 [2024-11-29 09:35:11.975787] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:49.199 [2024-11-29 09:35:11.975802] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:49.199 [2024-11-29 09:35:11.975864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:49.199 [2024-11-29 09:35:11.975920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:49.199 [2024-11-29 09:35:11.975954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:49.199 [2024-11-29 09:35:11.975958] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:50.136 09:35:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:50.136 09:35:12 -- common/autotest_common.sh@862 -- # return 0 00:11:50.136 09:35:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:50.136 09:35:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:50.136 09:35:12 -- common/autotest_common.sh@10 -- # set +x 00:11:50.136 09:35:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:50.136 09:35:12 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:50.136 09:35:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:50.136 09:35:12 -- common/autotest_common.sh@10 -- # set +x 00:11:50.136 09:35:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:50.136 09:35:12 -- target/rpc.sh@26 -- # stats='{ 00:11:50.136 "tick_rate": 2700000000, 00:11:50.136 "poll_groups": [ 00:11:50.136 { 00:11:50.136 "name": "nvmf_tgt_poll_group_0", 00:11:50.136 "admin_qpairs": 0, 00:11:50.136 "io_qpairs": 0, 00:11:50.136 "current_admin_qpairs": 0, 00:11:50.136 "current_io_qpairs": 0, 00:11:50.136 "pending_bdev_io": 0, 00:11:50.136 "completed_nvme_io": 0, 00:11:50.136 "transports": [] 00:11:50.136 }, 00:11:50.136 { 00:11:50.136 "name": "nvmf_tgt_poll_group_1", 00:11:50.136 "admin_qpairs": 0, 00:11:50.136 "io_qpairs": 0, 00:11:50.136 "current_admin_qpairs": 0, 00:11:50.136 "current_io_qpairs": 0, 00:11:50.136 "pending_bdev_io": 0, 00:11:50.136 "completed_nvme_io": 0, 00:11:50.136 "transports": [] 00:11:50.136 }, 00:11:50.136 { 00:11:50.136 "name": "nvmf_tgt_poll_group_2", 00:11:50.136 "admin_qpairs": 0, 00:11:50.136 "io_qpairs": 0, 00:11:50.136 "current_admin_qpairs": 0, 00:11:50.136 "current_io_qpairs": 0, 00:11:50.136 "pending_bdev_io": 0, 00:11:50.136 "completed_nvme_io": 0, 00:11:50.136 "transports": [] 00:11:50.136 }, 00:11:50.136 { 00:11:50.136 "name": "nvmf_tgt_poll_group_3", 00:11:50.136 "admin_qpairs": 0, 00:11:50.136 "io_qpairs": 0, 00:11:50.136 "current_admin_qpairs": 0, 00:11:50.136 "current_io_qpairs": 0, 00:11:50.136 "pending_bdev_io": 0, 00:11:50.136 "completed_nvme_io": 0, 00:11:50.136 "transports": [] 00:11:50.136 } 00:11:50.136 ] 00:11:50.136 }' 00:11:50.136 09:35:12 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:50.136 09:35:12 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:50.136 09:35:12 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:50.136 09:35:12 -- target/rpc.sh@15 -- # wc -l 00:11:50.136 09:35:12 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:50.136 09:35:12 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:50.136 09:35:12 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:50.136 09:35:12 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:50.136 09:35:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:50.136 09:35:12 -- common/autotest_common.sh@10 -- # set +x 00:11:50.136 [2024-11-29 09:35:12.963520] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:50.136 09:35:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:50.136 09:35:12 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:50.136 09:35:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:50.136 09:35:12 -- common/autotest_common.sh@10 -- # set +x 00:11:50.396 09:35:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:50.396 09:35:12 -- target/rpc.sh@33 -- # stats='{ 00:11:50.396 "tick_rate": 2700000000, 00:11:50.396 "poll_groups": [ 00:11:50.396 { 00:11:50.396 "name": "nvmf_tgt_poll_group_0", 00:11:50.396 "admin_qpairs": 0, 00:11:50.396 "io_qpairs": 0, 00:11:50.396 "current_admin_qpairs": 0, 00:11:50.396 "current_io_qpairs": 0, 00:11:50.396 "pending_bdev_io": 0, 00:11:50.396 "completed_nvme_io": 0, 00:11:50.396 "transports": [ 00:11:50.396 { 00:11:50.396 "trtype": "TCP" 00:11:50.396 } 00:11:50.396 ] 00:11:50.396 }, 00:11:50.396 { 00:11:50.396 "name": "nvmf_tgt_poll_group_1", 00:11:50.396 "admin_qpairs": 0, 00:11:50.396 "io_qpairs": 0, 00:11:50.396 "current_admin_qpairs": 0, 00:11:50.396 "current_io_qpairs": 0, 00:11:50.396 "pending_bdev_io": 0, 00:11:50.396 "completed_nvme_io": 0, 00:11:50.396 "transports": [ 00:11:50.396 { 00:11:50.396 "trtype": "TCP" 00:11:50.396 } 00:11:50.396 ] 00:11:50.396 }, 00:11:50.396 { 00:11:50.396 "name": "nvmf_tgt_poll_group_2", 00:11:50.396 "admin_qpairs": 0, 00:11:50.396 "io_qpairs": 0, 00:11:50.396 "current_admin_qpairs": 0, 00:11:50.396 "current_io_qpairs": 0, 00:11:50.396 "pending_bdev_io": 0, 00:11:50.396 "completed_nvme_io": 0, 00:11:50.396 "transports": [ 00:11:50.396 { 00:11:50.396 "trtype": "TCP" 00:11:50.396 } 00:11:50.396 ] 00:11:50.396 }, 00:11:50.396 { 00:11:50.396 "name": "nvmf_tgt_poll_group_3", 00:11:50.396 "admin_qpairs": 0, 00:11:50.396 "io_qpairs": 0, 00:11:50.396 "current_admin_qpairs": 0, 00:11:50.396 "current_io_qpairs": 0, 00:11:50.396 "pending_bdev_io": 0, 00:11:50.396 "completed_nvme_io": 0, 00:11:50.396 "transports": [ 00:11:50.396 { 00:11:50.396 "trtype": "TCP" 00:11:50.396 } 00:11:50.396 ] 00:11:50.396 } 00:11:50.396 ] 00:11:50.396 }' 00:11:50.396 09:35:12 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:50.396 09:35:12 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:50.396 09:35:12 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:50.396 09:35:12 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:50.396 09:35:13 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:50.396 09:35:13 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:50.396 09:35:13 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:50.396 09:35:13 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:50.396 09:35:13 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:50.396 09:35:13 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:50.396 09:35:13 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:50.396 09:35:13 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:50.396 09:35:13 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:50.396 09:35:13 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:50.396 09:35:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:50.396 09:35:13 -- common/autotest_common.sh@10 -- # set +x 00:11:50.396 Malloc1 00:11:50.396 09:35:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:50.396 09:35:13 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:50.396 09:35:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:50.396 09:35:13 -- common/autotest_common.sh@10 -- # set +x 00:11:50.396 09:35:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:50.396 09:35:13 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:50.396 09:35:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:50.396 09:35:13 -- common/autotest_common.sh@10 -- # set +x 00:11:50.396 09:35:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:50.396 09:35:13 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:50.396 09:35:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:50.396 09:35:13 -- common/autotest_common.sh@10 -- # set +x 00:11:50.396 09:35:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:50.396 09:35:13 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:50.396 09:35:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:50.396 09:35:13 -- common/autotest_common.sh@10 -- # set +x 00:11:50.396 [2024-11-29 09:35:13.107344] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:50.396 09:35:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:50.396 09:35:13 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:50.396 09:35:13 -- common/autotest_common.sh@650 -- # local es=0 00:11:50.396 09:35:13 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:50.396 09:35:13 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:50.396 09:35:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:50.396 09:35:13 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:50.396 09:35:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:50.396 09:35:13 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:50.396 09:35:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:50.396 09:35:13 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:50.396 09:35:13 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:50.396 09:35:13 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:50.396 [2024-11-29 09:35:13.129807] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:50.396 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:50.396 could not add new controller: failed to write to nvme-fabrics device 00:11:50.396 09:35:13 -- common/autotest_common.sh@653 -- # es=1 00:11:50.396 09:35:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:50.396 09:35:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:50.396 09:35:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:50.396 09:35:13 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:50.396 09:35:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:50.396 09:35:13 -- common/autotest_common.sh@10 -- # set +x 00:11:50.396 09:35:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:50.397 09:35:13 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:50.965 09:35:13 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:50.965 09:35:13 -- common/autotest_common.sh@1187 -- # local i=0 00:11:50.965 09:35:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:50.965 09:35:13 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:50.965 09:35:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:53.503 09:35:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:53.503 09:35:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:53.503 09:35:15 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:53.503 09:35:15 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:53.503 09:35:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:53.503 09:35:15 -- common/autotest_common.sh@1197 -- # return 0 00:11:53.503 09:35:15 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:53.503 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:53.503 09:35:15 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:53.503 09:35:15 -- common/autotest_common.sh@1208 -- # local i=0 00:11:53.503 09:35:15 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:53.503 09:35:15 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:53.503 09:35:15 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:53.503 09:35:15 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:53.503 09:35:15 -- common/autotest_common.sh@1220 -- # return 0 00:11:53.503 09:35:15 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:53.503 09:35:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:53.503 09:35:15 -- common/autotest_common.sh@10 -- # set +x 00:11:53.503 09:35:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:53.503 09:35:15 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:53.503 09:35:15 -- common/autotest_common.sh@650 -- # local es=0 00:11:53.503 09:35:15 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:53.503 09:35:15 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:53.503 09:35:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:53.503 09:35:15 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:53.503 09:35:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:53.503 09:35:15 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:53.503 09:35:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:53.503 09:35:15 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:53.503 09:35:15 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:53.503 09:35:15 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:53.503 [2024-11-29 09:35:15.920350] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:53.503 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:53.503 could not add new controller: failed to write to nvme-fabrics device 00:11:53.503 09:35:15 -- common/autotest_common.sh@653 -- # es=1 00:11:53.503 09:35:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:53.503 09:35:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:53.503 09:35:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:53.503 09:35:15 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:53.503 09:35:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:53.503 09:35:15 -- common/autotest_common.sh@10 -- # set +x 00:11:53.503 09:35:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:53.503 09:35:15 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:53.763 09:35:16 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:53.764 09:35:16 -- common/autotest_common.sh@1187 -- # local i=0 00:11:53.764 09:35:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:53.764 09:35:16 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:53.764 09:35:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:56.298 09:35:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:56.298 09:35:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:56.298 09:35:18 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:56.298 09:35:18 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:56.298 09:35:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:56.298 09:35:18 -- common/autotest_common.sh@1197 -- # return 0 00:11:56.298 09:35:18 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:56.298 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:56.298 09:35:18 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:56.298 09:35:18 -- common/autotest_common.sh@1208 -- # local i=0 00:11:56.298 09:35:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:56.298 09:35:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:56.298 09:35:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:56.299 09:35:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:56.299 09:35:18 -- common/autotest_common.sh@1220 -- # return 0 00:11:56.299 09:35:18 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:56.299 09:35:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:56.299 09:35:18 -- common/autotest_common.sh@10 -- # set +x 00:11:56.299 09:35:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:56.299 09:35:18 -- target/rpc.sh@81 -- # seq 1 5 00:11:56.299 09:35:18 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:56.299 09:35:18 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:56.299 09:35:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:56.299 09:35:18 -- common/autotest_common.sh@10 -- # set +x 00:11:56.299 09:35:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:56.299 09:35:18 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:56.299 09:35:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:56.299 09:35:18 -- common/autotest_common.sh@10 -- # set +x 00:11:56.299 [2024-11-29 09:35:18.712108] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:56.299 09:35:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:56.299 09:35:18 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:56.299 09:35:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:56.299 09:35:18 -- common/autotest_common.sh@10 -- # set +x 00:11:56.299 09:35:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:56.299 09:35:18 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:56.299 09:35:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:56.299 09:35:18 -- common/autotest_common.sh@10 -- # set +x 00:11:56.299 09:35:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:56.299 09:35:18 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:56.557 09:35:19 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:56.557 09:35:19 -- common/autotest_common.sh@1187 -- # local i=0 00:11:56.557 09:35:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:56.557 09:35:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:56.557 09:35:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:59.094 09:35:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:59.094 09:35:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:59.094 09:35:21 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:59.094 09:35:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:59.094 09:35:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:59.094 09:35:21 -- common/autotest_common.sh@1197 -- # return 0 00:11:59.094 09:35:21 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:59.094 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.094 09:35:21 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:59.094 09:35:21 -- common/autotest_common.sh@1208 -- # local i=0 00:11:59.094 09:35:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:59.094 09:35:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:59.094 09:35:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:59.094 09:35:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:59.094 09:35:21 -- common/autotest_common.sh@1220 -- # return 0 00:11:59.094 09:35:21 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:59.094 09:35:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.094 09:35:21 -- common/autotest_common.sh@10 -- # set +x 00:11:59.094 09:35:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.094 09:35:21 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:59.094 09:35:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.094 09:35:21 -- common/autotest_common.sh@10 -- # set +x 00:11:59.094 09:35:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.094 09:35:21 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:59.094 09:35:21 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:59.094 09:35:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.094 09:35:21 -- common/autotest_common.sh@10 -- # set +x 00:11:59.094 09:35:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.095 09:35:21 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:59.095 09:35:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.095 09:35:21 -- common/autotest_common.sh@10 -- # set +x 00:11:59.095 [2024-11-29 09:35:21.471068] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:59.095 09:35:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.095 09:35:21 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:59.095 09:35:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.095 09:35:21 -- common/autotest_common.sh@10 -- # set +x 00:11:59.095 09:35:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.095 09:35:21 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:59.095 09:35:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.095 09:35:21 -- common/autotest_common.sh@10 -- # set +x 00:11:59.095 09:35:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.095 09:35:21 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:59.355 09:35:22 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:59.355 09:35:22 -- common/autotest_common.sh@1187 -- # local i=0 00:11:59.355 09:35:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:59.355 09:35:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:59.355 09:35:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:01.892 09:35:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:01.892 09:35:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:01.892 09:35:24 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:01.892 09:35:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:01.892 09:35:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:01.892 09:35:24 -- common/autotest_common.sh@1197 -- # return 0 00:12:01.892 09:35:24 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:01.892 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:01.892 09:35:24 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:01.892 09:35:24 -- common/autotest_common.sh@1208 -- # local i=0 00:12:01.892 09:35:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:01.892 09:35:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:01.893 09:35:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:01.893 09:35:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:01.893 09:35:24 -- common/autotest_common.sh@1220 -- # return 0 00:12:01.893 09:35:24 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:01.893 09:35:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.893 09:35:24 -- common/autotest_common.sh@10 -- # set +x 00:12:01.893 09:35:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.893 09:35:24 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:01.893 09:35:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.893 09:35:24 -- common/autotest_common.sh@10 -- # set +x 00:12:01.893 09:35:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.893 09:35:24 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:01.893 09:35:24 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:01.893 09:35:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.893 09:35:24 -- common/autotest_common.sh@10 -- # set +x 00:12:01.893 09:35:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.893 09:35:24 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:01.893 09:35:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.893 09:35:24 -- common/autotest_common.sh@10 -- # set +x 00:12:01.893 [2024-11-29 09:35:24.327850] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:01.893 09:35:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.893 09:35:24 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:01.893 09:35:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.893 09:35:24 -- common/autotest_common.sh@10 -- # set +x 00:12:01.893 09:35:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.893 09:35:24 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:01.893 09:35:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.893 09:35:24 -- common/autotest_common.sh@10 -- # set +x 00:12:01.893 09:35:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.893 09:35:24 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.152 09:35:24 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:02.152 09:35:24 -- common/autotest_common.sh@1187 -- # local i=0 00:12:02.152 09:35:24 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:02.152 09:35:24 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:02.152 09:35:24 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:04.697 09:35:26 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:04.697 09:35:26 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:04.697 09:35:26 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:04.697 09:35:26 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:04.697 09:35:26 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:04.697 09:35:26 -- common/autotest_common.sh@1197 -- # return 0 00:12:04.697 09:35:26 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:04.697 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.697 09:35:27 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:04.697 09:35:27 -- common/autotest_common.sh@1208 -- # local i=0 00:12:04.697 09:35:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:04.697 09:35:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:04.697 09:35:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:04.697 09:35:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:04.697 09:35:27 -- common/autotest_common.sh@1220 -- # return 0 00:12:04.697 09:35:27 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:04.697 09:35:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.697 09:35:27 -- common/autotest_common.sh@10 -- # set +x 00:12:04.697 09:35:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.697 09:35:27 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:04.697 09:35:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.697 09:35:27 -- common/autotest_common.sh@10 -- # set +x 00:12:04.697 09:35:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.697 09:35:27 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:04.697 09:35:27 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:04.697 09:35:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.697 09:35:27 -- common/autotest_common.sh@10 -- # set +x 00:12:04.697 09:35:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.697 09:35:27 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:04.697 09:35:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.697 09:35:27 -- common/autotest_common.sh@10 -- # set +x 00:12:04.697 [2024-11-29 09:35:27.121753] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:04.697 09:35:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.698 09:35:27 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:04.698 09:35:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.698 09:35:27 -- common/autotest_common.sh@10 -- # set +x 00:12:04.698 09:35:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.698 09:35:27 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:04.698 09:35:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.698 09:35:27 -- common/autotest_common.sh@10 -- # set +x 00:12:04.698 09:35:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.698 09:35:27 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:04.956 09:35:27 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:04.956 09:35:27 -- common/autotest_common.sh@1187 -- # local i=0 00:12:04.956 09:35:27 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:04.956 09:35:27 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:04.956 09:35:27 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:07.496 09:35:29 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:07.496 09:35:29 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:07.496 09:35:29 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:07.496 09:35:29 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:07.496 09:35:29 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:07.496 09:35:29 -- common/autotest_common.sh@1197 -- # return 0 00:12:07.496 09:35:29 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:07.496 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.496 09:35:29 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:07.496 09:35:29 -- common/autotest_common.sh@1208 -- # local i=0 00:12:07.496 09:35:29 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:07.496 09:35:29 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:07.496 09:35:29 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:07.496 09:35:29 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:07.496 09:35:29 -- common/autotest_common.sh@1220 -- # return 0 00:12:07.496 09:35:29 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:07.496 09:35:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.496 09:35:29 -- common/autotest_common.sh@10 -- # set +x 00:12:07.496 09:35:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.496 09:35:29 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:07.496 09:35:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.496 09:35:29 -- common/autotest_common.sh@10 -- # set +x 00:12:07.496 09:35:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.496 09:35:29 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:07.496 09:35:29 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:07.496 09:35:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.496 09:35:29 -- common/autotest_common.sh@10 -- # set +x 00:12:07.496 09:35:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.496 09:35:29 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:07.496 09:35:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.496 09:35:29 -- common/autotest_common.sh@10 -- # set +x 00:12:07.496 [2024-11-29 09:35:29.871993] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:07.496 09:35:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.496 09:35:29 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:07.496 09:35:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.496 09:35:29 -- common/autotest_common.sh@10 -- # set +x 00:12:07.496 09:35:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.496 09:35:29 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:07.496 09:35:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.496 09:35:29 -- common/autotest_common.sh@10 -- # set +x 00:12:07.496 09:35:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.496 09:35:29 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:07.755 09:35:30 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:07.755 09:35:30 -- common/autotest_common.sh@1187 -- # local i=0 00:12:07.755 09:35:30 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:07.755 09:35:30 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:07.755 09:35:30 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:10.299 09:35:32 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:10.299 09:35:32 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:10.299 09:35:32 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:10.299 09:35:32 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:10.299 09:35:32 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:10.299 09:35:32 -- common/autotest_common.sh@1197 -- # return 0 00:12:10.299 09:35:32 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:10.299 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:10.299 09:35:32 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:10.299 09:35:32 -- common/autotest_common.sh@1208 -- # local i=0 00:12:10.299 09:35:32 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:10.299 09:35:32 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:10.299 09:35:32 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:10.299 09:35:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:10.299 09:35:32 -- common/autotest_common.sh@1220 -- # return 0 00:12:10.299 09:35:32 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:10.299 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.299 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.299 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.299 09:35:32 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:10.299 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.299 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.299 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.299 09:35:32 -- target/rpc.sh@99 -- # seq 1 5 00:12:10.299 09:35:32 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:10.299 09:35:32 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:10.299 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.299 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.299 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.299 09:35:32 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:10.299 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.299 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.299 [2024-11-29 09:35:32.702323] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:10.299 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.299 09:35:32 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:10.299 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.299 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.299 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.299 09:35:32 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:10.299 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.299 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.299 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.299 09:35:32 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:10.299 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.299 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.299 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.299 09:35:32 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:10.299 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.299 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.299 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.299 09:35:32 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:10.299 09:35:32 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:10.299 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.299 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.299 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.299 09:35:32 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 [2024-11-29 09:35:32.750388] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:10.300 09:35:32 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 [2024-11-29 09:35:32.798567] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:10.300 09:35:32 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 [2024-11-29 09:35:32.846733] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:10.300 09:35:32 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 [2024-11-29 09:35:32.894914] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:10.300 09:35:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.300 09:35:32 -- common/autotest_common.sh@10 -- # set +x 00:12:10.300 09:35:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.300 09:35:32 -- target/rpc.sh@110 -- # stats='{ 00:12:10.300 "tick_rate": 2700000000, 00:12:10.300 "poll_groups": [ 00:12:10.300 { 00:12:10.300 "name": "nvmf_tgt_poll_group_0", 00:12:10.300 "admin_qpairs": 2, 00:12:10.300 "io_qpairs": 84, 00:12:10.300 "current_admin_qpairs": 0, 00:12:10.300 "current_io_qpairs": 0, 00:12:10.300 "pending_bdev_io": 0, 00:12:10.300 "completed_nvme_io": 174, 00:12:10.300 "transports": [ 00:12:10.300 { 00:12:10.300 "trtype": "TCP" 00:12:10.300 } 00:12:10.300 ] 00:12:10.300 }, 00:12:10.300 { 00:12:10.300 "name": "nvmf_tgt_poll_group_1", 00:12:10.300 "admin_qpairs": 2, 00:12:10.300 "io_qpairs": 84, 00:12:10.300 "current_admin_qpairs": 0, 00:12:10.300 "current_io_qpairs": 0, 00:12:10.300 "pending_bdev_io": 0, 00:12:10.300 "completed_nvme_io": 135, 00:12:10.300 "transports": [ 00:12:10.300 { 00:12:10.300 "trtype": "TCP" 00:12:10.300 } 00:12:10.300 ] 00:12:10.300 }, 00:12:10.300 { 00:12:10.300 "name": "nvmf_tgt_poll_group_2", 00:12:10.300 "admin_qpairs": 1, 00:12:10.300 "io_qpairs": 84, 00:12:10.300 "current_admin_qpairs": 0, 00:12:10.300 "current_io_qpairs": 0, 00:12:10.300 "pending_bdev_io": 0, 00:12:10.300 "completed_nvme_io": 283, 00:12:10.300 "transports": [ 00:12:10.300 { 00:12:10.300 "trtype": "TCP" 00:12:10.300 } 00:12:10.300 ] 00:12:10.300 }, 00:12:10.300 { 00:12:10.300 "name": "nvmf_tgt_poll_group_3", 00:12:10.300 "admin_qpairs": 2, 00:12:10.300 "io_qpairs": 84, 00:12:10.300 "current_admin_qpairs": 0, 00:12:10.300 "current_io_qpairs": 0, 00:12:10.300 "pending_bdev_io": 0, 00:12:10.300 "completed_nvme_io": 94, 00:12:10.300 "transports": [ 00:12:10.300 { 00:12:10.300 "trtype": "TCP" 00:12:10.300 } 00:12:10.300 ] 00:12:10.300 } 00:12:10.300 ] 00:12:10.300 }' 00:12:10.300 09:35:32 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:10.300 09:35:32 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:10.300 09:35:32 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:10.300 09:35:32 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:10.300 09:35:32 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:10.300 09:35:32 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:10.300 09:35:32 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:10.300 09:35:32 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:10.300 09:35:32 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:10.300 09:35:33 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:10.300 09:35:33 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:10.300 09:35:33 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:10.300 09:35:33 -- target/rpc.sh@123 -- # nvmftestfini 00:12:10.300 09:35:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:10.300 09:35:33 -- nvmf/common.sh@116 -- # sync 00:12:10.300 09:35:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:10.300 09:35:33 -- nvmf/common.sh@119 -- # set +e 00:12:10.301 09:35:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:10.301 09:35:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:10.301 rmmod nvme_tcp 00:12:10.301 rmmod nvme_fabrics 00:12:10.301 rmmod nvme_keyring 00:12:10.301 09:35:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:10.301 09:35:33 -- nvmf/common.sh@123 -- # set -e 00:12:10.301 09:35:33 -- nvmf/common.sh@124 -- # return 0 00:12:10.301 09:35:33 -- nvmf/common.sh@477 -- # '[' -n 4166685 ']' 00:12:10.301 09:35:33 -- nvmf/common.sh@478 -- # killprocess 4166685 00:12:10.301 09:35:33 -- common/autotest_common.sh@936 -- # '[' -z 4166685 ']' 00:12:10.301 09:35:33 -- common/autotest_common.sh@940 -- # kill -0 4166685 00:12:10.301 09:35:33 -- common/autotest_common.sh@941 -- # uname 00:12:10.301 09:35:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:10.301 09:35:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4166685 00:12:10.301 09:35:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:10.301 09:35:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:10.301 09:35:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4166685' 00:12:10.301 killing process with pid 4166685 00:12:10.301 09:35:33 -- common/autotest_common.sh@955 -- # kill 4166685 00:12:10.301 09:35:33 -- common/autotest_common.sh@960 -- # wait 4166685 00:12:10.871 09:35:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:10.871 09:35:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:10.871 09:35:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:10.871 09:35:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:10.871 09:35:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:10.871 09:35:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:10.871 09:35:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:10.871 09:35:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:12.781 09:35:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:12.781 00:12:12.781 real 0m26.163s 00:12:12.781 user 1m25.123s 00:12:12.781 sys 0m4.318s 00:12:12.781 09:35:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:12.781 09:35:35 -- common/autotest_common.sh@10 -- # set +x 00:12:12.781 ************************************ 00:12:12.781 END TEST nvmf_rpc 00:12:12.781 ************************************ 00:12:12.781 09:35:35 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:12.781 09:35:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:12.781 09:35:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:12.781 09:35:35 -- common/autotest_common.sh@10 -- # set +x 00:12:12.781 ************************************ 00:12:12.781 START TEST nvmf_invalid 00:12:12.781 ************************************ 00:12:12.781 09:35:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:12.781 * Looking for test storage... 00:12:12.781 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:12.781 09:35:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:12.781 09:35:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:12.781 09:35:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:13.040 09:35:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:13.040 09:35:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:13.040 09:35:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:13.040 09:35:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:13.040 09:35:35 -- scripts/common.sh@335 -- # IFS=.-: 00:12:13.040 09:35:35 -- scripts/common.sh@335 -- # read -ra ver1 00:12:13.040 09:35:35 -- scripts/common.sh@336 -- # IFS=.-: 00:12:13.040 09:35:35 -- scripts/common.sh@336 -- # read -ra ver2 00:12:13.040 09:35:35 -- scripts/common.sh@337 -- # local 'op=<' 00:12:13.040 09:35:35 -- scripts/common.sh@339 -- # ver1_l=2 00:12:13.040 09:35:35 -- scripts/common.sh@340 -- # ver2_l=1 00:12:13.040 09:35:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:13.040 09:35:35 -- scripts/common.sh@343 -- # case "$op" in 00:12:13.040 09:35:35 -- scripts/common.sh@344 -- # : 1 00:12:13.040 09:35:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:13.040 09:35:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:13.040 09:35:35 -- scripts/common.sh@364 -- # decimal 1 00:12:13.040 09:35:35 -- scripts/common.sh@352 -- # local d=1 00:12:13.040 09:35:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:13.040 09:35:35 -- scripts/common.sh@354 -- # echo 1 00:12:13.040 09:35:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:13.040 09:35:35 -- scripts/common.sh@365 -- # decimal 2 00:12:13.040 09:35:35 -- scripts/common.sh@352 -- # local d=2 00:12:13.040 09:35:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:13.040 09:35:35 -- scripts/common.sh@354 -- # echo 2 00:12:13.040 09:35:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:13.040 09:35:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:13.040 09:35:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:13.040 09:35:35 -- scripts/common.sh@367 -- # return 0 00:12:13.040 09:35:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:13.040 09:35:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:13.040 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:13.040 --rc genhtml_branch_coverage=1 00:12:13.040 --rc genhtml_function_coverage=1 00:12:13.040 --rc genhtml_legend=1 00:12:13.040 --rc geninfo_all_blocks=1 00:12:13.040 --rc geninfo_unexecuted_blocks=1 00:12:13.040 00:12:13.040 ' 00:12:13.040 09:35:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:13.040 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:13.040 --rc genhtml_branch_coverage=1 00:12:13.040 --rc genhtml_function_coverage=1 00:12:13.040 --rc genhtml_legend=1 00:12:13.040 --rc geninfo_all_blocks=1 00:12:13.040 --rc geninfo_unexecuted_blocks=1 00:12:13.040 00:12:13.040 ' 00:12:13.040 09:35:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:13.040 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:13.040 --rc genhtml_branch_coverage=1 00:12:13.040 --rc genhtml_function_coverage=1 00:12:13.040 --rc genhtml_legend=1 00:12:13.040 --rc geninfo_all_blocks=1 00:12:13.040 --rc geninfo_unexecuted_blocks=1 00:12:13.040 00:12:13.040 ' 00:12:13.040 09:35:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:13.040 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:13.040 --rc genhtml_branch_coverage=1 00:12:13.040 --rc genhtml_function_coverage=1 00:12:13.040 --rc genhtml_legend=1 00:12:13.040 --rc geninfo_all_blocks=1 00:12:13.040 --rc geninfo_unexecuted_blocks=1 00:12:13.040 00:12:13.040 ' 00:12:13.040 09:35:35 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:13.040 09:35:35 -- nvmf/common.sh@7 -- # uname -s 00:12:13.040 09:35:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:13.040 09:35:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:13.040 09:35:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:13.040 09:35:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:13.040 09:35:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:13.040 09:35:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:13.040 09:35:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:13.040 09:35:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:13.040 09:35:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:13.040 09:35:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:13.040 09:35:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:13.040 09:35:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:13.040 09:35:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:13.040 09:35:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:13.040 09:35:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:13.040 09:35:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:13.040 09:35:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:13.040 09:35:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:13.040 09:35:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:13.040 09:35:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.040 09:35:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.040 09:35:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.040 09:35:35 -- paths/export.sh@5 -- # export PATH 00:12:13.040 09:35:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.040 09:35:35 -- nvmf/common.sh@46 -- # : 0 00:12:13.040 09:35:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:13.040 09:35:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:13.040 09:35:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:13.040 09:35:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:13.040 09:35:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:13.040 09:35:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:13.040 09:35:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:13.040 09:35:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:13.040 09:35:35 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:13.040 09:35:35 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:13.040 09:35:35 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:13.040 09:35:35 -- target/invalid.sh@14 -- # target=foobar 00:12:13.040 09:35:35 -- target/invalid.sh@16 -- # RANDOM=0 00:12:13.040 09:35:35 -- target/invalid.sh@34 -- # nvmftestinit 00:12:13.040 09:35:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:13.040 09:35:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:13.040 09:35:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:13.040 09:35:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:13.040 09:35:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:13.040 09:35:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:13.040 09:35:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:13.040 09:35:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:13.040 09:35:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:13.040 09:35:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:13.040 09:35:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:13.040 09:35:35 -- common/autotest_common.sh@10 -- # set +x 00:12:15.579 09:35:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:15.579 09:35:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:15.579 09:35:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:15.579 09:35:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:15.579 09:35:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:15.579 09:35:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:15.579 09:35:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:15.579 09:35:37 -- nvmf/common.sh@294 -- # net_devs=() 00:12:15.579 09:35:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:15.579 09:35:37 -- nvmf/common.sh@295 -- # e810=() 00:12:15.579 09:35:37 -- nvmf/common.sh@295 -- # local -ga e810 00:12:15.579 09:35:37 -- nvmf/common.sh@296 -- # x722=() 00:12:15.579 09:35:37 -- nvmf/common.sh@296 -- # local -ga x722 00:12:15.579 09:35:37 -- nvmf/common.sh@297 -- # mlx=() 00:12:15.579 09:35:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:15.579 09:35:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:15.579 09:35:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:15.579 09:35:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:15.579 09:35:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:15.579 09:35:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:15.579 09:35:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:15.579 09:35:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:15.579 09:35:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:15.579 09:35:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:15.579 09:35:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:15.579 09:35:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:15.579 09:35:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:15.579 09:35:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:15.579 09:35:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:15.579 09:35:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:15.579 09:35:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:15.579 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:15.579 09:35:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:15.579 09:35:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:15.579 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:15.579 09:35:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:15.579 09:35:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:15.579 09:35:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:15.579 09:35:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:15.579 09:35:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:15.579 09:35:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:15.579 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:15.579 09:35:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:15.579 09:35:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:15.579 09:35:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:15.579 09:35:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:15.579 09:35:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:15.579 09:35:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:15.579 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:15.579 09:35:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:15.579 09:35:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:15.579 09:35:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:15.579 09:35:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:15.579 09:35:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:15.580 09:35:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:15.580 09:35:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:15.580 09:35:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:15.580 09:35:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:15.580 09:35:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:15.580 09:35:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:15.580 09:35:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:15.580 09:35:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:15.580 09:35:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:15.580 09:35:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:15.580 09:35:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:15.580 09:35:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:15.580 09:35:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:15.580 09:35:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:15.580 09:35:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:15.580 09:35:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:15.580 09:35:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:15.580 09:35:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:15.580 09:35:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:15.580 09:35:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:15.580 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:15.580 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.224 ms 00:12:15.580 00:12:15.580 --- 10.0.0.2 ping statistics --- 00:12:15.580 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:15.580 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:12:15.580 09:35:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:15.580 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:15.580 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:12:15.580 00:12:15.580 --- 10.0.0.1 ping statistics --- 00:12:15.580 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:15.580 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:12:15.580 09:35:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:15.580 09:35:37 -- nvmf/common.sh@410 -- # return 0 00:12:15.580 09:35:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:15.580 09:35:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:15.580 09:35:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:15.580 09:35:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:15.580 09:35:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:15.580 09:35:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:15.580 09:35:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:15.580 09:35:38 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:15.580 09:35:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:15.580 09:35:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:15.580 09:35:38 -- common/autotest_common.sh@10 -- # set +x 00:12:15.580 09:35:38 -- nvmf/common.sh@469 -- # nvmfpid=4171404 00:12:15.580 09:35:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:15.580 09:35:38 -- nvmf/common.sh@470 -- # waitforlisten 4171404 00:12:15.580 09:35:38 -- common/autotest_common.sh@829 -- # '[' -z 4171404 ']' 00:12:15.580 09:35:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:15.580 09:35:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:15.580 09:35:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:15.580 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:15.580 09:35:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:15.580 09:35:38 -- common/autotest_common.sh@10 -- # set +x 00:12:15.580 [2024-11-29 09:35:38.058035] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:15.580 [2024-11-29 09:35:38.058115] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:15.580 EAL: No free 2048 kB hugepages reported on node 1 00:12:15.580 [2024-11-29 09:35:38.126839] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:15.580 [2024-11-29 09:35:38.246792] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:15.580 [2024-11-29 09:35:38.246949] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:15.580 [2024-11-29 09:35:38.246968] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:15.580 [2024-11-29 09:35:38.246983] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:15.580 [2024-11-29 09:35:38.247043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:15.580 [2024-11-29 09:35:38.247101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:15.580 [2024-11-29 09:35:38.247153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:15.580 [2024-11-29 09:35:38.247156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:16.518 09:35:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:16.518 09:35:39 -- common/autotest_common.sh@862 -- # return 0 00:12:16.518 09:35:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:16.518 09:35:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:16.518 09:35:39 -- common/autotest_common.sh@10 -- # set +x 00:12:16.518 09:35:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:16.518 09:35:39 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:16.518 09:35:39 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode17555 00:12:16.518 [2024-11-29 09:35:39.271587] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:16.518 09:35:39 -- target/invalid.sh@40 -- # out='request: 00:12:16.518 { 00:12:16.518 "nqn": "nqn.2016-06.io.spdk:cnode17555", 00:12:16.518 "tgt_name": "foobar", 00:12:16.518 "method": "nvmf_create_subsystem", 00:12:16.518 "req_id": 1 00:12:16.518 } 00:12:16.518 Got JSON-RPC error response 00:12:16.518 response: 00:12:16.518 { 00:12:16.518 "code": -32603, 00:12:16.518 "message": "Unable to find target foobar" 00:12:16.518 }' 00:12:16.518 09:35:39 -- target/invalid.sh@41 -- # [[ request: 00:12:16.518 { 00:12:16.518 "nqn": "nqn.2016-06.io.spdk:cnode17555", 00:12:16.518 "tgt_name": "foobar", 00:12:16.518 "method": "nvmf_create_subsystem", 00:12:16.518 "req_id": 1 00:12:16.518 } 00:12:16.518 Got JSON-RPC error response 00:12:16.518 response: 00:12:16.518 { 00:12:16.518 "code": -32603, 00:12:16.518 "message": "Unable to find target foobar" 00:12:16.518 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:16.518 09:35:39 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:16.518 09:35:39 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode25816 00:12:16.777 [2024-11-29 09:35:39.532491] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25816: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:16.777 09:35:39 -- target/invalid.sh@45 -- # out='request: 00:12:16.777 { 00:12:16.777 "nqn": "nqn.2016-06.io.spdk:cnode25816", 00:12:16.777 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:16.777 "method": "nvmf_create_subsystem", 00:12:16.777 "req_id": 1 00:12:16.777 } 00:12:16.777 Got JSON-RPC error response 00:12:16.777 response: 00:12:16.777 { 00:12:16.777 "code": -32602, 00:12:16.777 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:16.777 }' 00:12:16.777 09:35:39 -- target/invalid.sh@46 -- # [[ request: 00:12:16.777 { 00:12:16.777 "nqn": "nqn.2016-06.io.spdk:cnode25816", 00:12:16.777 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:16.777 "method": "nvmf_create_subsystem", 00:12:16.777 "req_id": 1 00:12:16.777 } 00:12:16.777 Got JSON-RPC error response 00:12:16.777 response: 00:12:16.777 { 00:12:16.777 "code": -32602, 00:12:16.777 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:16.777 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:16.777 09:35:39 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:16.777 09:35:39 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode31088 00:12:17.035 [2024-11-29 09:35:39.781269] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode31088: invalid model number 'SPDK_Controller' 00:12:17.035 09:35:39 -- target/invalid.sh@50 -- # out='request: 00:12:17.035 { 00:12:17.035 "nqn": "nqn.2016-06.io.spdk:cnode31088", 00:12:17.035 "model_number": "SPDK_Controller\u001f", 00:12:17.035 "method": "nvmf_create_subsystem", 00:12:17.035 "req_id": 1 00:12:17.035 } 00:12:17.035 Got JSON-RPC error response 00:12:17.035 response: 00:12:17.035 { 00:12:17.035 "code": -32602, 00:12:17.035 "message": "Invalid MN SPDK_Controller\u001f" 00:12:17.035 }' 00:12:17.035 09:35:39 -- target/invalid.sh@51 -- # [[ request: 00:12:17.035 { 00:12:17.035 "nqn": "nqn.2016-06.io.spdk:cnode31088", 00:12:17.035 "model_number": "SPDK_Controller\u001f", 00:12:17.035 "method": "nvmf_create_subsystem", 00:12:17.035 "req_id": 1 00:12:17.035 } 00:12:17.035 Got JSON-RPC error response 00:12:17.035 response: 00:12:17.035 { 00:12:17.035 "code": -32602, 00:12:17.035 "message": "Invalid MN SPDK_Controller\u001f" 00:12:17.035 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:17.035 09:35:39 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:17.035 09:35:39 -- target/invalid.sh@19 -- # local length=21 ll 00:12:17.035 09:35:39 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:17.035 09:35:39 -- target/invalid.sh@21 -- # local chars 00:12:17.035 09:35:39 -- target/invalid.sh@22 -- # local string 00:12:17.035 09:35:39 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:17.035 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.035 09:35:39 -- target/invalid.sh@25 -- # printf %x 54 00:12:17.035 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:17.035 09:35:39 -- target/invalid.sh@25 -- # string+=6 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 48 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x30' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+=0 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 120 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x78' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+=x 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 126 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+='~' 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 86 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+=V 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 40 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x28' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+='(' 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 108 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+=l 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 126 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+='~' 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 126 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+='~' 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 43 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+=+ 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 60 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+='<' 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 52 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x34' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+=4 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 91 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+='[' 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 70 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+=F 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 123 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+='{' 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 35 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x23' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+='#' 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 108 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+=l 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 67 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x43' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+=C 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 113 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x71' 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # string+=q 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.036 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.036 09:35:39 -- target/invalid.sh@25 -- # printf %x 81 00:12:17.294 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x51' 00:12:17.294 09:35:39 -- target/invalid.sh@25 -- # string+=Q 00:12:17.294 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.294 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.294 09:35:39 -- target/invalid.sh@25 -- # printf %x 95 00:12:17.294 09:35:39 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:12:17.294 09:35:39 -- target/invalid.sh@25 -- # string+=_ 00:12:17.294 09:35:39 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.294 09:35:39 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.294 09:35:39 -- target/invalid.sh@28 -- # [[ 6 == \- ]] 00:12:17.294 09:35:39 -- target/invalid.sh@31 -- # echo '60x~V(l~~+<4[F{#lCqQ_' 00:12:17.294 09:35:39 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '60x~V(l~~+<4[F{#lCqQ_' nqn.2016-06.io.spdk:cnode18503 00:12:17.553 [2024-11-29 09:35:40.138509] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode18503: invalid serial number '60x~V(l~~+<4[F{#lCqQ_' 00:12:17.553 09:35:40 -- target/invalid.sh@54 -- # out='request: 00:12:17.553 { 00:12:17.553 "nqn": "nqn.2016-06.io.spdk:cnode18503", 00:12:17.553 "serial_number": "60x~V(l~~+<4[F{#lCqQ_", 00:12:17.553 "method": "nvmf_create_subsystem", 00:12:17.553 "req_id": 1 00:12:17.553 } 00:12:17.553 Got JSON-RPC error response 00:12:17.553 response: 00:12:17.553 { 00:12:17.553 "code": -32602, 00:12:17.553 "message": "Invalid SN 60x~V(l~~+<4[F{#lCqQ_" 00:12:17.553 }' 00:12:17.553 09:35:40 -- target/invalid.sh@55 -- # [[ request: 00:12:17.553 { 00:12:17.553 "nqn": "nqn.2016-06.io.spdk:cnode18503", 00:12:17.553 "serial_number": "60x~V(l~~+<4[F{#lCqQ_", 00:12:17.553 "method": "nvmf_create_subsystem", 00:12:17.553 "req_id": 1 00:12:17.553 } 00:12:17.553 Got JSON-RPC error response 00:12:17.553 response: 00:12:17.553 { 00:12:17.553 "code": -32602, 00:12:17.553 "message": "Invalid SN 60x~V(l~~+<4[F{#lCqQ_" 00:12:17.553 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:17.553 09:35:40 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:17.553 09:35:40 -- target/invalid.sh@19 -- # local length=41 ll 00:12:17.553 09:35:40 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:17.553 09:35:40 -- target/invalid.sh@21 -- # local chars 00:12:17.553 09:35:40 -- target/invalid.sh@22 -- # local string 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # printf %x 73 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # string+=I 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # printf %x 114 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # string+=r 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # printf %x 121 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x79' 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # string+=y 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # printf %x 78 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # string+=N 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # printf %x 120 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x78' 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # string+=x 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # printf %x 101 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x65' 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # string+=e 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # printf %x 92 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # string+='\' 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # printf %x 90 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # string+=Z 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # printf %x 41 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # string+=')' 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # printf %x 112 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x70' 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # string+=p 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.553 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.553 09:35:40 -- target/invalid.sh@25 -- # printf %x 78 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=N 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 46 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=. 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 43 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=+ 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 32 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=' ' 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 89 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=Y 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 60 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+='<' 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 102 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x66' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=f 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 38 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x26' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+='&' 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 41 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=')' 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 75 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=K 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 56 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=8 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 110 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=n 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 123 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+='{' 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 49 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x31' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=1 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 103 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x67' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=g 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 114 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=r 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 126 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+='~' 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 35 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x23' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+='#' 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 35 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x23' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+='#' 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 61 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+== 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 117 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=u 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 61 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+== 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 41 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=')' 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 50 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x32' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=2 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 78 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=N 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 75 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=K 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 100 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x64' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=d 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 72 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x48' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=H 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 92 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+='\' 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 47 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=/ 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # printf %x 80 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # echo -e '\x50' 00:12:17.554 09:35:40 -- target/invalid.sh@25 -- # string+=P 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:17.554 09:35:40 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:17.554 09:35:40 -- target/invalid.sh@28 -- # [[ I == \- ]] 00:12:17.554 09:35:40 -- target/invalid.sh@31 -- # echo 'IryNxe\Z)pN.+ Y /dev/null' 00:12:20.222 09:35:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:22.756 09:35:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:22.756 00:12:22.756 real 0m9.615s 00:12:22.756 user 0m23.152s 00:12:22.756 sys 0m2.579s 00:12:22.756 09:35:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:22.756 09:35:45 -- common/autotest_common.sh@10 -- # set +x 00:12:22.756 ************************************ 00:12:22.756 END TEST nvmf_invalid 00:12:22.756 ************************************ 00:12:22.756 09:35:45 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:22.756 09:35:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:22.756 09:35:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:22.756 09:35:45 -- common/autotest_common.sh@10 -- # set +x 00:12:22.756 ************************************ 00:12:22.756 START TEST nvmf_abort 00:12:22.756 ************************************ 00:12:22.756 09:35:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:22.756 * Looking for test storage... 00:12:22.757 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:22.757 09:35:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:22.757 09:35:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:22.757 09:35:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:22.757 09:35:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:22.757 09:35:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:22.757 09:35:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:22.757 09:35:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:22.757 09:35:45 -- scripts/common.sh@335 -- # IFS=.-: 00:12:22.757 09:35:45 -- scripts/common.sh@335 -- # read -ra ver1 00:12:22.757 09:35:45 -- scripts/common.sh@336 -- # IFS=.-: 00:12:22.757 09:35:45 -- scripts/common.sh@336 -- # read -ra ver2 00:12:22.757 09:35:45 -- scripts/common.sh@337 -- # local 'op=<' 00:12:22.757 09:35:45 -- scripts/common.sh@339 -- # ver1_l=2 00:12:22.757 09:35:45 -- scripts/common.sh@340 -- # ver2_l=1 00:12:22.757 09:35:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:22.757 09:35:45 -- scripts/common.sh@343 -- # case "$op" in 00:12:22.757 09:35:45 -- scripts/common.sh@344 -- # : 1 00:12:22.757 09:35:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:22.757 09:35:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:22.757 09:35:45 -- scripts/common.sh@364 -- # decimal 1 00:12:22.757 09:35:45 -- scripts/common.sh@352 -- # local d=1 00:12:22.757 09:35:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:22.757 09:35:45 -- scripts/common.sh@354 -- # echo 1 00:12:22.757 09:35:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:22.757 09:35:45 -- scripts/common.sh@365 -- # decimal 2 00:12:22.757 09:35:45 -- scripts/common.sh@352 -- # local d=2 00:12:22.757 09:35:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:22.757 09:35:45 -- scripts/common.sh@354 -- # echo 2 00:12:22.757 09:35:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:22.757 09:35:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:22.757 09:35:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:22.757 09:35:45 -- scripts/common.sh@367 -- # return 0 00:12:22.757 09:35:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:22.757 09:35:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:22.757 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:22.757 --rc genhtml_branch_coverage=1 00:12:22.757 --rc genhtml_function_coverage=1 00:12:22.757 --rc genhtml_legend=1 00:12:22.757 --rc geninfo_all_blocks=1 00:12:22.757 --rc geninfo_unexecuted_blocks=1 00:12:22.757 00:12:22.757 ' 00:12:22.757 09:35:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:22.757 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:22.757 --rc genhtml_branch_coverage=1 00:12:22.757 --rc genhtml_function_coverage=1 00:12:22.757 --rc genhtml_legend=1 00:12:22.757 --rc geninfo_all_blocks=1 00:12:22.757 --rc geninfo_unexecuted_blocks=1 00:12:22.757 00:12:22.757 ' 00:12:22.757 09:35:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:22.757 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:22.757 --rc genhtml_branch_coverage=1 00:12:22.757 --rc genhtml_function_coverage=1 00:12:22.757 --rc genhtml_legend=1 00:12:22.757 --rc geninfo_all_blocks=1 00:12:22.757 --rc geninfo_unexecuted_blocks=1 00:12:22.757 00:12:22.757 ' 00:12:22.757 09:35:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:22.757 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:22.757 --rc genhtml_branch_coverage=1 00:12:22.757 --rc genhtml_function_coverage=1 00:12:22.757 --rc genhtml_legend=1 00:12:22.757 --rc geninfo_all_blocks=1 00:12:22.757 --rc geninfo_unexecuted_blocks=1 00:12:22.757 00:12:22.757 ' 00:12:22.757 09:35:45 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:22.757 09:35:45 -- nvmf/common.sh@7 -- # uname -s 00:12:22.757 09:35:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:22.757 09:35:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:22.757 09:35:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:22.757 09:35:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:22.757 09:35:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:22.757 09:35:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:22.757 09:35:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:22.757 09:35:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:22.757 09:35:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:22.757 09:35:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:22.757 09:35:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:22.757 09:35:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:22.757 09:35:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:22.757 09:35:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:22.757 09:35:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:22.757 09:35:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:22.757 09:35:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:22.757 09:35:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:22.757 09:35:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:22.757 09:35:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.757 09:35:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.757 09:35:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.757 09:35:45 -- paths/export.sh@5 -- # export PATH 00:12:22.757 09:35:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:22.757 09:35:45 -- nvmf/common.sh@46 -- # : 0 00:12:22.757 09:35:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:22.757 09:35:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:22.757 09:35:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:22.757 09:35:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:22.757 09:35:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:22.757 09:35:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:22.757 09:35:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:22.757 09:35:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:22.757 09:35:45 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:22.757 09:35:45 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:22.757 09:35:45 -- target/abort.sh@14 -- # nvmftestinit 00:12:22.757 09:35:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:22.757 09:35:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:22.757 09:35:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:22.757 09:35:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:22.757 09:35:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:22.757 09:35:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:22.757 09:35:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:22.757 09:35:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:22.757 09:35:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:22.757 09:35:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:22.757 09:35:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:22.757 09:35:45 -- common/autotest_common.sh@10 -- # set +x 00:12:24.664 09:35:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:24.664 09:35:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:24.664 09:35:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:24.664 09:35:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:24.664 09:35:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:24.664 09:35:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:24.664 09:35:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:24.664 09:35:47 -- nvmf/common.sh@294 -- # net_devs=() 00:12:24.664 09:35:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:24.664 09:35:47 -- nvmf/common.sh@295 -- # e810=() 00:12:24.664 09:35:47 -- nvmf/common.sh@295 -- # local -ga e810 00:12:24.664 09:35:47 -- nvmf/common.sh@296 -- # x722=() 00:12:24.664 09:35:47 -- nvmf/common.sh@296 -- # local -ga x722 00:12:24.664 09:35:47 -- nvmf/common.sh@297 -- # mlx=() 00:12:24.664 09:35:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:24.664 09:35:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:24.664 09:35:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:24.664 09:35:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:24.664 09:35:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:24.664 09:35:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:24.664 09:35:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:24.664 09:35:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:24.664 09:35:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:24.664 09:35:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:24.664 09:35:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:24.664 09:35:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:24.664 09:35:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:24.664 09:35:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:24.664 09:35:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:24.664 09:35:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:24.664 09:35:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:24.664 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:24.664 09:35:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:24.664 09:35:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:24.664 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:24.664 09:35:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:24.664 09:35:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:24.664 09:35:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:24.664 09:35:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:24.664 09:35:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:24.664 09:35:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:24.664 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:24.664 09:35:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:24.664 09:35:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:24.664 09:35:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:24.664 09:35:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:24.664 09:35:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:24.664 09:35:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:24.664 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:24.664 09:35:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:24.664 09:35:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:24.664 09:35:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:24.664 09:35:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:24.664 09:35:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:24.664 09:35:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:24.664 09:35:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:24.664 09:35:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:24.664 09:35:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:24.664 09:35:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:24.664 09:35:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:24.664 09:35:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:24.664 09:35:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:24.664 09:35:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:24.665 09:35:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:24.665 09:35:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:24.665 09:35:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:24.665 09:35:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:24.665 09:35:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:24.665 09:35:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:24.665 09:35:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:24.665 09:35:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:24.665 09:35:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:24.665 09:35:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:24.665 09:35:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:24.665 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:24.665 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.269 ms 00:12:24.665 00:12:24.665 --- 10.0.0.2 ping statistics --- 00:12:24.665 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:24.665 rtt min/avg/max/mdev = 0.269/0.269/0.269/0.000 ms 00:12:24.665 09:35:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:24.665 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:24.665 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:12:24.665 00:12:24.665 --- 10.0.0.1 ping statistics --- 00:12:24.665 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:24.665 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:12:24.665 09:35:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:24.665 09:35:47 -- nvmf/common.sh@410 -- # return 0 00:12:24.665 09:35:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:24.665 09:35:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:24.665 09:35:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:24.665 09:35:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:24.665 09:35:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:24.665 09:35:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:24.665 09:35:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:24.665 09:35:47 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:24.665 09:35:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:24.665 09:35:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:24.665 09:35:47 -- common/autotest_common.sh@10 -- # set +x 00:12:24.665 09:35:47 -- nvmf/common.sh@469 -- # nvmfpid=4174086 00:12:24.665 09:35:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:24.665 09:35:47 -- nvmf/common.sh@470 -- # waitforlisten 4174086 00:12:24.665 09:35:47 -- common/autotest_common.sh@829 -- # '[' -z 4174086 ']' 00:12:24.665 09:35:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:24.665 09:35:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:24.665 09:35:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:24.665 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:24.665 09:35:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:24.665 09:35:47 -- common/autotest_common.sh@10 -- # set +x 00:12:24.665 [2024-11-29 09:35:47.455155] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:24.665 [2024-11-29 09:35:47.455226] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:24.665 EAL: No free 2048 kB hugepages reported on node 1 00:12:24.926 [2024-11-29 09:35:47.520328] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:24.926 [2024-11-29 09:35:47.629018] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:24.926 [2024-11-29 09:35:47.629196] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:24.926 [2024-11-29 09:35:47.629213] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:24.926 [2024-11-29 09:35:47.629225] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:24.926 [2024-11-29 09:35:47.629367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:24.926 [2024-11-29 09:35:47.629423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:24.926 [2024-11-29 09:35:47.629427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:25.864 09:35:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:25.864 09:35:48 -- common/autotest_common.sh@862 -- # return 0 00:12:25.864 09:35:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:25.864 09:35:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:25.864 09:35:48 -- common/autotest_common.sh@10 -- # set +x 00:12:25.864 09:35:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:25.864 09:35:48 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:25.864 09:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.865 09:35:48 -- common/autotest_common.sh@10 -- # set +x 00:12:25.865 [2024-11-29 09:35:48.492156] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:25.865 09:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.865 09:35:48 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:25.865 09:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.865 09:35:48 -- common/autotest_common.sh@10 -- # set +x 00:12:25.865 Malloc0 00:12:25.865 09:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.865 09:35:48 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:25.865 09:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.865 09:35:48 -- common/autotest_common.sh@10 -- # set +x 00:12:25.865 Delay0 00:12:25.865 09:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.865 09:35:48 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:25.865 09:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.865 09:35:48 -- common/autotest_common.sh@10 -- # set +x 00:12:25.865 09:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.865 09:35:48 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:25.865 09:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.865 09:35:48 -- common/autotest_common.sh@10 -- # set +x 00:12:25.865 09:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.865 09:35:48 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:25.865 09:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.865 09:35:48 -- common/autotest_common.sh@10 -- # set +x 00:12:25.865 [2024-11-29 09:35:48.559440] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:25.865 09:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.865 09:35:48 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:25.865 09:35:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.865 09:35:48 -- common/autotest_common.sh@10 -- # set +x 00:12:25.865 09:35:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.865 09:35:48 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:25.865 EAL: No free 2048 kB hugepages reported on node 1 00:12:25.865 [2024-11-29 09:35:48.614117] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:28.418 Initializing NVMe Controllers 00:12:28.418 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:28.418 controller IO queue size 128 less than required 00:12:28.418 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:28.418 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:28.418 Initialization complete. Launching workers. 00:12:28.418 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 32825 00:12:28.418 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 32886, failed to submit 62 00:12:28.418 success 32825, unsuccess 61, failed 0 00:12:28.418 09:35:50 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:28.418 09:35:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:28.418 09:35:50 -- common/autotest_common.sh@10 -- # set +x 00:12:28.418 09:35:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:28.418 09:35:50 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:28.418 09:35:50 -- target/abort.sh@38 -- # nvmftestfini 00:12:28.418 09:35:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:28.418 09:35:50 -- nvmf/common.sh@116 -- # sync 00:12:28.418 09:35:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:28.418 09:35:50 -- nvmf/common.sh@119 -- # set +e 00:12:28.418 09:35:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:28.418 09:35:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:28.418 rmmod nvme_tcp 00:12:28.418 rmmod nvme_fabrics 00:12:28.418 rmmod nvme_keyring 00:12:28.418 09:35:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:28.418 09:35:50 -- nvmf/common.sh@123 -- # set -e 00:12:28.418 09:35:50 -- nvmf/common.sh@124 -- # return 0 00:12:28.418 09:35:50 -- nvmf/common.sh@477 -- # '[' -n 4174086 ']' 00:12:28.418 09:35:50 -- nvmf/common.sh@478 -- # killprocess 4174086 00:12:28.418 09:35:50 -- common/autotest_common.sh@936 -- # '[' -z 4174086 ']' 00:12:28.418 09:35:50 -- common/autotest_common.sh@940 -- # kill -0 4174086 00:12:28.418 09:35:50 -- common/autotest_common.sh@941 -- # uname 00:12:28.418 09:35:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:28.418 09:35:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4174086 00:12:28.418 09:35:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:28.418 09:35:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:28.418 09:35:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4174086' 00:12:28.418 killing process with pid 4174086 00:12:28.418 09:35:50 -- common/autotest_common.sh@955 -- # kill 4174086 00:12:28.418 09:35:50 -- common/autotest_common.sh@960 -- # wait 4174086 00:12:28.418 09:35:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:28.418 09:35:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:28.418 09:35:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:28.418 09:35:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:28.418 09:35:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:28.418 09:35:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:28.418 09:35:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:28.418 09:35:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:30.334 09:35:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:30.334 00:12:30.334 real 0m7.981s 00:12:30.334 user 0m12.655s 00:12:30.334 sys 0m2.534s 00:12:30.334 09:35:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:30.334 09:35:53 -- common/autotest_common.sh@10 -- # set +x 00:12:30.334 ************************************ 00:12:30.334 END TEST nvmf_abort 00:12:30.334 ************************************ 00:12:30.334 09:35:53 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:30.334 09:35:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:30.334 09:35:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:30.334 09:35:53 -- common/autotest_common.sh@10 -- # set +x 00:12:30.334 ************************************ 00:12:30.334 START TEST nvmf_ns_hotplug_stress 00:12:30.334 ************************************ 00:12:30.334 09:35:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:30.597 * Looking for test storage... 00:12:30.597 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:30.597 09:35:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:30.597 09:35:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:30.597 09:35:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:30.597 09:35:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:30.597 09:35:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:30.597 09:35:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:30.597 09:35:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:30.597 09:35:53 -- scripts/common.sh@335 -- # IFS=.-: 00:12:30.597 09:35:53 -- scripts/common.sh@335 -- # read -ra ver1 00:12:30.597 09:35:53 -- scripts/common.sh@336 -- # IFS=.-: 00:12:30.597 09:35:53 -- scripts/common.sh@336 -- # read -ra ver2 00:12:30.597 09:35:53 -- scripts/common.sh@337 -- # local 'op=<' 00:12:30.597 09:35:53 -- scripts/common.sh@339 -- # ver1_l=2 00:12:30.597 09:35:53 -- scripts/common.sh@340 -- # ver2_l=1 00:12:30.597 09:35:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:30.597 09:35:53 -- scripts/common.sh@343 -- # case "$op" in 00:12:30.597 09:35:53 -- scripts/common.sh@344 -- # : 1 00:12:30.597 09:35:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:30.597 09:35:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:30.597 09:35:53 -- scripts/common.sh@364 -- # decimal 1 00:12:30.597 09:35:53 -- scripts/common.sh@352 -- # local d=1 00:12:30.597 09:35:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:30.597 09:35:53 -- scripts/common.sh@354 -- # echo 1 00:12:30.597 09:35:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:30.597 09:35:53 -- scripts/common.sh@365 -- # decimal 2 00:12:30.597 09:35:53 -- scripts/common.sh@352 -- # local d=2 00:12:30.597 09:35:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:30.597 09:35:53 -- scripts/common.sh@354 -- # echo 2 00:12:30.597 09:35:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:30.597 09:35:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:30.597 09:35:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:30.597 09:35:53 -- scripts/common.sh@367 -- # return 0 00:12:30.597 09:35:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:30.597 09:35:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:30.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.597 --rc genhtml_branch_coverage=1 00:12:30.597 --rc genhtml_function_coverage=1 00:12:30.597 --rc genhtml_legend=1 00:12:30.597 --rc geninfo_all_blocks=1 00:12:30.597 --rc geninfo_unexecuted_blocks=1 00:12:30.597 00:12:30.597 ' 00:12:30.597 09:35:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:30.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.597 --rc genhtml_branch_coverage=1 00:12:30.597 --rc genhtml_function_coverage=1 00:12:30.597 --rc genhtml_legend=1 00:12:30.597 --rc geninfo_all_blocks=1 00:12:30.597 --rc geninfo_unexecuted_blocks=1 00:12:30.597 00:12:30.597 ' 00:12:30.597 09:35:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:30.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.597 --rc genhtml_branch_coverage=1 00:12:30.597 --rc genhtml_function_coverage=1 00:12:30.597 --rc genhtml_legend=1 00:12:30.597 --rc geninfo_all_blocks=1 00:12:30.597 --rc geninfo_unexecuted_blocks=1 00:12:30.597 00:12:30.597 ' 00:12:30.597 09:35:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:30.598 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:30.598 --rc genhtml_branch_coverage=1 00:12:30.598 --rc genhtml_function_coverage=1 00:12:30.598 --rc genhtml_legend=1 00:12:30.598 --rc geninfo_all_blocks=1 00:12:30.598 --rc geninfo_unexecuted_blocks=1 00:12:30.598 00:12:30.598 ' 00:12:30.598 09:35:53 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:30.598 09:35:53 -- nvmf/common.sh@7 -- # uname -s 00:12:30.598 09:35:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:30.598 09:35:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:30.598 09:35:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:30.598 09:35:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:30.598 09:35:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:30.598 09:35:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:30.598 09:35:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:30.598 09:35:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:30.598 09:35:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:30.598 09:35:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:30.598 09:35:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:30.598 09:35:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:30.598 09:35:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:30.598 09:35:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:30.598 09:35:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:30.598 09:35:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:30.598 09:35:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:30.598 09:35:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:30.598 09:35:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:30.598 09:35:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.598 09:35:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.598 09:35:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.598 09:35:53 -- paths/export.sh@5 -- # export PATH 00:12:30.598 09:35:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.598 09:35:53 -- nvmf/common.sh@46 -- # : 0 00:12:30.598 09:35:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:30.598 09:35:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:30.598 09:35:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:30.598 09:35:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:30.598 09:35:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:30.598 09:35:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:30.598 09:35:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:30.598 09:35:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:30.598 09:35:53 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:30.598 09:35:53 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:30.598 09:35:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:30.598 09:35:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:30.598 09:35:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:30.598 09:35:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:30.598 09:35:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:30.598 09:35:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:30.598 09:35:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:30.598 09:35:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:30.598 09:35:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:30.598 09:35:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:30.598 09:35:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:30.598 09:35:53 -- common/autotest_common.sh@10 -- # set +x 00:12:33.143 09:35:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:33.143 09:35:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:33.143 09:35:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:33.143 09:35:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:33.143 09:35:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:33.143 09:35:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:33.143 09:35:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:33.143 09:35:55 -- nvmf/common.sh@294 -- # net_devs=() 00:12:33.143 09:35:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:33.144 09:35:55 -- nvmf/common.sh@295 -- # e810=() 00:12:33.144 09:35:55 -- nvmf/common.sh@295 -- # local -ga e810 00:12:33.144 09:35:55 -- nvmf/common.sh@296 -- # x722=() 00:12:33.144 09:35:55 -- nvmf/common.sh@296 -- # local -ga x722 00:12:33.144 09:35:55 -- nvmf/common.sh@297 -- # mlx=() 00:12:33.144 09:35:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:33.144 09:35:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:33.144 09:35:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:33.144 09:35:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:33.144 09:35:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:33.144 09:35:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:33.144 09:35:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:33.144 09:35:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:33.144 09:35:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:33.144 09:35:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:33.144 09:35:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:33.144 09:35:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:33.144 09:35:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:33.144 09:35:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:33.144 09:35:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:33.144 09:35:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:33.144 09:35:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:33.144 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:33.144 09:35:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:33.144 09:35:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:33.144 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:33.144 09:35:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:33.144 09:35:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:33.144 09:35:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:33.144 09:35:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:33.144 09:35:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:33.144 09:35:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:33.144 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:33.144 09:35:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:33.144 09:35:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:33.144 09:35:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:33.144 09:35:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:33.144 09:35:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:33.144 09:35:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:33.144 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:33.144 09:35:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:33.144 09:35:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:33.144 09:35:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:33.144 09:35:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:33.144 09:35:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:33.144 09:35:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:33.144 09:35:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:33.144 09:35:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:33.144 09:35:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:33.144 09:35:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:33.144 09:35:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:33.144 09:35:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:33.144 09:35:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:33.144 09:35:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:33.144 09:35:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:33.144 09:35:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:33.144 09:35:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:33.144 09:35:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:33.144 09:35:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:33.144 09:35:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:33.144 09:35:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:33.144 09:35:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:33.144 09:35:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:33.144 09:35:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:33.144 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:33.144 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.267 ms 00:12:33.144 00:12:33.144 --- 10.0.0.2 ping statistics --- 00:12:33.144 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:33.144 rtt min/avg/max/mdev = 0.267/0.267/0.267/0.000 ms 00:12:33.144 09:35:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:33.144 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:33.144 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:12:33.144 00:12:33.144 --- 10.0.0.1 ping statistics --- 00:12:33.144 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:33.144 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:12:33.144 09:35:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:33.144 09:35:55 -- nvmf/common.sh@410 -- # return 0 00:12:33.144 09:35:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:33.144 09:35:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:33.144 09:35:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:33.144 09:35:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:33.144 09:35:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:33.144 09:35:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:33.144 09:35:55 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:33.144 09:35:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:33.144 09:35:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:33.144 09:35:55 -- common/autotest_common.sh@10 -- # set +x 00:12:33.144 09:35:55 -- nvmf/common.sh@469 -- # nvmfpid=4176467 00:12:33.144 09:35:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:33.144 09:35:55 -- nvmf/common.sh@470 -- # waitforlisten 4176467 00:12:33.144 09:35:55 -- common/autotest_common.sh@829 -- # '[' -z 4176467 ']' 00:12:33.144 09:35:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:33.144 09:35:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:33.144 09:35:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:33.144 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:33.144 09:35:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:33.144 09:35:55 -- common/autotest_common.sh@10 -- # set +x 00:12:33.144 [2024-11-29 09:35:55.675429] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:33.144 [2024-11-29 09:35:55.675521] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:33.144 EAL: No free 2048 kB hugepages reported on node 1 00:12:33.144 [2024-11-29 09:35:55.739721] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:33.144 [2024-11-29 09:35:55.850358] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:33.144 [2024-11-29 09:35:55.850520] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:33.144 [2024-11-29 09:35:55.850538] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:33.144 [2024-11-29 09:35:55.850552] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:33.144 [2024-11-29 09:35:55.850604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:33.144 [2024-11-29 09:35:55.850630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:33.144 [2024-11-29 09:35:55.850634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:34.082 09:35:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:34.082 09:35:56 -- common/autotest_common.sh@862 -- # return 0 00:12:34.082 09:35:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:34.082 09:35:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:34.082 09:35:56 -- common/autotest_common.sh@10 -- # set +x 00:12:34.082 09:35:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:34.082 09:35:56 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:34.082 09:35:56 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:34.341 [2024-11-29 09:35:56.933404] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:34.341 09:35:56 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:34.600 09:35:57 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:34.858 [2024-11-29 09:35:57.444282] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:34.858 09:35:57 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:35.118 09:35:57 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:35.377 Malloc0 00:12:35.377 09:35:57 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:35.636 Delay0 00:12:35.636 09:35:58 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:35.894 09:35:58 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:35.894 NULL1 00:12:35.894 09:35:58 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:36.153 09:35:58 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=4176903 00:12:36.153 09:35:58 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:36.153 09:35:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:36.153 09:35:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.411 EAL: No free 2048 kB hugepages reported on node 1 00:12:37.345 Read completed with error (sct=0, sc=11) 00:12:37.345 09:36:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:37.603 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:37.603 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:37.603 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:37.603 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:37.603 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:37.603 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:37.603 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:37.862 09:36:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:37.862 09:36:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:37.862 true 00:12:38.121 09:36:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:38.121 09:36:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:38.687 09:36:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:38.944 09:36:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:38.945 09:36:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:39.202 true 00:12:39.202 09:36:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:39.202 09:36:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:39.459 09:36:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:39.717 09:36:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:39.717 09:36:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:39.975 true 00:12:39.975 09:36:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:39.975 09:36:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:40.232 09:36:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:40.488 09:36:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:40.488 09:36:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:40.744 true 00:12:40.744 09:36:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:40.744 09:36:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:41.673 09:36:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.930 09:36:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:41.930 09:36:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:42.186 true 00:12:42.186 09:36:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:42.186 09:36:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:42.449 09:36:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:42.715 09:36:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:42.715 09:36:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:42.971 true 00:12:42.971 09:36:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:42.971 09:36:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.902 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:43.902 09:36:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:43.902 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:44.160 09:36:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:44.160 09:36:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:44.417 true 00:12:44.417 09:36:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:44.417 09:36:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.674 09:36:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:44.931 09:36:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:44.931 09:36:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:45.189 true 00:12:45.189 09:36:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:45.189 09:36:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.123 09:36:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.382 09:36:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:46.382 09:36:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:46.640 true 00:12:46.640 09:36:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:46.640 09:36:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.897 09:36:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.155 09:36:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:47.155 09:36:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:47.413 true 00:12:47.413 09:36:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:47.413 09:36:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.671 09:36:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.929 09:36:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:47.929 09:36:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:48.187 true 00:12:48.187 09:36:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:48.187 09:36:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.119 09:36:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.120 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.377 09:36:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:49.377 09:36:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:49.635 true 00:12:49.635 09:36:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:49.635 09:36:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.893 09:36:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:50.151 09:36:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:50.151 09:36:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:50.409 true 00:12:50.409 09:36:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:50.409 09:36:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.343 09:36:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.343 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:51.343 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:51.343 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:51.343 09:36:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:51.343 09:36:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:51.675 true 00:12:51.675 09:36:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:51.675 09:36:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.976 09:36:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.233 09:36:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:52.233 09:36:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:52.495 true 00:12:52.495 09:36:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:52.495 09:36:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.426 09:36:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.426 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:53.683 09:36:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:53.683 09:36:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:53.941 true 00:12:53.941 09:36:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:53.941 09:36:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.198 09:36:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.456 09:36:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:54.456 09:36:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:54.714 true 00:12:54.714 09:36:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:54.714 09:36:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:55.647 09:36:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.647 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:55.647 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:55.905 09:36:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:12:55.905 09:36:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:12:56.163 true 00:12:56.163 09:36:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:56.163 09:36:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.420 09:36:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:56.678 09:36:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:12:56.678 09:36:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:12:56.935 true 00:12:56.935 09:36:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:56.935 09:36:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.868 09:36:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.868 09:36:20 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:12:57.868 09:36:20 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:58.126 true 00:12:58.126 09:36:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:58.126 09:36:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.384 09:36:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:58.642 09:36:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:12:58.642 09:36:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:12:58.899 true 00:12:58.899 09:36:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:58.899 09:36:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.156 09:36:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.414 09:36:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:12:59.414 09:36:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:12:59.671 true 00:12:59.671 09:36:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:12:59.671 09:36:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.041 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:01.041 09:36:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.041 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:01.041 09:36:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:13:01.041 09:36:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:01.298 true 00:13:01.298 09:36:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:13:01.298 09:36:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.556 09:36:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.813 09:36:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:01.813 09:36:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:02.071 true 00:13:02.071 09:36:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:13:02.071 09:36:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.006 09:36:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:03.006 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:03.264 09:36:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:03.264 09:36:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:03.523 true 00:13:03.523 09:36:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:13:03.523 09:36:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.781 09:36:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.039 09:36:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:04.040 09:36:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:04.040 true 00:13:04.298 09:36:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:13:04.298 09:36:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.231 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:05.231 09:36:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.231 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:05.231 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:05.231 09:36:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:05.231 09:36:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:05.488 true 00:13:05.489 09:36:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:13:05.489 09:36:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.747 09:36:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:06.005 09:36:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:06.005 09:36:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:06.263 true 00:13:06.263 09:36:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:13:06.263 09:36:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.638 Initializing NVMe Controllers 00:13:07.638 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:07.638 Controller IO queue size 128, less than required. 00:13:07.638 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:07.638 Controller IO queue size 128, less than required. 00:13:07.638 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:07.638 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:07.638 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:07.638 Initialization complete. Launching workers. 00:13:07.638 ======================================================== 00:13:07.638 Latency(us) 00:13:07.638 Device Information : IOPS MiB/s Average min max 00:13:07.638 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 818.86 0.40 81533.42 2191.10 1084843.93 00:13:07.638 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11467.10 5.60 11162.42 2387.42 442078.95 00:13:07.638 ======================================================== 00:13:07.638 Total : 12285.96 6.00 15852.65 2191.10 1084843.93 00:13:07.638 00:13:07.638 09:36:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:07.638 09:36:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:07.638 09:36:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:07.896 true 00:13:07.897 09:36:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 4176903 00:13:07.897 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (4176903) - No such process 00:13:07.897 09:36:30 -- target/ns_hotplug_stress.sh@53 -- # wait 4176903 00:13:07.897 09:36:30 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.155 09:36:30 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:08.411 09:36:31 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:08.411 09:36:31 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:08.411 09:36:31 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:08.411 09:36:31 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:08.411 09:36:31 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:08.669 null0 00:13:08.669 09:36:31 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:08.669 09:36:31 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:08.669 09:36:31 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:08.927 null1 00:13:08.927 09:36:31 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:08.927 09:36:31 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:08.927 09:36:31 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:09.185 null2 00:13:09.185 09:36:31 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:09.185 09:36:31 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:09.185 09:36:31 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:09.444 null3 00:13:09.444 09:36:32 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:09.444 09:36:32 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:09.444 09:36:32 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:09.701 null4 00:13:09.701 09:36:32 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:09.701 09:36:32 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:09.701 09:36:32 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:09.960 null5 00:13:09.960 09:36:32 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:09.960 09:36:32 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:09.960 09:36:32 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:10.218 null6 00:13:10.218 09:36:32 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:10.218 09:36:32 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:10.218 09:36:32 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:10.476 null7 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@66 -- # wait 4181811 4181812 4181814 4181816 4181818 4181820 4181822 4181824 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.476 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:10.734 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:10.734 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.734 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:10.734 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:10.734 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:10.734 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:10.734 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:10.734 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.993 09:36:33 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:11.251 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.251 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:11.251 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:11.251 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:11.251 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:11.251 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:11.251 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:11.252 09:36:33 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.510 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:11.768 09:36:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.768 09:36:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:11.768 09:36:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:11.768 09:36:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:11.768 09:36:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:11.768 09:36:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:11.768 09:36:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:11.768 09:36:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.027 09:36:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:12.286 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.286 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:12.286 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:12.286 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:12.286 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:12.286 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:12.286 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:12.286 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.544 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:12.801 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.801 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:12.801 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:12.801 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:12.801 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:12.801 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:12.801 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:13.060 09:36:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:13.060 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.060 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.060 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:13.060 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.060 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.060 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:13.318 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.319 09:36:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:13.577 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:13.577 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:13.577 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:13.577 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:13.577 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:13.577 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:13.577 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:13.577 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.836 09:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:14.095 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.095 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:14.095 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:14.095 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:14.095 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:14.095 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:14.095 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:14.095 09:36:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:14.353 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.353 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.353 09:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:14.353 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.353 09:36:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.353 09:36:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:14.353 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.354 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.354 09:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:14.612 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.612 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:14.612 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:14.612 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:14.612 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:14.612 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:14.612 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:14.612 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.871 09:36:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:15.130 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.130 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:15.130 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:15.130 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:15.130 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:15.130 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:15.130 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:15.130 09:36:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:15.388 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.388 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.388 09:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:15.388 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.388 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.389 09:36:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:15.647 09:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:15.647 09:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.647 09:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:15.647 09:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:15.647 09:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:15.647 09:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:15.647 09:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:15.647 09:36:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:15.906 09:36:38 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:15.906 09:36:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:15.906 09:36:38 -- nvmf/common.sh@116 -- # sync 00:13:15.906 09:36:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:15.906 09:36:38 -- nvmf/common.sh@119 -- # set +e 00:13:15.906 09:36:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:15.906 09:36:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:15.906 rmmod nvme_tcp 00:13:15.906 rmmod nvme_fabrics 00:13:15.906 rmmod nvme_keyring 00:13:16.164 09:36:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:16.164 09:36:38 -- nvmf/common.sh@123 -- # set -e 00:13:16.164 09:36:38 -- nvmf/common.sh@124 -- # return 0 00:13:16.164 09:36:38 -- nvmf/common.sh@477 -- # '[' -n 4176467 ']' 00:13:16.164 09:36:38 -- nvmf/common.sh@478 -- # killprocess 4176467 00:13:16.164 09:36:38 -- common/autotest_common.sh@936 -- # '[' -z 4176467 ']' 00:13:16.164 09:36:38 -- common/autotest_common.sh@940 -- # kill -0 4176467 00:13:16.164 09:36:38 -- common/autotest_common.sh@941 -- # uname 00:13:16.164 09:36:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:16.164 09:36:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4176467 00:13:16.164 09:36:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:16.164 09:36:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:16.164 09:36:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4176467' 00:13:16.164 killing process with pid 4176467 00:13:16.164 09:36:38 -- common/autotest_common.sh@955 -- # kill 4176467 00:13:16.164 09:36:38 -- common/autotest_common.sh@960 -- # wait 4176467 00:13:16.425 09:36:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:16.425 09:36:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:16.425 09:36:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:16.425 09:36:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:16.425 09:36:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:16.425 09:36:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:16.425 09:36:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:16.425 09:36:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:18.331 09:36:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:18.331 00:13:18.331 real 0m47.988s 00:13:18.331 user 3m38.375s 00:13:18.331 sys 0m15.408s 00:13:18.331 09:36:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:18.331 09:36:41 -- common/autotest_common.sh@10 -- # set +x 00:13:18.331 ************************************ 00:13:18.331 END TEST nvmf_ns_hotplug_stress 00:13:18.331 ************************************ 00:13:18.331 09:36:41 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:18.331 09:36:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:18.331 09:36:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:18.331 09:36:41 -- common/autotest_common.sh@10 -- # set +x 00:13:18.331 ************************************ 00:13:18.331 START TEST nvmf_connect_stress 00:13:18.331 ************************************ 00:13:18.331 09:36:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:18.590 * Looking for test storage... 00:13:18.590 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:18.590 09:36:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:18.590 09:36:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:18.590 09:36:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:18.590 09:36:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:18.590 09:36:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:18.590 09:36:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:18.590 09:36:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:18.590 09:36:41 -- scripts/common.sh@335 -- # IFS=.-: 00:13:18.590 09:36:41 -- scripts/common.sh@335 -- # read -ra ver1 00:13:18.590 09:36:41 -- scripts/common.sh@336 -- # IFS=.-: 00:13:18.590 09:36:41 -- scripts/common.sh@336 -- # read -ra ver2 00:13:18.590 09:36:41 -- scripts/common.sh@337 -- # local 'op=<' 00:13:18.590 09:36:41 -- scripts/common.sh@339 -- # ver1_l=2 00:13:18.590 09:36:41 -- scripts/common.sh@340 -- # ver2_l=1 00:13:18.590 09:36:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:18.590 09:36:41 -- scripts/common.sh@343 -- # case "$op" in 00:13:18.590 09:36:41 -- scripts/common.sh@344 -- # : 1 00:13:18.590 09:36:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:18.590 09:36:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:18.590 09:36:41 -- scripts/common.sh@364 -- # decimal 1 00:13:18.590 09:36:41 -- scripts/common.sh@352 -- # local d=1 00:13:18.590 09:36:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:18.590 09:36:41 -- scripts/common.sh@354 -- # echo 1 00:13:18.590 09:36:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:18.590 09:36:41 -- scripts/common.sh@365 -- # decimal 2 00:13:18.590 09:36:41 -- scripts/common.sh@352 -- # local d=2 00:13:18.590 09:36:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:18.590 09:36:41 -- scripts/common.sh@354 -- # echo 2 00:13:18.590 09:36:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:18.590 09:36:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:18.590 09:36:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:18.590 09:36:41 -- scripts/common.sh@367 -- # return 0 00:13:18.590 09:36:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:18.590 09:36:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:18.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:18.590 --rc genhtml_branch_coverage=1 00:13:18.590 --rc genhtml_function_coverage=1 00:13:18.590 --rc genhtml_legend=1 00:13:18.590 --rc geninfo_all_blocks=1 00:13:18.590 --rc geninfo_unexecuted_blocks=1 00:13:18.590 00:13:18.590 ' 00:13:18.590 09:36:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:18.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:18.591 --rc genhtml_branch_coverage=1 00:13:18.591 --rc genhtml_function_coverage=1 00:13:18.591 --rc genhtml_legend=1 00:13:18.591 --rc geninfo_all_blocks=1 00:13:18.591 --rc geninfo_unexecuted_blocks=1 00:13:18.591 00:13:18.591 ' 00:13:18.591 09:36:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:18.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:18.591 --rc genhtml_branch_coverage=1 00:13:18.591 --rc genhtml_function_coverage=1 00:13:18.591 --rc genhtml_legend=1 00:13:18.591 --rc geninfo_all_blocks=1 00:13:18.591 --rc geninfo_unexecuted_blocks=1 00:13:18.591 00:13:18.591 ' 00:13:18.591 09:36:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:18.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:18.591 --rc genhtml_branch_coverage=1 00:13:18.591 --rc genhtml_function_coverage=1 00:13:18.591 --rc genhtml_legend=1 00:13:18.591 --rc geninfo_all_blocks=1 00:13:18.591 --rc geninfo_unexecuted_blocks=1 00:13:18.591 00:13:18.591 ' 00:13:18.591 09:36:41 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:18.591 09:36:41 -- nvmf/common.sh@7 -- # uname -s 00:13:18.591 09:36:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:18.591 09:36:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:18.591 09:36:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:18.591 09:36:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:18.591 09:36:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:18.591 09:36:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:18.591 09:36:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:18.591 09:36:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:18.591 09:36:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:18.591 09:36:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:18.591 09:36:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:18.591 09:36:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:18.591 09:36:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:18.591 09:36:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:18.591 09:36:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:18.591 09:36:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:18.591 09:36:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:18.591 09:36:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:18.591 09:36:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:18.591 09:36:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.591 09:36:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.591 09:36:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.591 09:36:41 -- paths/export.sh@5 -- # export PATH 00:13:18.591 09:36:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.591 09:36:41 -- nvmf/common.sh@46 -- # : 0 00:13:18.591 09:36:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:18.591 09:36:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:18.591 09:36:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:18.591 09:36:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:18.591 09:36:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:18.591 09:36:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:18.591 09:36:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:18.591 09:36:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:18.591 09:36:41 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:18.591 09:36:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:18.591 09:36:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:18.591 09:36:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:18.591 09:36:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:18.591 09:36:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:18.591 09:36:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:18.591 09:36:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:18.591 09:36:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:18.591 09:36:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:18.591 09:36:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:18.591 09:36:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:18.591 09:36:41 -- common/autotest_common.sh@10 -- # set +x 00:13:20.495 09:36:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:20.495 09:36:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:20.495 09:36:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:20.495 09:36:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:20.495 09:36:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:20.495 09:36:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:20.495 09:36:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:20.495 09:36:43 -- nvmf/common.sh@294 -- # net_devs=() 00:13:20.495 09:36:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:20.495 09:36:43 -- nvmf/common.sh@295 -- # e810=() 00:13:20.495 09:36:43 -- nvmf/common.sh@295 -- # local -ga e810 00:13:20.495 09:36:43 -- nvmf/common.sh@296 -- # x722=() 00:13:20.495 09:36:43 -- nvmf/common.sh@296 -- # local -ga x722 00:13:20.495 09:36:43 -- nvmf/common.sh@297 -- # mlx=() 00:13:20.495 09:36:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:20.495 09:36:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:20.495 09:36:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:20.495 09:36:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:20.495 09:36:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:20.495 09:36:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:20.495 09:36:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:20.495 09:36:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:20.495 09:36:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:20.495 09:36:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:20.495 09:36:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:20.495 09:36:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:20.495 09:36:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:20.495 09:36:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:20.495 09:36:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:20.495 09:36:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:20.495 09:36:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:20.495 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:20.495 09:36:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:20.495 09:36:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:20.495 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:20.495 09:36:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:20.495 09:36:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:20.495 09:36:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:20.495 09:36:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:20.495 09:36:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:20.495 09:36:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:20.495 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:20.495 09:36:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:20.495 09:36:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:20.495 09:36:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:20.495 09:36:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:20.495 09:36:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:20.495 09:36:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:20.495 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:20.495 09:36:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:20.495 09:36:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:20.495 09:36:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:20.495 09:36:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:20.495 09:36:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:20.495 09:36:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:20.495 09:36:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:20.495 09:36:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:20.495 09:36:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:20.495 09:36:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:20.495 09:36:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:20.495 09:36:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:20.495 09:36:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:20.495 09:36:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:20.495 09:36:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:20.495 09:36:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:20.495 09:36:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:20.495 09:36:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:20.754 09:36:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:20.754 09:36:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:20.754 09:36:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:20.754 09:36:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:20.754 09:36:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:20.754 09:36:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:20.754 09:36:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:20.754 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:20.754 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.363 ms 00:13:20.754 00:13:20.754 --- 10.0.0.2 ping statistics --- 00:13:20.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:20.754 rtt min/avg/max/mdev = 0.363/0.363/0.363/0.000 ms 00:13:20.754 09:36:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:20.754 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:20.754 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:13:20.754 00:13:20.754 --- 10.0.0.1 ping statistics --- 00:13:20.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:20.754 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:13:20.754 09:36:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:20.754 09:36:43 -- nvmf/common.sh@410 -- # return 0 00:13:20.754 09:36:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:20.754 09:36:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:20.754 09:36:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:20.754 09:36:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:20.754 09:36:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:20.754 09:36:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:20.754 09:36:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:20.754 09:36:43 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:20.754 09:36:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:20.754 09:36:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:20.754 09:36:43 -- common/autotest_common.sh@10 -- # set +x 00:13:20.754 09:36:43 -- nvmf/common.sh@469 -- # nvmfpid=4184603 00:13:20.754 09:36:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:20.754 09:36:43 -- nvmf/common.sh@470 -- # waitforlisten 4184603 00:13:20.754 09:36:43 -- common/autotest_common.sh@829 -- # '[' -z 4184603 ']' 00:13:20.754 09:36:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:20.754 09:36:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:20.754 09:36:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:20.754 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:20.754 09:36:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:20.754 09:36:43 -- common/autotest_common.sh@10 -- # set +x 00:13:20.754 [2024-11-29 09:36:43.492803] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:20.754 [2024-11-29 09:36:43.492891] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:20.754 EAL: No free 2048 kB hugepages reported on node 1 00:13:20.754 [2024-11-29 09:36:43.562623] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:21.013 [2024-11-29 09:36:43.681455] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:21.013 [2024-11-29 09:36:43.681621] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:21.013 [2024-11-29 09:36:43.681641] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:21.013 [2024-11-29 09:36:43.681656] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:21.013 [2024-11-29 09:36:43.681765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:21.013 [2024-11-29 09:36:43.685413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:21.013 [2024-11-29 09:36:43.685426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:22.013 09:36:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:22.013 09:36:44 -- common/autotest_common.sh@862 -- # return 0 00:13:22.013 09:36:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:22.013 09:36:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:22.013 09:36:44 -- common/autotest_common.sh@10 -- # set +x 00:13:22.013 09:36:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:22.013 09:36:44 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:22.013 09:36:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.013 09:36:44 -- common/autotest_common.sh@10 -- # set +x 00:13:22.013 [2024-11-29 09:36:44.513951] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:22.013 09:36:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.013 09:36:44 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:22.013 09:36:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.013 09:36:44 -- common/autotest_common.sh@10 -- # set +x 00:13:22.013 09:36:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.013 09:36:44 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:22.013 09:36:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.013 09:36:44 -- common/autotest_common.sh@10 -- # set +x 00:13:22.013 [2024-11-29 09:36:44.542574] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:22.013 09:36:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.013 09:36:44 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:22.013 09:36:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.013 09:36:44 -- common/autotest_common.sh@10 -- # set +x 00:13:22.013 NULL1 00:13:22.013 09:36:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.013 09:36:44 -- target/connect_stress.sh@21 -- # PERF_PID=4184765 00:13:22.013 09:36:44 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:22.013 09:36:44 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:22.013 09:36:44 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 EAL: No free 2048 kB hugepages reported on node 1 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.013 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.013 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.014 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.014 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.014 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.014 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.014 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.014 09:36:44 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:22.014 09:36:44 -- target/connect_stress.sh@28 -- # cat 00:13:22.014 09:36:44 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:22.014 09:36:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.014 09:36:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.014 09:36:44 -- common/autotest_common.sh@10 -- # set +x 00:13:22.272 09:36:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.272 09:36:44 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:22.272 09:36:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.272 09:36:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.272 09:36:44 -- common/autotest_common.sh@10 -- # set +x 00:13:22.529 09:36:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.529 09:36:45 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:22.529 09:36:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.529 09:36:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.529 09:36:45 -- common/autotest_common.sh@10 -- # set +x 00:13:22.786 09:36:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.786 09:36:45 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:22.786 09:36:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.786 09:36:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.786 09:36:45 -- common/autotest_common.sh@10 -- # set +x 00:13:23.351 09:36:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.351 09:36:45 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:23.351 09:36:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.351 09:36:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.351 09:36:45 -- common/autotest_common.sh@10 -- # set +x 00:13:23.609 09:36:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.609 09:36:46 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:23.609 09:36:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.609 09:36:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.609 09:36:46 -- common/autotest_common.sh@10 -- # set +x 00:13:23.867 09:36:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.867 09:36:46 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:23.867 09:36:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.867 09:36:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.867 09:36:46 -- common/autotest_common.sh@10 -- # set +x 00:13:24.124 09:36:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.124 09:36:46 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:24.124 09:36:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.124 09:36:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.124 09:36:46 -- common/autotest_common.sh@10 -- # set +x 00:13:24.381 09:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.381 09:36:47 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:24.381 09:36:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.381 09:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.381 09:36:47 -- common/autotest_common.sh@10 -- # set +x 00:13:24.946 09:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.946 09:36:47 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:24.946 09:36:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.946 09:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.946 09:36:47 -- common/autotest_common.sh@10 -- # set +x 00:13:25.204 09:36:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.204 09:36:47 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:25.204 09:36:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.204 09:36:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.204 09:36:47 -- common/autotest_common.sh@10 -- # set +x 00:13:25.462 09:36:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.462 09:36:48 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:25.462 09:36:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.462 09:36:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.462 09:36:48 -- common/autotest_common.sh@10 -- # set +x 00:13:25.720 09:36:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.720 09:36:48 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:25.720 09:36:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.720 09:36:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.720 09:36:48 -- common/autotest_common.sh@10 -- # set +x 00:13:25.977 09:36:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.977 09:36:48 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:25.977 09:36:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.977 09:36:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.977 09:36:48 -- common/autotest_common.sh@10 -- # set +x 00:13:26.541 09:36:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.542 09:36:49 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:26.542 09:36:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.542 09:36:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.542 09:36:49 -- common/autotest_common.sh@10 -- # set +x 00:13:26.799 09:36:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.799 09:36:49 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:26.799 09:36:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.799 09:36:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.799 09:36:49 -- common/autotest_common.sh@10 -- # set +x 00:13:27.056 09:36:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.056 09:36:49 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:27.056 09:36:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.056 09:36:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.056 09:36:49 -- common/autotest_common.sh@10 -- # set +x 00:13:27.314 09:36:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.314 09:36:50 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:27.314 09:36:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.314 09:36:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.314 09:36:50 -- common/autotest_common.sh@10 -- # set +x 00:13:27.571 09:36:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.571 09:36:50 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:27.571 09:36:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.571 09:36:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.571 09:36:50 -- common/autotest_common.sh@10 -- # set +x 00:13:28.136 09:36:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.136 09:36:50 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:28.136 09:36:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.136 09:36:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.136 09:36:50 -- common/autotest_common.sh@10 -- # set +x 00:13:28.392 09:36:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.392 09:36:51 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:28.392 09:36:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.392 09:36:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.392 09:36:51 -- common/autotest_common.sh@10 -- # set +x 00:13:28.649 09:36:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.649 09:36:51 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:28.649 09:36:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.649 09:36:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.649 09:36:51 -- common/autotest_common.sh@10 -- # set +x 00:13:28.906 09:36:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.906 09:36:51 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:28.906 09:36:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.906 09:36:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.907 09:36:51 -- common/autotest_common.sh@10 -- # set +x 00:13:29.164 09:36:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.164 09:36:51 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:29.164 09:36:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.164 09:36:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.164 09:36:51 -- common/autotest_common.sh@10 -- # set +x 00:13:29.729 09:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.729 09:36:52 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:29.729 09:36:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.729 09:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.729 09:36:52 -- common/autotest_common.sh@10 -- # set +x 00:13:29.986 09:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.986 09:36:52 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:29.986 09:36:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.986 09:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.986 09:36:52 -- common/autotest_common.sh@10 -- # set +x 00:13:30.244 09:36:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.244 09:36:52 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:30.244 09:36:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:30.244 09:36:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.244 09:36:52 -- common/autotest_common.sh@10 -- # set +x 00:13:30.501 09:36:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.501 09:36:53 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:30.501 09:36:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:30.501 09:36:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.501 09:36:53 -- common/autotest_common.sh@10 -- # set +x 00:13:31.067 09:36:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.067 09:36:53 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:31.067 09:36:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.067 09:36:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.067 09:36:53 -- common/autotest_common.sh@10 -- # set +x 00:13:31.324 09:36:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.324 09:36:53 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:31.324 09:36:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.324 09:36:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.324 09:36:53 -- common/autotest_common.sh@10 -- # set +x 00:13:31.581 09:36:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.581 09:36:54 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:31.581 09:36:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.581 09:36:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.581 09:36:54 -- common/autotest_common.sh@10 -- # set +x 00:13:31.839 09:36:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.839 09:36:54 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:31.839 09:36:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.839 09:36:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.839 09:36:54 -- common/autotest_common.sh@10 -- # set +x 00:13:32.097 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:32.097 09:36:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.097 09:36:54 -- target/connect_stress.sh@34 -- # kill -0 4184765 00:13:32.097 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (4184765) - No such process 00:13:32.097 09:36:54 -- target/connect_stress.sh@38 -- # wait 4184765 00:13:32.097 09:36:54 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:32.097 09:36:54 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:32.097 09:36:54 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:32.097 09:36:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:32.097 09:36:54 -- nvmf/common.sh@116 -- # sync 00:13:32.097 09:36:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:32.097 09:36:54 -- nvmf/common.sh@119 -- # set +e 00:13:32.097 09:36:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:32.097 09:36:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:32.097 rmmod nvme_tcp 00:13:32.097 rmmod nvme_fabrics 00:13:32.097 rmmod nvme_keyring 00:13:32.356 09:36:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:32.356 09:36:54 -- nvmf/common.sh@123 -- # set -e 00:13:32.356 09:36:54 -- nvmf/common.sh@124 -- # return 0 00:13:32.356 09:36:54 -- nvmf/common.sh@477 -- # '[' -n 4184603 ']' 00:13:32.356 09:36:54 -- nvmf/common.sh@478 -- # killprocess 4184603 00:13:32.356 09:36:54 -- common/autotest_common.sh@936 -- # '[' -z 4184603 ']' 00:13:32.356 09:36:54 -- common/autotest_common.sh@940 -- # kill -0 4184603 00:13:32.356 09:36:54 -- common/autotest_common.sh@941 -- # uname 00:13:32.356 09:36:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:32.356 09:36:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4184603 00:13:32.356 09:36:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:32.356 09:36:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:32.356 09:36:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4184603' 00:13:32.356 killing process with pid 4184603 00:13:32.356 09:36:54 -- common/autotest_common.sh@955 -- # kill 4184603 00:13:32.356 09:36:54 -- common/autotest_common.sh@960 -- # wait 4184603 00:13:32.614 09:36:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:32.614 09:36:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:32.614 09:36:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:32.614 09:36:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:32.614 09:36:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:32.614 09:36:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:32.614 09:36:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:32.615 09:36:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:34.520 09:36:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:34.520 00:13:34.520 real 0m16.143s 00:13:34.520 user 0m41.050s 00:13:34.520 sys 0m5.731s 00:13:34.520 09:36:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:34.520 09:36:57 -- common/autotest_common.sh@10 -- # set +x 00:13:34.520 ************************************ 00:13:34.520 END TEST nvmf_connect_stress 00:13:34.520 ************************************ 00:13:34.520 09:36:57 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:34.520 09:36:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:34.520 09:36:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:34.520 09:36:57 -- common/autotest_common.sh@10 -- # set +x 00:13:34.520 ************************************ 00:13:34.520 START TEST nvmf_fused_ordering 00:13:34.520 ************************************ 00:13:34.520 09:36:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:34.779 * Looking for test storage... 00:13:34.779 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:34.779 09:36:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:34.779 09:36:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:34.779 09:36:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:34.779 09:36:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:34.779 09:36:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:34.779 09:36:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:34.779 09:36:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:34.779 09:36:57 -- scripts/common.sh@335 -- # IFS=.-: 00:13:34.779 09:36:57 -- scripts/common.sh@335 -- # read -ra ver1 00:13:34.779 09:36:57 -- scripts/common.sh@336 -- # IFS=.-: 00:13:34.779 09:36:57 -- scripts/common.sh@336 -- # read -ra ver2 00:13:34.779 09:36:57 -- scripts/common.sh@337 -- # local 'op=<' 00:13:34.779 09:36:57 -- scripts/common.sh@339 -- # ver1_l=2 00:13:34.779 09:36:57 -- scripts/common.sh@340 -- # ver2_l=1 00:13:34.779 09:36:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:34.779 09:36:57 -- scripts/common.sh@343 -- # case "$op" in 00:13:34.779 09:36:57 -- scripts/common.sh@344 -- # : 1 00:13:34.779 09:36:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:34.779 09:36:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:34.779 09:36:57 -- scripts/common.sh@364 -- # decimal 1 00:13:34.779 09:36:57 -- scripts/common.sh@352 -- # local d=1 00:13:34.779 09:36:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:34.779 09:36:57 -- scripts/common.sh@354 -- # echo 1 00:13:34.779 09:36:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:34.779 09:36:57 -- scripts/common.sh@365 -- # decimal 2 00:13:34.779 09:36:57 -- scripts/common.sh@352 -- # local d=2 00:13:34.779 09:36:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:34.779 09:36:57 -- scripts/common.sh@354 -- # echo 2 00:13:34.779 09:36:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:34.779 09:36:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:34.779 09:36:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:34.779 09:36:57 -- scripts/common.sh@367 -- # return 0 00:13:34.779 09:36:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:34.779 09:36:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:34.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:34.779 --rc genhtml_branch_coverage=1 00:13:34.779 --rc genhtml_function_coverage=1 00:13:34.779 --rc genhtml_legend=1 00:13:34.779 --rc geninfo_all_blocks=1 00:13:34.779 --rc geninfo_unexecuted_blocks=1 00:13:34.779 00:13:34.779 ' 00:13:34.779 09:36:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:34.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:34.779 --rc genhtml_branch_coverage=1 00:13:34.779 --rc genhtml_function_coverage=1 00:13:34.779 --rc genhtml_legend=1 00:13:34.779 --rc geninfo_all_blocks=1 00:13:34.779 --rc geninfo_unexecuted_blocks=1 00:13:34.779 00:13:34.779 ' 00:13:34.779 09:36:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:34.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:34.779 --rc genhtml_branch_coverage=1 00:13:34.779 --rc genhtml_function_coverage=1 00:13:34.779 --rc genhtml_legend=1 00:13:34.779 --rc geninfo_all_blocks=1 00:13:34.779 --rc geninfo_unexecuted_blocks=1 00:13:34.779 00:13:34.779 ' 00:13:34.779 09:36:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:34.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:34.779 --rc genhtml_branch_coverage=1 00:13:34.779 --rc genhtml_function_coverage=1 00:13:34.779 --rc genhtml_legend=1 00:13:34.779 --rc geninfo_all_blocks=1 00:13:34.779 --rc geninfo_unexecuted_blocks=1 00:13:34.779 00:13:34.779 ' 00:13:34.780 09:36:57 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:34.780 09:36:57 -- nvmf/common.sh@7 -- # uname -s 00:13:34.780 09:36:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:34.780 09:36:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:34.780 09:36:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:34.780 09:36:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:34.780 09:36:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:34.780 09:36:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:34.780 09:36:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:34.780 09:36:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:34.780 09:36:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:34.780 09:36:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:34.780 09:36:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:34.780 09:36:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:34.780 09:36:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:34.780 09:36:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:34.780 09:36:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:34.780 09:36:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:34.780 09:36:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:34.780 09:36:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:34.780 09:36:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:34.780 09:36:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:34.780 09:36:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:34.780 09:36:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:34.780 09:36:57 -- paths/export.sh@5 -- # export PATH 00:13:34.780 09:36:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:34.780 09:36:57 -- nvmf/common.sh@46 -- # : 0 00:13:34.780 09:36:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:34.780 09:36:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:34.780 09:36:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:34.780 09:36:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:34.780 09:36:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:34.780 09:36:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:34.780 09:36:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:34.780 09:36:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:34.780 09:36:57 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:34.780 09:36:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:34.780 09:36:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:34.780 09:36:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:34.780 09:36:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:34.780 09:36:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:34.780 09:36:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:34.780 09:36:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:34.780 09:36:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:34.780 09:36:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:34.780 09:36:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:34.780 09:36:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:34.780 09:36:57 -- common/autotest_common.sh@10 -- # set +x 00:13:36.679 09:36:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:36.679 09:36:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:36.679 09:36:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:36.679 09:36:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:36.679 09:36:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:36.679 09:36:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:36.679 09:36:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:36.679 09:36:59 -- nvmf/common.sh@294 -- # net_devs=() 00:13:36.679 09:36:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:36.679 09:36:59 -- nvmf/common.sh@295 -- # e810=() 00:13:36.679 09:36:59 -- nvmf/common.sh@295 -- # local -ga e810 00:13:36.679 09:36:59 -- nvmf/common.sh@296 -- # x722=() 00:13:36.679 09:36:59 -- nvmf/common.sh@296 -- # local -ga x722 00:13:36.679 09:36:59 -- nvmf/common.sh@297 -- # mlx=() 00:13:36.679 09:36:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:36.679 09:36:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:36.679 09:36:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:36.679 09:36:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:36.679 09:36:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:36.679 09:36:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:36.679 09:36:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:36.679 09:36:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:36.679 09:36:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:36.679 09:36:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:36.679 09:36:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:36.679 09:36:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:36.679 09:36:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:36.679 09:36:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:36.679 09:36:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:36.679 09:36:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:36.679 09:36:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:36.679 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:36.679 09:36:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:36.679 09:36:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:36.679 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:36.679 09:36:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:36.679 09:36:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:36.679 09:36:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:36.679 09:36:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:36.679 09:36:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:36.679 09:36:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:36.679 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:36.679 09:36:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:36.679 09:36:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:36.679 09:36:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:36.679 09:36:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:36.679 09:36:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:36.679 09:36:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:36.679 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:36.679 09:36:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:36.679 09:36:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:36.679 09:36:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:36.679 09:36:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:36.679 09:36:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:36.679 09:36:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:36.680 09:36:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:36.680 09:36:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:36.680 09:36:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:36.680 09:36:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:36.680 09:36:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:36.680 09:36:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:36.680 09:36:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:36.680 09:36:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:36.680 09:36:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:36.680 09:36:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:36.680 09:36:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:36.680 09:36:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:36.938 09:36:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:36.938 09:36:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:36.938 09:36:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:36.938 09:36:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:36.938 09:36:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:36.938 09:36:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:36.938 09:36:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:36.938 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:36.938 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:13:36.938 00:13:36.938 --- 10.0.0.2 ping statistics --- 00:13:36.938 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:36.938 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:13:36.938 09:36:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:36.938 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:36.938 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:13:36.938 00:13:36.938 --- 10.0.0.1 ping statistics --- 00:13:36.938 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:36.938 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:13:36.938 09:36:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:36.938 09:36:59 -- nvmf/common.sh@410 -- # return 0 00:13:36.938 09:36:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:36.938 09:36:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:36.938 09:36:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:36.938 09:36:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:36.938 09:36:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:36.938 09:36:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:36.938 09:36:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:36.938 09:36:59 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:36.938 09:36:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:36.938 09:36:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:36.938 09:36:59 -- common/autotest_common.sh@10 -- # set +x 00:13:36.938 09:36:59 -- nvmf/common.sh@469 -- # nvmfpid=4187975 00:13:36.938 09:36:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:36.938 09:36:59 -- nvmf/common.sh@470 -- # waitforlisten 4187975 00:13:36.938 09:36:59 -- common/autotest_common.sh@829 -- # '[' -z 4187975 ']' 00:13:36.938 09:36:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:36.938 09:36:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:36.938 09:36:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:36.938 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:36.938 09:36:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:36.938 09:36:59 -- common/autotest_common.sh@10 -- # set +x 00:13:37.196 [2024-11-29 09:36:59.784810] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:37.196 [2024-11-29 09:36:59.784896] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:37.196 EAL: No free 2048 kB hugepages reported on node 1 00:13:37.196 [2024-11-29 09:36:59.851583] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:37.196 [2024-11-29 09:36:59.958918] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:37.196 [2024-11-29 09:36:59.959082] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:37.196 [2024-11-29 09:36:59.959098] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:37.196 [2024-11-29 09:36:59.959126] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:37.196 [2024-11-29 09:36:59.959155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:38.129 09:37:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:38.129 09:37:00 -- common/autotest_common.sh@862 -- # return 0 00:13:38.129 09:37:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:38.129 09:37:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:38.129 09:37:00 -- common/autotest_common.sh@10 -- # set +x 00:13:38.129 09:37:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:38.129 09:37:00 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:38.129 09:37:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.129 09:37:00 -- common/autotest_common.sh@10 -- # set +x 00:13:38.129 [2024-11-29 09:37:00.778916] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:38.130 09:37:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.130 09:37:00 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:38.130 09:37:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.130 09:37:00 -- common/autotest_common.sh@10 -- # set +x 00:13:38.130 09:37:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.130 09:37:00 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:38.130 09:37:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.130 09:37:00 -- common/autotest_common.sh@10 -- # set +x 00:13:38.130 [2024-11-29 09:37:00.795111] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:38.130 09:37:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.130 09:37:00 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:38.130 09:37:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.130 09:37:00 -- common/autotest_common.sh@10 -- # set +x 00:13:38.130 NULL1 00:13:38.130 09:37:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.130 09:37:00 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:38.130 09:37:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.130 09:37:00 -- common/autotest_common.sh@10 -- # set +x 00:13:38.130 09:37:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.130 09:37:00 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:38.130 09:37:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.130 09:37:00 -- common/autotest_common.sh@10 -- # set +x 00:13:38.130 09:37:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.130 09:37:00 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:38.130 [2024-11-29 09:37:00.840247] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:38.130 [2024-11-29 09:37:00.840288] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4188126 ] 00:13:38.130 EAL: No free 2048 kB hugepages reported on node 1 00:13:38.696 Attached to nqn.2016-06.io.spdk:cnode1 00:13:38.696 Namespace ID: 1 size: 1GB 00:13:38.696 fused_ordering(0) 00:13:38.696 fused_ordering(1) 00:13:38.696 fused_ordering(2) 00:13:38.696 fused_ordering(3) 00:13:38.696 fused_ordering(4) 00:13:38.696 fused_ordering(5) 00:13:38.696 fused_ordering(6) 00:13:38.696 fused_ordering(7) 00:13:38.696 fused_ordering(8) 00:13:38.696 fused_ordering(9) 00:13:38.696 fused_ordering(10) 00:13:38.696 fused_ordering(11) 00:13:38.696 fused_ordering(12) 00:13:38.696 fused_ordering(13) 00:13:38.696 fused_ordering(14) 00:13:38.696 fused_ordering(15) 00:13:38.696 fused_ordering(16) 00:13:38.696 fused_ordering(17) 00:13:38.696 fused_ordering(18) 00:13:38.696 fused_ordering(19) 00:13:38.696 fused_ordering(20) 00:13:38.696 fused_ordering(21) 00:13:38.696 fused_ordering(22) 00:13:38.696 fused_ordering(23) 00:13:38.696 fused_ordering(24) 00:13:38.696 fused_ordering(25) 00:13:38.696 fused_ordering(26) 00:13:38.696 fused_ordering(27) 00:13:38.696 fused_ordering(28) 00:13:38.696 fused_ordering(29) 00:13:38.696 fused_ordering(30) 00:13:38.696 fused_ordering(31) 00:13:38.696 fused_ordering(32) 00:13:38.696 fused_ordering(33) 00:13:38.696 fused_ordering(34) 00:13:38.696 fused_ordering(35) 00:13:38.696 fused_ordering(36) 00:13:38.696 fused_ordering(37) 00:13:38.696 fused_ordering(38) 00:13:38.696 fused_ordering(39) 00:13:38.696 fused_ordering(40) 00:13:38.696 fused_ordering(41) 00:13:38.696 fused_ordering(42) 00:13:38.696 fused_ordering(43) 00:13:38.696 fused_ordering(44) 00:13:38.696 fused_ordering(45) 00:13:38.696 fused_ordering(46) 00:13:38.696 fused_ordering(47) 00:13:38.696 fused_ordering(48) 00:13:38.696 fused_ordering(49) 00:13:38.696 fused_ordering(50) 00:13:38.696 fused_ordering(51) 00:13:38.696 fused_ordering(52) 00:13:38.696 fused_ordering(53) 00:13:38.696 fused_ordering(54) 00:13:38.696 fused_ordering(55) 00:13:38.696 fused_ordering(56) 00:13:38.696 fused_ordering(57) 00:13:38.696 fused_ordering(58) 00:13:38.696 fused_ordering(59) 00:13:38.696 fused_ordering(60) 00:13:38.696 fused_ordering(61) 00:13:38.696 fused_ordering(62) 00:13:38.696 fused_ordering(63) 00:13:38.696 fused_ordering(64) 00:13:38.696 fused_ordering(65) 00:13:38.696 fused_ordering(66) 00:13:38.696 fused_ordering(67) 00:13:38.696 fused_ordering(68) 00:13:38.696 fused_ordering(69) 00:13:38.696 fused_ordering(70) 00:13:38.696 fused_ordering(71) 00:13:38.696 fused_ordering(72) 00:13:38.696 fused_ordering(73) 00:13:38.696 fused_ordering(74) 00:13:38.696 fused_ordering(75) 00:13:38.696 fused_ordering(76) 00:13:38.696 fused_ordering(77) 00:13:38.696 fused_ordering(78) 00:13:38.696 fused_ordering(79) 00:13:38.696 fused_ordering(80) 00:13:38.696 fused_ordering(81) 00:13:38.696 fused_ordering(82) 00:13:38.696 fused_ordering(83) 00:13:38.696 fused_ordering(84) 00:13:38.696 fused_ordering(85) 00:13:38.696 fused_ordering(86) 00:13:38.696 fused_ordering(87) 00:13:38.696 fused_ordering(88) 00:13:38.696 fused_ordering(89) 00:13:38.696 fused_ordering(90) 00:13:38.696 fused_ordering(91) 00:13:38.696 fused_ordering(92) 00:13:38.696 fused_ordering(93) 00:13:38.696 fused_ordering(94) 00:13:38.696 fused_ordering(95) 00:13:38.696 fused_ordering(96) 00:13:38.696 fused_ordering(97) 00:13:38.696 fused_ordering(98) 00:13:38.696 fused_ordering(99) 00:13:38.696 fused_ordering(100) 00:13:38.696 fused_ordering(101) 00:13:38.696 fused_ordering(102) 00:13:38.696 fused_ordering(103) 00:13:38.696 fused_ordering(104) 00:13:38.696 fused_ordering(105) 00:13:38.696 fused_ordering(106) 00:13:38.696 fused_ordering(107) 00:13:38.696 fused_ordering(108) 00:13:38.696 fused_ordering(109) 00:13:38.696 fused_ordering(110) 00:13:38.696 fused_ordering(111) 00:13:38.696 fused_ordering(112) 00:13:38.696 fused_ordering(113) 00:13:38.696 fused_ordering(114) 00:13:38.696 fused_ordering(115) 00:13:38.696 fused_ordering(116) 00:13:38.696 fused_ordering(117) 00:13:38.696 fused_ordering(118) 00:13:38.696 fused_ordering(119) 00:13:38.696 fused_ordering(120) 00:13:38.696 fused_ordering(121) 00:13:38.696 fused_ordering(122) 00:13:38.696 fused_ordering(123) 00:13:38.696 fused_ordering(124) 00:13:38.696 fused_ordering(125) 00:13:38.696 fused_ordering(126) 00:13:38.696 fused_ordering(127) 00:13:38.696 fused_ordering(128) 00:13:38.696 fused_ordering(129) 00:13:38.696 fused_ordering(130) 00:13:38.696 fused_ordering(131) 00:13:38.696 fused_ordering(132) 00:13:38.696 fused_ordering(133) 00:13:38.696 fused_ordering(134) 00:13:38.696 fused_ordering(135) 00:13:38.696 fused_ordering(136) 00:13:38.696 fused_ordering(137) 00:13:38.696 fused_ordering(138) 00:13:38.696 fused_ordering(139) 00:13:38.696 fused_ordering(140) 00:13:38.696 fused_ordering(141) 00:13:38.696 fused_ordering(142) 00:13:38.696 fused_ordering(143) 00:13:38.696 fused_ordering(144) 00:13:38.696 fused_ordering(145) 00:13:38.696 fused_ordering(146) 00:13:38.696 fused_ordering(147) 00:13:38.696 fused_ordering(148) 00:13:38.696 fused_ordering(149) 00:13:38.696 fused_ordering(150) 00:13:38.696 fused_ordering(151) 00:13:38.696 fused_ordering(152) 00:13:38.696 fused_ordering(153) 00:13:38.696 fused_ordering(154) 00:13:38.696 fused_ordering(155) 00:13:38.696 fused_ordering(156) 00:13:38.696 fused_ordering(157) 00:13:38.696 fused_ordering(158) 00:13:38.696 fused_ordering(159) 00:13:38.696 fused_ordering(160) 00:13:38.696 fused_ordering(161) 00:13:38.696 fused_ordering(162) 00:13:38.696 fused_ordering(163) 00:13:38.696 fused_ordering(164) 00:13:38.696 fused_ordering(165) 00:13:38.696 fused_ordering(166) 00:13:38.696 fused_ordering(167) 00:13:38.696 fused_ordering(168) 00:13:38.696 fused_ordering(169) 00:13:38.696 fused_ordering(170) 00:13:38.696 fused_ordering(171) 00:13:38.696 fused_ordering(172) 00:13:38.696 fused_ordering(173) 00:13:38.696 fused_ordering(174) 00:13:38.696 fused_ordering(175) 00:13:38.696 fused_ordering(176) 00:13:38.696 fused_ordering(177) 00:13:38.696 fused_ordering(178) 00:13:38.696 fused_ordering(179) 00:13:38.696 fused_ordering(180) 00:13:38.696 fused_ordering(181) 00:13:38.696 fused_ordering(182) 00:13:38.696 fused_ordering(183) 00:13:38.696 fused_ordering(184) 00:13:38.696 fused_ordering(185) 00:13:38.696 fused_ordering(186) 00:13:38.696 fused_ordering(187) 00:13:38.696 fused_ordering(188) 00:13:38.696 fused_ordering(189) 00:13:38.696 fused_ordering(190) 00:13:38.696 fused_ordering(191) 00:13:38.696 fused_ordering(192) 00:13:38.696 fused_ordering(193) 00:13:38.696 fused_ordering(194) 00:13:38.696 fused_ordering(195) 00:13:38.696 fused_ordering(196) 00:13:38.696 fused_ordering(197) 00:13:38.696 fused_ordering(198) 00:13:38.696 fused_ordering(199) 00:13:38.696 fused_ordering(200) 00:13:38.696 fused_ordering(201) 00:13:38.696 fused_ordering(202) 00:13:38.696 fused_ordering(203) 00:13:38.697 fused_ordering(204) 00:13:38.697 fused_ordering(205) 00:13:38.955 fused_ordering(206) 00:13:38.955 fused_ordering(207) 00:13:38.955 fused_ordering(208) 00:13:38.955 fused_ordering(209) 00:13:38.955 fused_ordering(210) 00:13:38.955 fused_ordering(211) 00:13:38.955 fused_ordering(212) 00:13:38.955 fused_ordering(213) 00:13:38.955 fused_ordering(214) 00:13:38.955 fused_ordering(215) 00:13:38.955 fused_ordering(216) 00:13:38.955 fused_ordering(217) 00:13:38.955 fused_ordering(218) 00:13:38.955 fused_ordering(219) 00:13:38.955 fused_ordering(220) 00:13:38.955 fused_ordering(221) 00:13:38.955 fused_ordering(222) 00:13:38.955 fused_ordering(223) 00:13:38.955 fused_ordering(224) 00:13:38.955 fused_ordering(225) 00:13:38.955 fused_ordering(226) 00:13:38.955 fused_ordering(227) 00:13:38.955 fused_ordering(228) 00:13:38.955 fused_ordering(229) 00:13:38.955 fused_ordering(230) 00:13:38.955 fused_ordering(231) 00:13:38.955 fused_ordering(232) 00:13:38.955 fused_ordering(233) 00:13:38.955 fused_ordering(234) 00:13:38.955 fused_ordering(235) 00:13:38.955 fused_ordering(236) 00:13:38.955 fused_ordering(237) 00:13:38.955 fused_ordering(238) 00:13:38.955 fused_ordering(239) 00:13:38.955 fused_ordering(240) 00:13:38.955 fused_ordering(241) 00:13:38.955 fused_ordering(242) 00:13:38.955 fused_ordering(243) 00:13:38.955 fused_ordering(244) 00:13:38.955 fused_ordering(245) 00:13:38.955 fused_ordering(246) 00:13:38.955 fused_ordering(247) 00:13:38.955 fused_ordering(248) 00:13:38.955 fused_ordering(249) 00:13:38.955 fused_ordering(250) 00:13:38.955 fused_ordering(251) 00:13:38.955 fused_ordering(252) 00:13:38.955 fused_ordering(253) 00:13:38.955 fused_ordering(254) 00:13:38.955 fused_ordering(255) 00:13:38.955 fused_ordering(256) 00:13:38.955 fused_ordering(257) 00:13:38.955 fused_ordering(258) 00:13:38.955 fused_ordering(259) 00:13:38.955 fused_ordering(260) 00:13:38.955 fused_ordering(261) 00:13:38.955 fused_ordering(262) 00:13:38.955 fused_ordering(263) 00:13:38.955 fused_ordering(264) 00:13:38.955 fused_ordering(265) 00:13:38.955 fused_ordering(266) 00:13:38.955 fused_ordering(267) 00:13:38.955 fused_ordering(268) 00:13:38.955 fused_ordering(269) 00:13:38.955 fused_ordering(270) 00:13:38.955 fused_ordering(271) 00:13:38.955 fused_ordering(272) 00:13:38.955 fused_ordering(273) 00:13:38.955 fused_ordering(274) 00:13:38.955 fused_ordering(275) 00:13:38.955 fused_ordering(276) 00:13:38.955 fused_ordering(277) 00:13:38.955 fused_ordering(278) 00:13:38.955 fused_ordering(279) 00:13:38.955 fused_ordering(280) 00:13:38.955 fused_ordering(281) 00:13:38.955 fused_ordering(282) 00:13:38.955 fused_ordering(283) 00:13:38.955 fused_ordering(284) 00:13:38.955 fused_ordering(285) 00:13:38.955 fused_ordering(286) 00:13:38.955 fused_ordering(287) 00:13:38.955 fused_ordering(288) 00:13:38.955 fused_ordering(289) 00:13:38.955 fused_ordering(290) 00:13:38.955 fused_ordering(291) 00:13:38.955 fused_ordering(292) 00:13:38.955 fused_ordering(293) 00:13:38.955 fused_ordering(294) 00:13:38.955 fused_ordering(295) 00:13:38.955 fused_ordering(296) 00:13:38.955 fused_ordering(297) 00:13:38.955 fused_ordering(298) 00:13:38.955 fused_ordering(299) 00:13:38.955 fused_ordering(300) 00:13:38.955 fused_ordering(301) 00:13:38.955 fused_ordering(302) 00:13:38.955 fused_ordering(303) 00:13:38.955 fused_ordering(304) 00:13:38.955 fused_ordering(305) 00:13:38.955 fused_ordering(306) 00:13:38.955 fused_ordering(307) 00:13:38.955 fused_ordering(308) 00:13:38.955 fused_ordering(309) 00:13:38.955 fused_ordering(310) 00:13:38.955 fused_ordering(311) 00:13:38.955 fused_ordering(312) 00:13:38.955 fused_ordering(313) 00:13:38.955 fused_ordering(314) 00:13:38.955 fused_ordering(315) 00:13:38.955 fused_ordering(316) 00:13:38.955 fused_ordering(317) 00:13:38.955 fused_ordering(318) 00:13:38.955 fused_ordering(319) 00:13:38.955 fused_ordering(320) 00:13:38.955 fused_ordering(321) 00:13:38.955 fused_ordering(322) 00:13:38.955 fused_ordering(323) 00:13:38.955 fused_ordering(324) 00:13:38.955 fused_ordering(325) 00:13:38.955 fused_ordering(326) 00:13:38.955 fused_ordering(327) 00:13:38.955 fused_ordering(328) 00:13:38.955 fused_ordering(329) 00:13:38.955 fused_ordering(330) 00:13:38.955 fused_ordering(331) 00:13:38.955 fused_ordering(332) 00:13:38.955 fused_ordering(333) 00:13:38.955 fused_ordering(334) 00:13:38.955 fused_ordering(335) 00:13:38.955 fused_ordering(336) 00:13:38.955 fused_ordering(337) 00:13:38.955 fused_ordering(338) 00:13:38.955 fused_ordering(339) 00:13:38.955 fused_ordering(340) 00:13:38.955 fused_ordering(341) 00:13:38.955 fused_ordering(342) 00:13:38.955 fused_ordering(343) 00:13:38.955 fused_ordering(344) 00:13:38.955 fused_ordering(345) 00:13:38.955 fused_ordering(346) 00:13:38.955 fused_ordering(347) 00:13:38.955 fused_ordering(348) 00:13:38.955 fused_ordering(349) 00:13:38.955 fused_ordering(350) 00:13:38.955 fused_ordering(351) 00:13:38.955 fused_ordering(352) 00:13:38.955 fused_ordering(353) 00:13:38.955 fused_ordering(354) 00:13:38.955 fused_ordering(355) 00:13:38.955 fused_ordering(356) 00:13:38.955 fused_ordering(357) 00:13:38.955 fused_ordering(358) 00:13:38.955 fused_ordering(359) 00:13:38.955 fused_ordering(360) 00:13:38.955 fused_ordering(361) 00:13:38.955 fused_ordering(362) 00:13:38.955 fused_ordering(363) 00:13:38.955 fused_ordering(364) 00:13:38.955 fused_ordering(365) 00:13:38.955 fused_ordering(366) 00:13:38.955 fused_ordering(367) 00:13:38.955 fused_ordering(368) 00:13:38.955 fused_ordering(369) 00:13:38.955 fused_ordering(370) 00:13:38.955 fused_ordering(371) 00:13:38.955 fused_ordering(372) 00:13:38.955 fused_ordering(373) 00:13:38.955 fused_ordering(374) 00:13:38.955 fused_ordering(375) 00:13:38.955 fused_ordering(376) 00:13:38.955 fused_ordering(377) 00:13:38.955 fused_ordering(378) 00:13:38.955 fused_ordering(379) 00:13:38.955 fused_ordering(380) 00:13:38.955 fused_ordering(381) 00:13:38.955 fused_ordering(382) 00:13:38.955 fused_ordering(383) 00:13:38.955 fused_ordering(384) 00:13:38.955 fused_ordering(385) 00:13:38.955 fused_ordering(386) 00:13:38.955 fused_ordering(387) 00:13:38.955 fused_ordering(388) 00:13:38.955 fused_ordering(389) 00:13:38.955 fused_ordering(390) 00:13:38.955 fused_ordering(391) 00:13:38.955 fused_ordering(392) 00:13:38.955 fused_ordering(393) 00:13:38.955 fused_ordering(394) 00:13:38.955 fused_ordering(395) 00:13:38.955 fused_ordering(396) 00:13:38.955 fused_ordering(397) 00:13:38.955 fused_ordering(398) 00:13:38.955 fused_ordering(399) 00:13:38.955 fused_ordering(400) 00:13:38.955 fused_ordering(401) 00:13:38.955 fused_ordering(402) 00:13:38.955 fused_ordering(403) 00:13:38.955 fused_ordering(404) 00:13:38.955 fused_ordering(405) 00:13:38.955 fused_ordering(406) 00:13:38.955 fused_ordering(407) 00:13:38.955 fused_ordering(408) 00:13:38.955 fused_ordering(409) 00:13:38.955 fused_ordering(410) 00:13:39.521 fused_ordering(411) 00:13:39.521 fused_ordering(412) 00:13:39.521 fused_ordering(413) 00:13:39.521 fused_ordering(414) 00:13:39.521 fused_ordering(415) 00:13:39.521 fused_ordering(416) 00:13:39.521 fused_ordering(417) 00:13:39.521 fused_ordering(418) 00:13:39.521 fused_ordering(419) 00:13:39.521 fused_ordering(420) 00:13:39.521 fused_ordering(421) 00:13:39.521 fused_ordering(422) 00:13:39.521 fused_ordering(423) 00:13:39.521 fused_ordering(424) 00:13:39.521 fused_ordering(425) 00:13:39.521 fused_ordering(426) 00:13:39.521 fused_ordering(427) 00:13:39.521 fused_ordering(428) 00:13:39.521 fused_ordering(429) 00:13:39.521 fused_ordering(430) 00:13:39.521 fused_ordering(431) 00:13:39.521 fused_ordering(432) 00:13:39.521 fused_ordering(433) 00:13:39.521 fused_ordering(434) 00:13:39.521 fused_ordering(435) 00:13:39.521 fused_ordering(436) 00:13:39.521 fused_ordering(437) 00:13:39.521 fused_ordering(438) 00:13:39.521 fused_ordering(439) 00:13:39.521 fused_ordering(440) 00:13:39.521 fused_ordering(441) 00:13:39.521 fused_ordering(442) 00:13:39.521 fused_ordering(443) 00:13:39.521 fused_ordering(444) 00:13:39.521 fused_ordering(445) 00:13:39.521 fused_ordering(446) 00:13:39.521 fused_ordering(447) 00:13:39.521 fused_ordering(448) 00:13:39.521 fused_ordering(449) 00:13:39.521 fused_ordering(450) 00:13:39.521 fused_ordering(451) 00:13:39.521 fused_ordering(452) 00:13:39.521 fused_ordering(453) 00:13:39.521 fused_ordering(454) 00:13:39.521 fused_ordering(455) 00:13:39.521 fused_ordering(456) 00:13:39.521 fused_ordering(457) 00:13:39.521 fused_ordering(458) 00:13:39.521 fused_ordering(459) 00:13:39.521 fused_ordering(460) 00:13:39.521 fused_ordering(461) 00:13:39.521 fused_ordering(462) 00:13:39.521 fused_ordering(463) 00:13:39.521 fused_ordering(464) 00:13:39.521 fused_ordering(465) 00:13:39.521 fused_ordering(466) 00:13:39.521 fused_ordering(467) 00:13:39.521 fused_ordering(468) 00:13:39.521 fused_ordering(469) 00:13:39.521 fused_ordering(470) 00:13:39.521 fused_ordering(471) 00:13:39.521 fused_ordering(472) 00:13:39.521 fused_ordering(473) 00:13:39.521 fused_ordering(474) 00:13:39.521 fused_ordering(475) 00:13:39.521 fused_ordering(476) 00:13:39.521 fused_ordering(477) 00:13:39.521 fused_ordering(478) 00:13:39.521 fused_ordering(479) 00:13:39.521 fused_ordering(480) 00:13:39.521 fused_ordering(481) 00:13:39.521 fused_ordering(482) 00:13:39.521 fused_ordering(483) 00:13:39.521 fused_ordering(484) 00:13:39.521 fused_ordering(485) 00:13:39.521 fused_ordering(486) 00:13:39.521 fused_ordering(487) 00:13:39.521 fused_ordering(488) 00:13:39.521 fused_ordering(489) 00:13:39.521 fused_ordering(490) 00:13:39.521 fused_ordering(491) 00:13:39.521 fused_ordering(492) 00:13:39.521 fused_ordering(493) 00:13:39.521 fused_ordering(494) 00:13:39.521 fused_ordering(495) 00:13:39.521 fused_ordering(496) 00:13:39.521 fused_ordering(497) 00:13:39.521 fused_ordering(498) 00:13:39.521 fused_ordering(499) 00:13:39.521 fused_ordering(500) 00:13:39.521 fused_ordering(501) 00:13:39.521 fused_ordering(502) 00:13:39.521 fused_ordering(503) 00:13:39.521 fused_ordering(504) 00:13:39.521 fused_ordering(505) 00:13:39.521 fused_ordering(506) 00:13:39.521 fused_ordering(507) 00:13:39.521 fused_ordering(508) 00:13:39.521 fused_ordering(509) 00:13:39.521 fused_ordering(510) 00:13:39.521 fused_ordering(511) 00:13:39.521 fused_ordering(512) 00:13:39.521 fused_ordering(513) 00:13:39.521 fused_ordering(514) 00:13:39.521 fused_ordering(515) 00:13:39.521 fused_ordering(516) 00:13:39.521 fused_ordering(517) 00:13:39.521 fused_ordering(518) 00:13:39.521 fused_ordering(519) 00:13:39.521 fused_ordering(520) 00:13:39.521 fused_ordering(521) 00:13:39.521 fused_ordering(522) 00:13:39.521 fused_ordering(523) 00:13:39.521 fused_ordering(524) 00:13:39.521 fused_ordering(525) 00:13:39.521 fused_ordering(526) 00:13:39.521 fused_ordering(527) 00:13:39.521 fused_ordering(528) 00:13:39.521 fused_ordering(529) 00:13:39.521 fused_ordering(530) 00:13:39.521 fused_ordering(531) 00:13:39.521 fused_ordering(532) 00:13:39.521 fused_ordering(533) 00:13:39.521 fused_ordering(534) 00:13:39.521 fused_ordering(535) 00:13:39.521 fused_ordering(536) 00:13:39.521 fused_ordering(537) 00:13:39.521 fused_ordering(538) 00:13:39.521 fused_ordering(539) 00:13:39.521 fused_ordering(540) 00:13:39.521 fused_ordering(541) 00:13:39.521 fused_ordering(542) 00:13:39.521 fused_ordering(543) 00:13:39.521 fused_ordering(544) 00:13:39.521 fused_ordering(545) 00:13:39.521 fused_ordering(546) 00:13:39.521 fused_ordering(547) 00:13:39.521 fused_ordering(548) 00:13:39.521 fused_ordering(549) 00:13:39.521 fused_ordering(550) 00:13:39.521 fused_ordering(551) 00:13:39.521 fused_ordering(552) 00:13:39.521 fused_ordering(553) 00:13:39.521 fused_ordering(554) 00:13:39.521 fused_ordering(555) 00:13:39.521 fused_ordering(556) 00:13:39.521 fused_ordering(557) 00:13:39.521 fused_ordering(558) 00:13:39.521 fused_ordering(559) 00:13:39.521 fused_ordering(560) 00:13:39.521 fused_ordering(561) 00:13:39.521 fused_ordering(562) 00:13:39.521 fused_ordering(563) 00:13:39.521 fused_ordering(564) 00:13:39.521 fused_ordering(565) 00:13:39.521 fused_ordering(566) 00:13:39.521 fused_ordering(567) 00:13:39.521 fused_ordering(568) 00:13:39.521 fused_ordering(569) 00:13:39.521 fused_ordering(570) 00:13:39.522 fused_ordering(571) 00:13:39.522 fused_ordering(572) 00:13:39.522 fused_ordering(573) 00:13:39.522 fused_ordering(574) 00:13:39.522 fused_ordering(575) 00:13:39.522 fused_ordering(576) 00:13:39.522 fused_ordering(577) 00:13:39.522 fused_ordering(578) 00:13:39.522 fused_ordering(579) 00:13:39.522 fused_ordering(580) 00:13:39.522 fused_ordering(581) 00:13:39.522 fused_ordering(582) 00:13:39.522 fused_ordering(583) 00:13:39.522 fused_ordering(584) 00:13:39.522 fused_ordering(585) 00:13:39.522 fused_ordering(586) 00:13:39.522 fused_ordering(587) 00:13:39.522 fused_ordering(588) 00:13:39.522 fused_ordering(589) 00:13:39.522 fused_ordering(590) 00:13:39.522 fused_ordering(591) 00:13:39.522 fused_ordering(592) 00:13:39.522 fused_ordering(593) 00:13:39.522 fused_ordering(594) 00:13:39.522 fused_ordering(595) 00:13:39.522 fused_ordering(596) 00:13:39.522 fused_ordering(597) 00:13:39.522 fused_ordering(598) 00:13:39.522 fused_ordering(599) 00:13:39.522 fused_ordering(600) 00:13:39.522 fused_ordering(601) 00:13:39.522 fused_ordering(602) 00:13:39.522 fused_ordering(603) 00:13:39.522 fused_ordering(604) 00:13:39.522 fused_ordering(605) 00:13:39.522 fused_ordering(606) 00:13:39.522 fused_ordering(607) 00:13:39.522 fused_ordering(608) 00:13:39.522 fused_ordering(609) 00:13:39.522 fused_ordering(610) 00:13:39.522 fused_ordering(611) 00:13:39.522 fused_ordering(612) 00:13:39.522 fused_ordering(613) 00:13:39.522 fused_ordering(614) 00:13:39.522 fused_ordering(615) 00:13:40.088 fused_ordering(616) 00:13:40.088 fused_ordering(617) 00:13:40.088 fused_ordering(618) 00:13:40.088 fused_ordering(619) 00:13:40.088 fused_ordering(620) 00:13:40.088 fused_ordering(621) 00:13:40.088 fused_ordering(622) 00:13:40.088 fused_ordering(623) 00:13:40.088 fused_ordering(624) 00:13:40.088 fused_ordering(625) 00:13:40.088 fused_ordering(626) 00:13:40.088 fused_ordering(627) 00:13:40.088 fused_ordering(628) 00:13:40.088 fused_ordering(629) 00:13:40.088 fused_ordering(630) 00:13:40.088 fused_ordering(631) 00:13:40.088 fused_ordering(632) 00:13:40.088 fused_ordering(633) 00:13:40.088 fused_ordering(634) 00:13:40.088 fused_ordering(635) 00:13:40.088 fused_ordering(636) 00:13:40.088 fused_ordering(637) 00:13:40.088 fused_ordering(638) 00:13:40.088 fused_ordering(639) 00:13:40.088 fused_ordering(640) 00:13:40.088 fused_ordering(641) 00:13:40.088 fused_ordering(642) 00:13:40.088 fused_ordering(643) 00:13:40.088 fused_ordering(644) 00:13:40.088 fused_ordering(645) 00:13:40.088 fused_ordering(646) 00:13:40.088 fused_ordering(647) 00:13:40.088 fused_ordering(648) 00:13:40.088 fused_ordering(649) 00:13:40.088 fused_ordering(650) 00:13:40.088 fused_ordering(651) 00:13:40.088 fused_ordering(652) 00:13:40.088 fused_ordering(653) 00:13:40.088 fused_ordering(654) 00:13:40.088 fused_ordering(655) 00:13:40.088 fused_ordering(656) 00:13:40.088 fused_ordering(657) 00:13:40.088 fused_ordering(658) 00:13:40.088 fused_ordering(659) 00:13:40.088 fused_ordering(660) 00:13:40.088 fused_ordering(661) 00:13:40.088 fused_ordering(662) 00:13:40.088 fused_ordering(663) 00:13:40.088 fused_ordering(664) 00:13:40.088 fused_ordering(665) 00:13:40.088 fused_ordering(666) 00:13:40.088 fused_ordering(667) 00:13:40.088 fused_ordering(668) 00:13:40.088 fused_ordering(669) 00:13:40.088 fused_ordering(670) 00:13:40.088 fused_ordering(671) 00:13:40.088 fused_ordering(672) 00:13:40.088 fused_ordering(673) 00:13:40.088 fused_ordering(674) 00:13:40.088 fused_ordering(675) 00:13:40.088 fused_ordering(676) 00:13:40.088 fused_ordering(677) 00:13:40.088 fused_ordering(678) 00:13:40.088 fused_ordering(679) 00:13:40.088 fused_ordering(680) 00:13:40.088 fused_ordering(681) 00:13:40.088 fused_ordering(682) 00:13:40.088 fused_ordering(683) 00:13:40.088 fused_ordering(684) 00:13:40.088 fused_ordering(685) 00:13:40.088 fused_ordering(686) 00:13:40.088 fused_ordering(687) 00:13:40.088 fused_ordering(688) 00:13:40.088 fused_ordering(689) 00:13:40.088 fused_ordering(690) 00:13:40.088 fused_ordering(691) 00:13:40.088 fused_ordering(692) 00:13:40.088 fused_ordering(693) 00:13:40.088 fused_ordering(694) 00:13:40.088 fused_ordering(695) 00:13:40.088 fused_ordering(696) 00:13:40.088 fused_ordering(697) 00:13:40.088 fused_ordering(698) 00:13:40.088 fused_ordering(699) 00:13:40.088 fused_ordering(700) 00:13:40.088 fused_ordering(701) 00:13:40.088 fused_ordering(702) 00:13:40.088 fused_ordering(703) 00:13:40.088 fused_ordering(704) 00:13:40.088 fused_ordering(705) 00:13:40.088 fused_ordering(706) 00:13:40.088 fused_ordering(707) 00:13:40.088 fused_ordering(708) 00:13:40.088 fused_ordering(709) 00:13:40.088 fused_ordering(710) 00:13:40.088 fused_ordering(711) 00:13:40.088 fused_ordering(712) 00:13:40.088 fused_ordering(713) 00:13:40.088 fused_ordering(714) 00:13:40.088 fused_ordering(715) 00:13:40.088 fused_ordering(716) 00:13:40.088 fused_ordering(717) 00:13:40.088 fused_ordering(718) 00:13:40.088 fused_ordering(719) 00:13:40.088 fused_ordering(720) 00:13:40.088 fused_ordering(721) 00:13:40.088 fused_ordering(722) 00:13:40.088 fused_ordering(723) 00:13:40.088 fused_ordering(724) 00:13:40.088 fused_ordering(725) 00:13:40.088 fused_ordering(726) 00:13:40.088 fused_ordering(727) 00:13:40.088 fused_ordering(728) 00:13:40.088 fused_ordering(729) 00:13:40.088 fused_ordering(730) 00:13:40.089 fused_ordering(731) 00:13:40.089 fused_ordering(732) 00:13:40.089 fused_ordering(733) 00:13:40.089 fused_ordering(734) 00:13:40.089 fused_ordering(735) 00:13:40.089 fused_ordering(736) 00:13:40.089 fused_ordering(737) 00:13:40.089 fused_ordering(738) 00:13:40.089 fused_ordering(739) 00:13:40.089 fused_ordering(740) 00:13:40.089 fused_ordering(741) 00:13:40.089 fused_ordering(742) 00:13:40.089 fused_ordering(743) 00:13:40.089 fused_ordering(744) 00:13:40.089 fused_ordering(745) 00:13:40.089 fused_ordering(746) 00:13:40.089 fused_ordering(747) 00:13:40.089 fused_ordering(748) 00:13:40.089 fused_ordering(749) 00:13:40.089 fused_ordering(750) 00:13:40.089 fused_ordering(751) 00:13:40.089 fused_ordering(752) 00:13:40.089 fused_ordering(753) 00:13:40.089 fused_ordering(754) 00:13:40.089 fused_ordering(755) 00:13:40.089 fused_ordering(756) 00:13:40.089 fused_ordering(757) 00:13:40.089 fused_ordering(758) 00:13:40.089 fused_ordering(759) 00:13:40.089 fused_ordering(760) 00:13:40.089 fused_ordering(761) 00:13:40.089 fused_ordering(762) 00:13:40.089 fused_ordering(763) 00:13:40.089 fused_ordering(764) 00:13:40.089 fused_ordering(765) 00:13:40.089 fused_ordering(766) 00:13:40.089 fused_ordering(767) 00:13:40.089 fused_ordering(768) 00:13:40.089 fused_ordering(769) 00:13:40.089 fused_ordering(770) 00:13:40.089 fused_ordering(771) 00:13:40.089 fused_ordering(772) 00:13:40.089 fused_ordering(773) 00:13:40.089 fused_ordering(774) 00:13:40.089 fused_ordering(775) 00:13:40.089 fused_ordering(776) 00:13:40.089 fused_ordering(777) 00:13:40.089 fused_ordering(778) 00:13:40.089 fused_ordering(779) 00:13:40.089 fused_ordering(780) 00:13:40.089 fused_ordering(781) 00:13:40.089 fused_ordering(782) 00:13:40.089 fused_ordering(783) 00:13:40.089 fused_ordering(784) 00:13:40.089 fused_ordering(785) 00:13:40.089 fused_ordering(786) 00:13:40.089 fused_ordering(787) 00:13:40.089 fused_ordering(788) 00:13:40.089 fused_ordering(789) 00:13:40.089 fused_ordering(790) 00:13:40.089 fused_ordering(791) 00:13:40.089 fused_ordering(792) 00:13:40.089 fused_ordering(793) 00:13:40.089 fused_ordering(794) 00:13:40.089 fused_ordering(795) 00:13:40.089 fused_ordering(796) 00:13:40.089 fused_ordering(797) 00:13:40.089 fused_ordering(798) 00:13:40.089 fused_ordering(799) 00:13:40.089 fused_ordering(800) 00:13:40.089 fused_ordering(801) 00:13:40.089 fused_ordering(802) 00:13:40.089 fused_ordering(803) 00:13:40.089 fused_ordering(804) 00:13:40.089 fused_ordering(805) 00:13:40.089 fused_ordering(806) 00:13:40.089 fused_ordering(807) 00:13:40.089 fused_ordering(808) 00:13:40.089 fused_ordering(809) 00:13:40.089 fused_ordering(810) 00:13:40.089 fused_ordering(811) 00:13:40.089 fused_ordering(812) 00:13:40.089 fused_ordering(813) 00:13:40.089 fused_ordering(814) 00:13:40.089 fused_ordering(815) 00:13:40.089 fused_ordering(816) 00:13:40.089 fused_ordering(817) 00:13:40.089 fused_ordering(818) 00:13:40.089 fused_ordering(819) 00:13:40.089 fused_ordering(820) 00:13:40.656 fused_ordering(821) 00:13:40.656 fused_ordering(822) 00:13:40.656 fused_ordering(823) 00:13:40.656 fused_ordering(824) 00:13:40.656 fused_ordering(825) 00:13:40.656 fused_ordering(826) 00:13:40.656 fused_ordering(827) 00:13:40.656 fused_ordering(828) 00:13:40.656 fused_ordering(829) 00:13:40.656 fused_ordering(830) 00:13:40.656 fused_ordering(831) 00:13:40.656 fused_ordering(832) 00:13:40.656 fused_ordering(833) 00:13:40.656 fused_ordering(834) 00:13:40.656 fused_ordering(835) 00:13:40.656 fused_ordering(836) 00:13:40.656 fused_ordering(837) 00:13:40.656 fused_ordering(838) 00:13:40.656 fused_ordering(839) 00:13:40.656 fused_ordering(840) 00:13:40.656 fused_ordering(841) 00:13:40.656 fused_ordering(842) 00:13:40.656 fused_ordering(843) 00:13:40.656 fused_ordering(844) 00:13:40.656 fused_ordering(845) 00:13:40.656 fused_ordering(846) 00:13:40.656 fused_ordering(847) 00:13:40.656 fused_ordering(848) 00:13:40.656 fused_ordering(849) 00:13:40.656 fused_ordering(850) 00:13:40.656 fused_ordering(851) 00:13:40.656 fused_ordering(852) 00:13:40.656 fused_ordering(853) 00:13:40.656 fused_ordering(854) 00:13:40.656 fused_ordering(855) 00:13:40.656 fused_ordering(856) 00:13:40.656 fused_ordering(857) 00:13:40.656 fused_ordering(858) 00:13:40.656 fused_ordering(859) 00:13:40.656 fused_ordering(860) 00:13:40.656 fused_ordering(861) 00:13:40.656 fused_ordering(862) 00:13:40.656 fused_ordering(863) 00:13:40.656 fused_ordering(864) 00:13:40.656 fused_ordering(865) 00:13:40.656 fused_ordering(866) 00:13:40.656 fused_ordering(867) 00:13:40.656 fused_ordering(868) 00:13:40.656 fused_ordering(869) 00:13:40.656 fused_ordering(870) 00:13:40.656 fused_ordering(871) 00:13:40.656 fused_ordering(872) 00:13:40.656 fused_ordering(873) 00:13:40.656 fused_ordering(874) 00:13:40.656 fused_ordering(875) 00:13:40.656 fused_ordering(876) 00:13:40.656 fused_ordering(877) 00:13:40.656 fused_ordering(878) 00:13:40.656 fused_ordering(879) 00:13:40.656 fused_ordering(880) 00:13:40.656 fused_ordering(881) 00:13:40.656 fused_ordering(882) 00:13:40.656 fused_ordering(883) 00:13:40.656 fused_ordering(884) 00:13:40.656 fused_ordering(885) 00:13:40.656 fused_ordering(886) 00:13:40.656 fused_ordering(887) 00:13:40.656 fused_ordering(888) 00:13:40.656 fused_ordering(889) 00:13:40.656 fused_ordering(890) 00:13:40.656 fused_ordering(891) 00:13:40.656 fused_ordering(892) 00:13:40.656 fused_ordering(893) 00:13:40.656 fused_ordering(894) 00:13:40.656 fused_ordering(895) 00:13:40.656 fused_ordering(896) 00:13:40.656 fused_ordering(897) 00:13:40.656 fused_ordering(898) 00:13:40.656 fused_ordering(899) 00:13:40.656 fused_ordering(900) 00:13:40.656 fused_ordering(901) 00:13:40.656 fused_ordering(902) 00:13:40.656 fused_ordering(903) 00:13:40.656 fused_ordering(904) 00:13:40.656 fused_ordering(905) 00:13:40.656 fused_ordering(906) 00:13:40.656 fused_ordering(907) 00:13:40.656 fused_ordering(908) 00:13:40.656 fused_ordering(909) 00:13:40.656 fused_ordering(910) 00:13:40.656 fused_ordering(911) 00:13:40.657 fused_ordering(912) 00:13:40.657 fused_ordering(913) 00:13:40.657 fused_ordering(914) 00:13:40.657 fused_ordering(915) 00:13:40.657 fused_ordering(916) 00:13:40.657 fused_ordering(917) 00:13:40.657 fused_ordering(918) 00:13:40.657 fused_ordering(919) 00:13:40.657 fused_ordering(920) 00:13:40.657 fused_ordering(921) 00:13:40.657 fused_ordering(922) 00:13:40.657 fused_ordering(923) 00:13:40.657 fused_ordering(924) 00:13:40.657 fused_ordering(925) 00:13:40.657 fused_ordering(926) 00:13:40.657 fused_ordering(927) 00:13:40.657 fused_ordering(928) 00:13:40.657 fused_ordering(929) 00:13:40.657 fused_ordering(930) 00:13:40.657 fused_ordering(931) 00:13:40.657 fused_ordering(932) 00:13:40.657 fused_ordering(933) 00:13:40.657 fused_ordering(934) 00:13:40.657 fused_ordering(935) 00:13:40.657 fused_ordering(936) 00:13:40.657 fused_ordering(937) 00:13:40.657 fused_ordering(938) 00:13:40.657 fused_ordering(939) 00:13:40.657 fused_ordering(940) 00:13:40.657 fused_ordering(941) 00:13:40.657 fused_ordering(942) 00:13:40.657 fused_ordering(943) 00:13:40.657 fused_ordering(944) 00:13:40.657 fused_ordering(945) 00:13:40.657 fused_ordering(946) 00:13:40.657 fused_ordering(947) 00:13:40.657 fused_ordering(948) 00:13:40.657 fused_ordering(949) 00:13:40.657 fused_ordering(950) 00:13:40.657 fused_ordering(951) 00:13:40.657 fused_ordering(952) 00:13:40.657 fused_ordering(953) 00:13:40.657 fused_ordering(954) 00:13:40.657 fused_ordering(955) 00:13:40.657 fused_ordering(956) 00:13:40.657 fused_ordering(957) 00:13:40.657 fused_ordering(958) 00:13:40.657 fused_ordering(959) 00:13:40.657 fused_ordering(960) 00:13:40.657 fused_ordering(961) 00:13:40.657 fused_ordering(962) 00:13:40.657 fused_ordering(963) 00:13:40.657 fused_ordering(964) 00:13:40.657 fused_ordering(965) 00:13:40.657 fused_ordering(966) 00:13:40.657 fused_ordering(967) 00:13:40.657 fused_ordering(968) 00:13:40.657 fused_ordering(969) 00:13:40.657 fused_ordering(970) 00:13:40.657 fused_ordering(971) 00:13:40.657 fused_ordering(972) 00:13:40.657 fused_ordering(973) 00:13:40.657 fused_ordering(974) 00:13:40.657 fused_ordering(975) 00:13:40.657 fused_ordering(976) 00:13:40.657 fused_ordering(977) 00:13:40.657 fused_ordering(978) 00:13:40.657 fused_ordering(979) 00:13:40.657 fused_ordering(980) 00:13:40.657 fused_ordering(981) 00:13:40.657 fused_ordering(982) 00:13:40.657 fused_ordering(983) 00:13:40.657 fused_ordering(984) 00:13:40.657 fused_ordering(985) 00:13:40.657 fused_ordering(986) 00:13:40.657 fused_ordering(987) 00:13:40.657 fused_ordering(988) 00:13:40.657 fused_ordering(989) 00:13:40.657 fused_ordering(990) 00:13:40.657 fused_ordering(991) 00:13:40.657 fused_ordering(992) 00:13:40.657 fused_ordering(993) 00:13:40.657 fused_ordering(994) 00:13:40.657 fused_ordering(995) 00:13:40.657 fused_ordering(996) 00:13:40.657 fused_ordering(997) 00:13:40.657 fused_ordering(998) 00:13:40.657 fused_ordering(999) 00:13:40.657 fused_ordering(1000) 00:13:40.657 fused_ordering(1001) 00:13:40.657 fused_ordering(1002) 00:13:40.657 fused_ordering(1003) 00:13:40.657 fused_ordering(1004) 00:13:40.657 fused_ordering(1005) 00:13:40.657 fused_ordering(1006) 00:13:40.657 fused_ordering(1007) 00:13:40.657 fused_ordering(1008) 00:13:40.657 fused_ordering(1009) 00:13:40.657 fused_ordering(1010) 00:13:40.657 fused_ordering(1011) 00:13:40.657 fused_ordering(1012) 00:13:40.657 fused_ordering(1013) 00:13:40.657 fused_ordering(1014) 00:13:40.657 fused_ordering(1015) 00:13:40.657 fused_ordering(1016) 00:13:40.657 fused_ordering(1017) 00:13:40.657 fused_ordering(1018) 00:13:40.657 fused_ordering(1019) 00:13:40.657 fused_ordering(1020) 00:13:40.657 fused_ordering(1021) 00:13:40.657 fused_ordering(1022) 00:13:40.657 fused_ordering(1023) 00:13:40.657 09:37:03 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:40.657 09:37:03 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:40.657 09:37:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:40.657 09:37:03 -- nvmf/common.sh@116 -- # sync 00:13:40.657 09:37:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:40.657 09:37:03 -- nvmf/common.sh@119 -- # set +e 00:13:40.657 09:37:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:40.657 09:37:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:40.657 rmmod nvme_tcp 00:13:40.657 rmmod nvme_fabrics 00:13:40.657 rmmod nvme_keyring 00:13:40.657 09:37:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:40.657 09:37:03 -- nvmf/common.sh@123 -- # set -e 00:13:40.657 09:37:03 -- nvmf/common.sh@124 -- # return 0 00:13:40.657 09:37:03 -- nvmf/common.sh@477 -- # '[' -n 4187975 ']' 00:13:40.657 09:37:03 -- nvmf/common.sh@478 -- # killprocess 4187975 00:13:40.657 09:37:03 -- common/autotest_common.sh@936 -- # '[' -z 4187975 ']' 00:13:40.657 09:37:03 -- common/autotest_common.sh@940 -- # kill -0 4187975 00:13:40.657 09:37:03 -- common/autotest_common.sh@941 -- # uname 00:13:40.657 09:37:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:40.657 09:37:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4187975 00:13:40.657 09:37:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:40.657 09:37:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:40.657 09:37:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4187975' 00:13:40.657 killing process with pid 4187975 00:13:40.657 09:37:03 -- common/autotest_common.sh@955 -- # kill 4187975 00:13:40.657 09:37:03 -- common/autotest_common.sh@960 -- # wait 4187975 00:13:40.916 09:37:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:40.916 09:37:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:40.916 09:37:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:40.916 09:37:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:40.916 09:37:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:40.916 09:37:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:40.916 09:37:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:40.916 09:37:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:43.459 09:37:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:43.459 00:13:43.459 real 0m8.464s 00:13:43.459 user 0m6.179s 00:13:43.459 sys 0m3.267s 00:13:43.459 09:37:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:43.459 09:37:05 -- common/autotest_common.sh@10 -- # set +x 00:13:43.459 ************************************ 00:13:43.459 END TEST nvmf_fused_ordering 00:13:43.459 ************************************ 00:13:43.459 09:37:05 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:43.459 09:37:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:43.459 09:37:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:43.459 09:37:05 -- common/autotest_common.sh@10 -- # set +x 00:13:43.459 ************************************ 00:13:43.459 START TEST nvmf_delete_subsystem 00:13:43.459 ************************************ 00:13:43.459 09:37:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:43.459 * Looking for test storage... 00:13:43.459 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:43.459 09:37:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:43.459 09:37:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:43.459 09:37:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:43.459 09:37:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:43.459 09:37:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:43.459 09:37:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:43.459 09:37:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:43.459 09:37:05 -- scripts/common.sh@335 -- # IFS=.-: 00:13:43.459 09:37:05 -- scripts/common.sh@335 -- # read -ra ver1 00:13:43.459 09:37:05 -- scripts/common.sh@336 -- # IFS=.-: 00:13:43.459 09:37:05 -- scripts/common.sh@336 -- # read -ra ver2 00:13:43.459 09:37:05 -- scripts/common.sh@337 -- # local 'op=<' 00:13:43.459 09:37:05 -- scripts/common.sh@339 -- # ver1_l=2 00:13:43.459 09:37:05 -- scripts/common.sh@340 -- # ver2_l=1 00:13:43.459 09:37:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:43.459 09:37:05 -- scripts/common.sh@343 -- # case "$op" in 00:13:43.459 09:37:05 -- scripts/common.sh@344 -- # : 1 00:13:43.459 09:37:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:43.459 09:37:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:43.459 09:37:05 -- scripts/common.sh@364 -- # decimal 1 00:13:43.459 09:37:05 -- scripts/common.sh@352 -- # local d=1 00:13:43.459 09:37:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:43.459 09:37:05 -- scripts/common.sh@354 -- # echo 1 00:13:43.459 09:37:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:43.459 09:37:05 -- scripts/common.sh@365 -- # decimal 2 00:13:43.459 09:37:05 -- scripts/common.sh@352 -- # local d=2 00:13:43.459 09:37:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:43.459 09:37:05 -- scripts/common.sh@354 -- # echo 2 00:13:43.459 09:37:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:43.459 09:37:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:43.459 09:37:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:43.459 09:37:05 -- scripts/common.sh@367 -- # return 0 00:13:43.459 09:37:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:43.459 09:37:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:43.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.459 --rc genhtml_branch_coverage=1 00:13:43.459 --rc genhtml_function_coverage=1 00:13:43.459 --rc genhtml_legend=1 00:13:43.459 --rc geninfo_all_blocks=1 00:13:43.459 --rc geninfo_unexecuted_blocks=1 00:13:43.459 00:13:43.459 ' 00:13:43.459 09:37:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:43.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.459 --rc genhtml_branch_coverage=1 00:13:43.459 --rc genhtml_function_coverage=1 00:13:43.459 --rc genhtml_legend=1 00:13:43.459 --rc geninfo_all_blocks=1 00:13:43.459 --rc geninfo_unexecuted_blocks=1 00:13:43.459 00:13:43.459 ' 00:13:43.459 09:37:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:43.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.459 --rc genhtml_branch_coverage=1 00:13:43.459 --rc genhtml_function_coverage=1 00:13:43.459 --rc genhtml_legend=1 00:13:43.459 --rc geninfo_all_blocks=1 00:13:43.459 --rc geninfo_unexecuted_blocks=1 00:13:43.459 00:13:43.459 ' 00:13:43.459 09:37:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:43.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.459 --rc genhtml_branch_coverage=1 00:13:43.459 --rc genhtml_function_coverage=1 00:13:43.459 --rc genhtml_legend=1 00:13:43.459 --rc geninfo_all_blocks=1 00:13:43.459 --rc geninfo_unexecuted_blocks=1 00:13:43.459 00:13:43.459 ' 00:13:43.459 09:37:05 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:43.459 09:37:05 -- nvmf/common.sh@7 -- # uname -s 00:13:43.459 09:37:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:43.459 09:37:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:43.459 09:37:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:43.459 09:37:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:43.460 09:37:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:43.460 09:37:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:43.460 09:37:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:43.460 09:37:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:43.460 09:37:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:43.460 09:37:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:43.460 09:37:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:43.460 09:37:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:43.460 09:37:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:43.460 09:37:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:43.460 09:37:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:43.460 09:37:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:43.460 09:37:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:43.460 09:37:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:43.460 09:37:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:43.460 09:37:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.460 09:37:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.460 09:37:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.460 09:37:05 -- paths/export.sh@5 -- # export PATH 00:13:43.460 09:37:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.460 09:37:05 -- nvmf/common.sh@46 -- # : 0 00:13:43.460 09:37:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:43.460 09:37:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:43.460 09:37:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:43.460 09:37:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:43.460 09:37:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:43.460 09:37:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:43.460 09:37:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:43.460 09:37:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:43.460 09:37:05 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:43.460 09:37:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:43.460 09:37:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:43.460 09:37:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:43.460 09:37:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:43.460 09:37:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:43.460 09:37:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:43.460 09:37:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:43.460 09:37:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:43.460 09:37:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:43.460 09:37:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:43.460 09:37:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:43.460 09:37:05 -- common/autotest_common.sh@10 -- # set +x 00:13:45.358 09:37:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:45.358 09:37:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:45.358 09:37:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:45.358 09:37:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:45.358 09:37:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:45.358 09:37:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:45.358 09:37:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:45.359 09:37:07 -- nvmf/common.sh@294 -- # net_devs=() 00:13:45.359 09:37:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:45.359 09:37:07 -- nvmf/common.sh@295 -- # e810=() 00:13:45.359 09:37:07 -- nvmf/common.sh@295 -- # local -ga e810 00:13:45.359 09:37:07 -- nvmf/common.sh@296 -- # x722=() 00:13:45.359 09:37:07 -- nvmf/common.sh@296 -- # local -ga x722 00:13:45.359 09:37:07 -- nvmf/common.sh@297 -- # mlx=() 00:13:45.359 09:37:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:45.359 09:37:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:45.359 09:37:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:45.359 09:37:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:45.359 09:37:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:45.359 09:37:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:45.359 09:37:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:45.359 09:37:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:45.359 09:37:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:45.359 09:37:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:45.359 09:37:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:45.359 09:37:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:45.359 09:37:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:45.359 09:37:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:45.359 09:37:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:45.359 09:37:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:45.359 09:37:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:45.359 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:45.359 09:37:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:45.359 09:37:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:45.359 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:45.359 09:37:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:45.359 09:37:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:45.359 09:37:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:45.359 09:37:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:45.359 09:37:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:45.359 09:37:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:45.359 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:45.359 09:37:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:45.359 09:37:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:45.359 09:37:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:45.359 09:37:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:45.359 09:37:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:45.359 09:37:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:45.359 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:45.359 09:37:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:45.359 09:37:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:45.359 09:37:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:45.359 09:37:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:45.359 09:37:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:45.359 09:37:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:45.359 09:37:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:45.359 09:37:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:45.359 09:37:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:45.359 09:37:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:45.359 09:37:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:45.359 09:37:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:45.359 09:37:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:45.359 09:37:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:45.359 09:37:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:45.359 09:37:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:45.359 09:37:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:45.359 09:37:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:45.359 09:37:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:45.359 09:37:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:45.359 09:37:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:45.359 09:37:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:45.359 09:37:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:45.359 09:37:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:45.359 09:37:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:45.359 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:45.359 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.241 ms 00:13:45.359 00:13:45.359 --- 10.0.0.2 ping statistics --- 00:13:45.359 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:45.359 rtt min/avg/max/mdev = 0.241/0.241/0.241/0.000 ms 00:13:45.359 09:37:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:45.359 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:45.359 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.088 ms 00:13:45.359 00:13:45.359 --- 10.0.0.1 ping statistics --- 00:13:45.359 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:45.359 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:13:45.359 09:37:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:45.359 09:37:08 -- nvmf/common.sh@410 -- # return 0 00:13:45.359 09:37:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:45.359 09:37:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:45.359 09:37:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:45.359 09:37:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:45.359 09:37:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:45.359 09:37:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:45.359 09:37:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:45.359 09:37:08 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:45.359 09:37:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:45.359 09:37:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:45.359 09:37:08 -- common/autotest_common.sh@10 -- # set +x 00:13:45.359 09:37:08 -- nvmf/common.sh@469 -- # nvmfpid=4190479 00:13:45.359 09:37:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:45.359 09:37:08 -- nvmf/common.sh@470 -- # waitforlisten 4190479 00:13:45.359 09:37:08 -- common/autotest_common.sh@829 -- # '[' -z 4190479 ']' 00:13:45.359 09:37:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:45.359 09:37:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:45.359 09:37:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:45.359 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:45.359 09:37:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:45.359 09:37:08 -- common/autotest_common.sh@10 -- # set +x 00:13:45.359 [2024-11-29 09:37:08.144990] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:45.359 [2024-11-29 09:37:08.145066] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:45.359 EAL: No free 2048 kB hugepages reported on node 1 00:13:45.619 [2024-11-29 09:37:08.213951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:45.619 [2024-11-29 09:37:08.327058] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:45.619 [2024-11-29 09:37:08.327232] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:45.619 [2024-11-29 09:37:08.327251] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:45.619 [2024-11-29 09:37:08.327271] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:45.619 [2024-11-29 09:37:08.327340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:45.619 [2024-11-29 09:37:08.327347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:46.557 09:37:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:46.557 09:37:09 -- common/autotest_common.sh@862 -- # return 0 00:13:46.557 09:37:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:46.558 09:37:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:46.558 09:37:09 -- common/autotest_common.sh@10 -- # set +x 00:13:46.558 09:37:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:46.558 09:37:09 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:46.558 09:37:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.558 09:37:09 -- common/autotest_common.sh@10 -- # set +x 00:13:46.558 [2024-11-29 09:37:09.135476] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:46.558 09:37:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.558 09:37:09 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:46.558 09:37:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.558 09:37:09 -- common/autotest_common.sh@10 -- # set +x 00:13:46.558 09:37:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.558 09:37:09 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:46.558 09:37:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.558 09:37:09 -- common/autotest_common.sh@10 -- # set +x 00:13:46.558 [2024-11-29 09:37:09.151687] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:46.558 09:37:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.558 09:37:09 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:46.558 09:37:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.558 09:37:09 -- common/autotest_common.sh@10 -- # set +x 00:13:46.558 NULL1 00:13:46.558 09:37:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.558 09:37:09 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:46.558 09:37:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.558 09:37:09 -- common/autotest_common.sh@10 -- # set +x 00:13:46.558 Delay0 00:13:46.558 09:37:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.558 09:37:09 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:46.558 09:37:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.558 09:37:09 -- common/autotest_common.sh@10 -- # set +x 00:13:46.558 09:37:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.558 09:37:09 -- target/delete_subsystem.sh@28 -- # perf_pid=4190638 00:13:46.558 09:37:09 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:46.558 09:37:09 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:46.558 EAL: No free 2048 kB hugepages reported on node 1 00:13:46.558 [2024-11-29 09:37:09.226479] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:48.470 09:37:11 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:48.470 09:37:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.470 09:37:11 -- common/autotest_common.sh@10 -- # set +x 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 starting I/O failed: -6 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 starting I/O failed: -6 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 starting I/O failed: -6 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 starting I/O failed: -6 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 starting I/O failed: -6 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 starting I/O failed: -6 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 starting I/O failed: -6 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 starting I/O failed: -6 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 starting I/O failed: -6 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 starting I/O failed: -6 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 [2024-11-29 09:37:11.395948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9d6770 is same with the state(5) to be set 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 [2024-11-29 09:37:11.398694] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9f63d0 is same with the state(5) to be set 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 starting I/O failed: -6 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 starting I/O failed: -6 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 starting I/O failed: -6 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 Write completed with error (sct=0, sc=8) 00:13:48.729 Read completed with error (sct=0, sc=8) 00:13:48.729 starting I/O failed: -6 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 starting I/O failed: -6 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 starting I/O failed: -6 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 starting I/O failed: -6 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 starting I/O failed: -6 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 starting I/O failed: -6 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 starting I/O failed: -6 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 [2024-11-29 09:37:11.399200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f7530000c00 is same with the state(5) to be set 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Read completed with error (sct=0, sc=8) 00:13:48.730 Write completed with error (sct=0, sc=8) 00:13:49.669 [2024-11-29 09:37:12.366890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9ef960 is same with the state(5) to be set 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 [2024-11-29 09:37:12.398943] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f753000bf20 is same with the state(5) to be set 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 [2024-11-29 09:37:12.399825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9d64c0 is same with the state(5) to be set 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 [2024-11-29 09:37:12.400011] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9d6a20 is same with the state(5) to be set 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Read completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 Write completed with error (sct=0, sc=8) 00:13:49.669 [2024-11-29 09:37:12.401750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f753000c480 is same with the state(5) to be set 00:13:49.669 [2024-11-29 09:37:12.402371] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9ef960 (9): Bad file descriptor 00:13:49.669 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:49.669 09:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.669 09:37:12 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:49.669 09:37:12 -- target/delete_subsystem.sh@35 -- # kill -0 4190638 00:13:49.669 09:37:12 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:49.669 Initializing NVMe Controllers 00:13:49.669 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:49.669 Controller IO queue size 128, less than required. 00:13:49.669 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:49.670 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:49.670 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:49.670 Initialization complete. Launching workers. 00:13:49.670 ======================================================== 00:13:49.670 Latency(us) 00:13:49.670 Device Information : IOPS MiB/s Average min max 00:13:49.670 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 156.47 0.08 926738.01 2745.45 1013457.21 00:13:49.670 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 161.44 0.08 914014.52 372.48 1011812.28 00:13:49.670 ======================================================== 00:13:49.670 Total : 317.91 0.16 920276.86 372.48 1013457.21 00:13:49.670 00:13:50.241 09:37:12 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:50.241 09:37:12 -- target/delete_subsystem.sh@35 -- # kill -0 4190638 00:13:50.241 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (4190638) - No such process 00:13:50.241 09:37:12 -- target/delete_subsystem.sh@45 -- # NOT wait 4190638 00:13:50.241 09:37:12 -- common/autotest_common.sh@650 -- # local es=0 00:13:50.241 09:37:12 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 4190638 00:13:50.241 09:37:12 -- common/autotest_common.sh@638 -- # local arg=wait 00:13:50.241 09:37:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:50.241 09:37:12 -- common/autotest_common.sh@642 -- # type -t wait 00:13:50.241 09:37:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:50.241 09:37:12 -- common/autotest_common.sh@653 -- # wait 4190638 00:13:50.241 09:37:12 -- common/autotest_common.sh@653 -- # es=1 00:13:50.241 09:37:12 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:50.241 09:37:12 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:50.241 09:37:12 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:50.241 09:37:12 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:50.241 09:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.241 09:37:12 -- common/autotest_common.sh@10 -- # set +x 00:13:50.241 09:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.241 09:37:12 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:50.241 09:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.241 09:37:12 -- common/autotest_common.sh@10 -- # set +x 00:13:50.241 [2024-11-29 09:37:12.925546] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:50.241 09:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.241 09:37:12 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:50.241 09:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.241 09:37:12 -- common/autotest_common.sh@10 -- # set +x 00:13:50.241 09:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.241 09:37:12 -- target/delete_subsystem.sh@54 -- # perf_pid=4191048 00:13:50.241 09:37:12 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:50.241 09:37:12 -- target/delete_subsystem.sh@57 -- # kill -0 4191048 00:13:50.241 09:37:12 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:50.241 09:37:12 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:50.241 EAL: No free 2048 kB hugepages reported on node 1 00:13:50.241 [2024-11-29 09:37:12.987707] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:50.810 09:37:13 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:50.810 09:37:13 -- target/delete_subsystem.sh@57 -- # kill -0 4191048 00:13:50.810 09:37:13 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:51.382 09:37:13 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:51.382 09:37:13 -- target/delete_subsystem.sh@57 -- # kill -0 4191048 00:13:51.382 09:37:13 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:51.642 09:37:14 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:51.642 09:37:14 -- target/delete_subsystem.sh@57 -- # kill -0 4191048 00:13:51.642 09:37:14 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:52.212 09:37:14 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:52.212 09:37:14 -- target/delete_subsystem.sh@57 -- # kill -0 4191048 00:13:52.212 09:37:14 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:52.780 09:37:15 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:52.780 09:37:15 -- target/delete_subsystem.sh@57 -- # kill -0 4191048 00:13:52.780 09:37:15 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:53.377 09:37:15 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:53.377 09:37:15 -- target/delete_subsystem.sh@57 -- # kill -0 4191048 00:13:53.377 09:37:15 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:53.377 Initializing NVMe Controllers 00:13:53.378 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:53.378 Controller IO queue size 128, less than required. 00:13:53.378 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:53.378 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:53.378 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:53.378 Initialization complete. Launching workers. 00:13:53.378 ======================================================== 00:13:53.378 Latency(us) 00:13:53.378 Device Information : IOPS MiB/s Average min max 00:13:53.378 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003567.18 1000171.05 1042211.69 00:13:53.378 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1005762.98 1000241.51 1043051.14 00:13:53.378 ======================================================== 00:13:53.378 Total : 256.00 0.12 1004665.08 1000171.05 1043051.14 00:13:53.378 00:13:53.658 09:37:16 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:53.658 09:37:16 -- target/delete_subsystem.sh@57 -- # kill -0 4191048 00:13:53.658 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (4191048) - No such process 00:13:53.658 09:37:16 -- target/delete_subsystem.sh@67 -- # wait 4191048 00:13:53.658 09:37:16 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:53.658 09:37:16 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:53.658 09:37:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:53.658 09:37:16 -- nvmf/common.sh@116 -- # sync 00:13:53.658 09:37:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:53.658 09:37:16 -- nvmf/common.sh@119 -- # set +e 00:13:53.658 09:37:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:53.658 09:37:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:53.658 rmmod nvme_tcp 00:13:53.924 rmmod nvme_fabrics 00:13:53.924 rmmod nvme_keyring 00:13:53.924 09:37:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:53.924 09:37:16 -- nvmf/common.sh@123 -- # set -e 00:13:53.924 09:37:16 -- nvmf/common.sh@124 -- # return 0 00:13:53.924 09:37:16 -- nvmf/common.sh@477 -- # '[' -n 4190479 ']' 00:13:53.924 09:37:16 -- nvmf/common.sh@478 -- # killprocess 4190479 00:13:53.924 09:37:16 -- common/autotest_common.sh@936 -- # '[' -z 4190479 ']' 00:13:53.924 09:37:16 -- common/autotest_common.sh@940 -- # kill -0 4190479 00:13:53.924 09:37:16 -- common/autotest_common.sh@941 -- # uname 00:13:53.924 09:37:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:53.924 09:37:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4190479 00:13:53.924 09:37:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:53.924 09:37:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:53.924 09:37:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4190479' 00:13:53.924 killing process with pid 4190479 00:13:53.924 09:37:16 -- common/autotest_common.sh@955 -- # kill 4190479 00:13:53.924 09:37:16 -- common/autotest_common.sh@960 -- # wait 4190479 00:13:54.186 09:37:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:54.186 09:37:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:54.186 09:37:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:54.186 09:37:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:54.186 09:37:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:54.186 09:37:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:54.186 09:37:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:54.186 09:37:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:56.095 09:37:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:56.095 00:13:56.095 real 0m13.055s 00:13:56.095 user 0m29.526s 00:13:56.095 sys 0m2.980s 00:13:56.095 09:37:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:56.095 09:37:18 -- common/autotest_common.sh@10 -- # set +x 00:13:56.095 ************************************ 00:13:56.095 END TEST nvmf_delete_subsystem 00:13:56.095 ************************************ 00:13:56.095 09:37:18 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:13:56.095 09:37:18 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:56.096 09:37:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:56.096 09:37:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:56.096 09:37:18 -- common/autotest_common.sh@10 -- # set +x 00:13:56.096 ************************************ 00:13:56.096 START TEST nvmf_nvme_cli 00:13:56.096 ************************************ 00:13:56.096 09:37:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:56.355 * Looking for test storage... 00:13:56.355 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:56.355 09:37:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:56.355 09:37:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:56.355 09:37:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:56.355 09:37:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:56.355 09:37:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:56.355 09:37:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:56.355 09:37:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:56.355 09:37:19 -- scripts/common.sh@335 -- # IFS=.-: 00:13:56.355 09:37:19 -- scripts/common.sh@335 -- # read -ra ver1 00:13:56.355 09:37:19 -- scripts/common.sh@336 -- # IFS=.-: 00:13:56.355 09:37:19 -- scripts/common.sh@336 -- # read -ra ver2 00:13:56.355 09:37:19 -- scripts/common.sh@337 -- # local 'op=<' 00:13:56.355 09:37:19 -- scripts/common.sh@339 -- # ver1_l=2 00:13:56.355 09:37:19 -- scripts/common.sh@340 -- # ver2_l=1 00:13:56.355 09:37:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:56.355 09:37:19 -- scripts/common.sh@343 -- # case "$op" in 00:13:56.355 09:37:19 -- scripts/common.sh@344 -- # : 1 00:13:56.355 09:37:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:56.355 09:37:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:56.355 09:37:19 -- scripts/common.sh@364 -- # decimal 1 00:13:56.355 09:37:19 -- scripts/common.sh@352 -- # local d=1 00:13:56.355 09:37:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:56.355 09:37:19 -- scripts/common.sh@354 -- # echo 1 00:13:56.355 09:37:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:56.355 09:37:19 -- scripts/common.sh@365 -- # decimal 2 00:13:56.355 09:37:19 -- scripts/common.sh@352 -- # local d=2 00:13:56.355 09:37:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:56.355 09:37:19 -- scripts/common.sh@354 -- # echo 2 00:13:56.355 09:37:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:56.355 09:37:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:56.355 09:37:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:56.355 09:37:19 -- scripts/common.sh@367 -- # return 0 00:13:56.355 09:37:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:56.355 09:37:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:56.355 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:56.355 --rc genhtml_branch_coverage=1 00:13:56.355 --rc genhtml_function_coverage=1 00:13:56.355 --rc genhtml_legend=1 00:13:56.355 --rc geninfo_all_blocks=1 00:13:56.355 --rc geninfo_unexecuted_blocks=1 00:13:56.355 00:13:56.355 ' 00:13:56.355 09:37:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:56.355 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:56.355 --rc genhtml_branch_coverage=1 00:13:56.355 --rc genhtml_function_coverage=1 00:13:56.355 --rc genhtml_legend=1 00:13:56.355 --rc geninfo_all_blocks=1 00:13:56.355 --rc geninfo_unexecuted_blocks=1 00:13:56.355 00:13:56.355 ' 00:13:56.355 09:37:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:56.355 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:56.355 --rc genhtml_branch_coverage=1 00:13:56.355 --rc genhtml_function_coverage=1 00:13:56.355 --rc genhtml_legend=1 00:13:56.355 --rc geninfo_all_blocks=1 00:13:56.355 --rc geninfo_unexecuted_blocks=1 00:13:56.355 00:13:56.355 ' 00:13:56.355 09:37:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:56.355 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:56.355 --rc genhtml_branch_coverage=1 00:13:56.355 --rc genhtml_function_coverage=1 00:13:56.355 --rc genhtml_legend=1 00:13:56.355 --rc geninfo_all_blocks=1 00:13:56.355 --rc geninfo_unexecuted_blocks=1 00:13:56.355 00:13:56.355 ' 00:13:56.355 09:37:19 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:56.355 09:37:19 -- nvmf/common.sh@7 -- # uname -s 00:13:56.355 09:37:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:56.355 09:37:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:56.355 09:37:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:56.355 09:37:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:56.355 09:37:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:56.355 09:37:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:56.355 09:37:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:56.355 09:37:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:56.355 09:37:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:56.355 09:37:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:56.355 09:37:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:56.355 09:37:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:56.355 09:37:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:56.355 09:37:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:56.355 09:37:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:56.355 09:37:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:56.355 09:37:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:56.355 09:37:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:56.355 09:37:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:56.355 09:37:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:56.355 09:37:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:56.355 09:37:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:56.355 09:37:19 -- paths/export.sh@5 -- # export PATH 00:13:56.355 09:37:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:56.355 09:37:19 -- nvmf/common.sh@46 -- # : 0 00:13:56.355 09:37:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:56.355 09:37:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:56.355 09:37:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:56.355 09:37:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:56.355 09:37:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:56.355 09:37:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:56.355 09:37:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:56.355 09:37:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:56.355 09:37:19 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:56.355 09:37:19 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:56.355 09:37:19 -- target/nvme_cli.sh@14 -- # devs=() 00:13:56.355 09:37:19 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:13:56.355 09:37:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:56.355 09:37:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:56.356 09:37:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:56.356 09:37:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:56.356 09:37:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:56.356 09:37:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:56.356 09:37:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:56.356 09:37:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:56.356 09:37:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:56.356 09:37:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:56.356 09:37:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:56.356 09:37:19 -- common/autotest_common.sh@10 -- # set +x 00:13:58.258 09:37:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:58.258 09:37:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:58.258 09:37:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:58.258 09:37:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:58.258 09:37:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:58.258 09:37:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:58.258 09:37:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:58.258 09:37:21 -- nvmf/common.sh@294 -- # net_devs=() 00:13:58.258 09:37:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:58.258 09:37:21 -- nvmf/common.sh@295 -- # e810=() 00:13:58.258 09:37:21 -- nvmf/common.sh@295 -- # local -ga e810 00:13:58.258 09:37:21 -- nvmf/common.sh@296 -- # x722=() 00:13:58.258 09:37:21 -- nvmf/common.sh@296 -- # local -ga x722 00:13:58.258 09:37:21 -- nvmf/common.sh@297 -- # mlx=() 00:13:58.258 09:37:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:58.258 09:37:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:58.258 09:37:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:58.258 09:37:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:58.258 09:37:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:58.258 09:37:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:58.258 09:37:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:58.258 09:37:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:58.258 09:37:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:58.258 09:37:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:58.258 09:37:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:58.258 09:37:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:58.258 09:37:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:58.258 09:37:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:58.258 09:37:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:58.258 09:37:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:58.258 09:37:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:58.258 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:58.258 09:37:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:58.258 09:37:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:58.258 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:58.258 09:37:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:58.258 09:37:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:58.258 09:37:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:58.258 09:37:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:58.258 09:37:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:58.258 09:37:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:58.258 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:58.258 09:37:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:58.258 09:37:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:58.258 09:37:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:58.258 09:37:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:58.258 09:37:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:58.258 09:37:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:58.258 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:58.258 09:37:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:58.258 09:37:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:58.258 09:37:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:58.258 09:37:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:58.258 09:37:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:58.258 09:37:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:58.258 09:37:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:58.258 09:37:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:58.258 09:37:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:58.258 09:37:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:58.258 09:37:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:58.258 09:37:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:58.258 09:37:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:58.259 09:37:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:58.259 09:37:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:58.259 09:37:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:58.259 09:37:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:58.259 09:37:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:58.518 09:37:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:58.518 09:37:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:58.518 09:37:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:58.518 09:37:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:58.518 09:37:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:58.518 09:37:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:58.518 09:37:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:58.518 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:58.518 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.302 ms 00:13:58.518 00:13:58.518 --- 10.0.0.2 ping statistics --- 00:13:58.518 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:58.518 rtt min/avg/max/mdev = 0.302/0.302/0.302/0.000 ms 00:13:58.518 09:37:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:58.518 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:58.518 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.157 ms 00:13:58.518 00:13:58.518 --- 10.0.0.1 ping statistics --- 00:13:58.518 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:58.518 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:13:58.518 09:37:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:58.518 09:37:21 -- nvmf/common.sh@410 -- # return 0 00:13:58.518 09:37:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:58.518 09:37:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:58.518 09:37:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:58.518 09:37:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:58.518 09:37:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:58.518 09:37:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:58.518 09:37:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:58.518 09:37:21 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:13:58.518 09:37:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:58.518 09:37:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:58.518 09:37:21 -- common/autotest_common.sh@10 -- # set +x 00:13:58.518 09:37:21 -- nvmf/common.sh@469 -- # nvmfpid=4193427 00:13:58.518 09:37:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:58.518 09:37:21 -- nvmf/common.sh@470 -- # waitforlisten 4193427 00:13:58.518 09:37:21 -- common/autotest_common.sh@829 -- # '[' -z 4193427 ']' 00:13:58.518 09:37:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:58.518 09:37:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:58.518 09:37:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:58.518 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:58.518 09:37:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:58.518 09:37:21 -- common/autotest_common.sh@10 -- # set +x 00:13:58.518 [2024-11-29 09:37:21.258812] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:58.518 [2024-11-29 09:37:21.258886] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:58.518 EAL: No free 2048 kB hugepages reported on node 1 00:13:58.518 [2024-11-29 09:37:21.324980] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:58.778 [2024-11-29 09:37:21.435691] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:58.778 [2024-11-29 09:37:21.435850] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:58.778 [2024-11-29 09:37:21.435867] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:58.778 [2024-11-29 09:37:21.435880] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:58.778 [2024-11-29 09:37:21.435944] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:58.778 [2024-11-29 09:37:21.436014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:58.778 [2024-11-29 09:37:21.436084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:58.778 [2024-11-29 09:37:21.436082] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:59.713 09:37:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:59.713 09:37:22 -- common/autotest_common.sh@862 -- # return 0 00:13:59.713 09:37:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:59.713 09:37:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:59.713 09:37:22 -- common/autotest_common.sh@10 -- # set +x 00:13:59.713 09:37:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:59.713 09:37:22 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:59.713 09:37:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.713 09:37:22 -- common/autotest_common.sh@10 -- # set +x 00:13:59.713 [2024-11-29 09:37:22.276043] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:59.713 09:37:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.713 09:37:22 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:59.713 09:37:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.713 09:37:22 -- common/autotest_common.sh@10 -- # set +x 00:13:59.713 Malloc0 00:13:59.713 09:37:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.713 09:37:22 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:59.713 09:37:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.714 09:37:22 -- common/autotest_common.sh@10 -- # set +x 00:13:59.714 Malloc1 00:13:59.714 09:37:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.714 09:37:22 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:13:59.714 09:37:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.714 09:37:22 -- common/autotest_common.sh@10 -- # set +x 00:13:59.714 09:37:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.714 09:37:22 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:59.714 09:37:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.714 09:37:22 -- common/autotest_common.sh@10 -- # set +x 00:13:59.714 09:37:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.714 09:37:22 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:59.714 09:37:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.714 09:37:22 -- common/autotest_common.sh@10 -- # set +x 00:13:59.714 09:37:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.714 09:37:22 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:59.714 09:37:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.714 09:37:22 -- common/autotest_common.sh@10 -- # set +x 00:13:59.714 [2024-11-29 09:37:22.361992] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:59.714 09:37:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.714 09:37:22 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:59.714 09:37:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.714 09:37:22 -- common/autotest_common.sh@10 -- # set +x 00:13:59.714 09:37:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.714 09:37:22 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:13:59.714 00:13:59.714 Discovery Log Number of Records 2, Generation counter 2 00:13:59.714 =====Discovery Log Entry 0====== 00:13:59.714 trtype: tcp 00:13:59.714 adrfam: ipv4 00:13:59.714 subtype: current discovery subsystem 00:13:59.714 treq: not required 00:13:59.714 portid: 0 00:13:59.714 trsvcid: 4420 00:13:59.714 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:13:59.714 traddr: 10.0.0.2 00:13:59.714 eflags: explicit discovery connections, duplicate discovery information 00:13:59.714 sectype: none 00:13:59.714 =====Discovery Log Entry 1====== 00:13:59.714 trtype: tcp 00:13:59.714 adrfam: ipv4 00:13:59.714 subtype: nvme subsystem 00:13:59.714 treq: not required 00:13:59.714 portid: 0 00:13:59.714 trsvcid: 4420 00:13:59.714 subnqn: nqn.2016-06.io.spdk:cnode1 00:13:59.714 traddr: 10.0.0.2 00:13:59.714 eflags: none 00:13:59.714 sectype: none 00:13:59.714 09:37:22 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:13:59.714 09:37:22 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:13:59.714 09:37:22 -- nvmf/common.sh@510 -- # local dev _ 00:13:59.714 09:37:22 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:59.714 09:37:22 -- nvmf/common.sh@509 -- # nvme list 00:13:59.973 09:37:22 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:59.973 09:37:22 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:59.973 09:37:22 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:59.973 09:37:22 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:59.973 09:37:22 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:13:59.973 09:37:22 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:00.542 09:37:23 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:00.542 09:37:23 -- common/autotest_common.sh@1187 -- # local i=0 00:14:00.542 09:37:23 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:14:00.542 09:37:23 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:14:00.542 09:37:23 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:14:00.542 09:37:23 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:02.460 09:37:25 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:02.460 09:37:25 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:02.460 09:37:25 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:02.460 09:37:25 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:02.460 09:37:25 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:02.460 09:37:25 -- common/autotest_common.sh@1197 -- # return 0 00:14:02.460 09:37:25 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:02.460 09:37:25 -- nvmf/common.sh@510 -- # local dev _ 00:14:02.460 09:37:25 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:02.460 09:37:25 -- nvmf/common.sh@509 -- # nvme list 00:14:02.725 09:37:25 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:02.725 09:37:25 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:02.725 09:37:25 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:02.725 09:37:25 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:02.725 09:37:25 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:02.725 09:37:25 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:02.725 09:37:25 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:02.725 09:37:25 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:02.725 09:37:25 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:02.725 09:37:25 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:02.725 09:37:25 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:02.725 /dev/nvme0n2 ]] 00:14:02.725 09:37:25 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:02.725 09:37:25 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:02.725 09:37:25 -- nvmf/common.sh@510 -- # local dev _ 00:14:02.725 09:37:25 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:02.725 09:37:25 -- nvmf/common.sh@509 -- # nvme list 00:14:02.725 09:37:25 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:02.725 09:37:25 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:02.725 09:37:25 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:02.725 09:37:25 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:02.725 09:37:25 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:02.725 09:37:25 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:02.725 09:37:25 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:02.725 09:37:25 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:02.725 09:37:25 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:02.725 09:37:25 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:02.725 09:37:25 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:02.725 09:37:25 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:02.985 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:02.985 09:37:25 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:02.985 09:37:25 -- common/autotest_common.sh@1208 -- # local i=0 00:14:02.985 09:37:25 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:02.985 09:37:25 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:02.985 09:37:25 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:02.985 09:37:25 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:02.985 09:37:25 -- common/autotest_common.sh@1220 -- # return 0 00:14:02.985 09:37:25 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:02.985 09:37:25 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:02.985 09:37:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.985 09:37:25 -- common/autotest_common.sh@10 -- # set +x 00:14:02.985 09:37:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.985 09:37:25 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:02.985 09:37:25 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:02.985 09:37:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:02.985 09:37:25 -- nvmf/common.sh@116 -- # sync 00:14:02.985 09:37:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:02.985 09:37:25 -- nvmf/common.sh@119 -- # set +e 00:14:02.985 09:37:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:02.985 09:37:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:02.985 rmmod nvme_tcp 00:14:02.985 rmmod nvme_fabrics 00:14:02.985 rmmod nvme_keyring 00:14:03.244 09:37:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:03.244 09:37:25 -- nvmf/common.sh@123 -- # set -e 00:14:03.244 09:37:25 -- nvmf/common.sh@124 -- # return 0 00:14:03.244 09:37:25 -- nvmf/common.sh@477 -- # '[' -n 4193427 ']' 00:14:03.244 09:37:25 -- nvmf/common.sh@478 -- # killprocess 4193427 00:14:03.244 09:37:25 -- common/autotest_common.sh@936 -- # '[' -z 4193427 ']' 00:14:03.244 09:37:25 -- common/autotest_common.sh@940 -- # kill -0 4193427 00:14:03.244 09:37:25 -- common/autotest_common.sh@941 -- # uname 00:14:03.244 09:37:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:03.244 09:37:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4193427 00:14:03.244 09:37:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:03.244 09:37:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:03.244 09:37:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4193427' 00:14:03.244 killing process with pid 4193427 00:14:03.244 09:37:25 -- common/autotest_common.sh@955 -- # kill 4193427 00:14:03.244 09:37:25 -- common/autotest_common.sh@960 -- # wait 4193427 00:14:03.502 09:37:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:03.502 09:37:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:03.502 09:37:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:03.502 09:37:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:03.502 09:37:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:03.502 09:37:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:03.502 09:37:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:03.502 09:37:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:05.411 09:37:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:05.411 00:14:05.411 real 0m9.334s 00:14:05.411 user 0m19.633s 00:14:05.411 sys 0m2.268s 00:14:05.411 09:37:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:05.411 09:37:28 -- common/autotest_common.sh@10 -- # set +x 00:14:05.411 ************************************ 00:14:05.411 END TEST nvmf_nvme_cli 00:14:05.411 ************************************ 00:14:05.670 09:37:28 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:05.670 09:37:28 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:05.670 09:37:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:05.670 09:37:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:05.670 09:37:28 -- common/autotest_common.sh@10 -- # set +x 00:14:05.670 ************************************ 00:14:05.670 START TEST nvmf_host_management 00:14:05.670 ************************************ 00:14:05.670 09:37:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:05.670 * Looking for test storage... 00:14:05.670 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:05.670 09:37:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:05.670 09:37:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:05.670 09:37:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:05.670 09:37:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:05.670 09:37:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:05.670 09:37:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:05.670 09:37:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:05.670 09:37:28 -- scripts/common.sh@335 -- # IFS=.-: 00:14:05.670 09:37:28 -- scripts/common.sh@335 -- # read -ra ver1 00:14:05.670 09:37:28 -- scripts/common.sh@336 -- # IFS=.-: 00:14:05.670 09:37:28 -- scripts/common.sh@336 -- # read -ra ver2 00:14:05.670 09:37:28 -- scripts/common.sh@337 -- # local 'op=<' 00:14:05.670 09:37:28 -- scripts/common.sh@339 -- # ver1_l=2 00:14:05.670 09:37:28 -- scripts/common.sh@340 -- # ver2_l=1 00:14:05.670 09:37:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:05.670 09:37:28 -- scripts/common.sh@343 -- # case "$op" in 00:14:05.670 09:37:28 -- scripts/common.sh@344 -- # : 1 00:14:05.670 09:37:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:05.670 09:37:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:05.670 09:37:28 -- scripts/common.sh@364 -- # decimal 1 00:14:05.670 09:37:28 -- scripts/common.sh@352 -- # local d=1 00:14:05.670 09:37:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:05.670 09:37:28 -- scripts/common.sh@354 -- # echo 1 00:14:05.670 09:37:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:05.670 09:37:28 -- scripts/common.sh@365 -- # decimal 2 00:14:05.670 09:37:28 -- scripts/common.sh@352 -- # local d=2 00:14:05.670 09:37:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:05.670 09:37:28 -- scripts/common.sh@354 -- # echo 2 00:14:05.670 09:37:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:05.670 09:37:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:05.670 09:37:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:05.670 09:37:28 -- scripts/common.sh@367 -- # return 0 00:14:05.670 09:37:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:05.670 09:37:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:05.670 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:05.670 --rc genhtml_branch_coverage=1 00:14:05.670 --rc genhtml_function_coverage=1 00:14:05.670 --rc genhtml_legend=1 00:14:05.670 --rc geninfo_all_blocks=1 00:14:05.670 --rc geninfo_unexecuted_blocks=1 00:14:05.670 00:14:05.671 ' 00:14:05.671 09:37:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:05.671 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:05.671 --rc genhtml_branch_coverage=1 00:14:05.671 --rc genhtml_function_coverage=1 00:14:05.671 --rc genhtml_legend=1 00:14:05.671 --rc geninfo_all_blocks=1 00:14:05.671 --rc geninfo_unexecuted_blocks=1 00:14:05.671 00:14:05.671 ' 00:14:05.671 09:37:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:05.671 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:05.671 --rc genhtml_branch_coverage=1 00:14:05.671 --rc genhtml_function_coverage=1 00:14:05.671 --rc genhtml_legend=1 00:14:05.671 --rc geninfo_all_blocks=1 00:14:05.671 --rc geninfo_unexecuted_blocks=1 00:14:05.671 00:14:05.671 ' 00:14:05.671 09:37:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:05.671 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:05.671 --rc genhtml_branch_coverage=1 00:14:05.671 --rc genhtml_function_coverage=1 00:14:05.671 --rc genhtml_legend=1 00:14:05.671 --rc geninfo_all_blocks=1 00:14:05.671 --rc geninfo_unexecuted_blocks=1 00:14:05.671 00:14:05.671 ' 00:14:05.671 09:37:28 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:05.671 09:37:28 -- nvmf/common.sh@7 -- # uname -s 00:14:05.671 09:37:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:05.671 09:37:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:05.671 09:37:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:05.671 09:37:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:05.671 09:37:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:05.671 09:37:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:05.671 09:37:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:05.671 09:37:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:05.671 09:37:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:05.671 09:37:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:05.671 09:37:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:05.671 09:37:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:05.671 09:37:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:05.671 09:37:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:05.671 09:37:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:05.671 09:37:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:05.671 09:37:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:05.671 09:37:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:05.671 09:37:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:05.671 09:37:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.671 09:37:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.671 09:37:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.671 09:37:28 -- paths/export.sh@5 -- # export PATH 00:14:05.671 09:37:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:05.671 09:37:28 -- nvmf/common.sh@46 -- # : 0 00:14:05.671 09:37:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:05.671 09:37:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:05.671 09:37:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:05.671 09:37:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:05.671 09:37:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:05.671 09:37:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:05.671 09:37:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:05.671 09:37:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:05.671 09:37:28 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:05.671 09:37:28 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:05.671 09:37:28 -- target/host_management.sh@104 -- # nvmftestinit 00:14:05.671 09:37:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:05.671 09:37:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:05.671 09:37:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:05.671 09:37:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:05.671 09:37:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:05.671 09:37:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:05.671 09:37:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:05.671 09:37:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:05.671 09:37:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:05.671 09:37:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:05.671 09:37:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:05.671 09:37:28 -- common/autotest_common.sh@10 -- # set +x 00:14:07.579 09:37:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:07.579 09:37:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:07.579 09:37:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:07.579 09:37:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:07.579 09:37:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:07.579 09:37:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:07.579 09:37:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:07.579 09:37:30 -- nvmf/common.sh@294 -- # net_devs=() 00:14:07.579 09:37:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:07.579 09:37:30 -- nvmf/common.sh@295 -- # e810=() 00:14:07.579 09:37:30 -- nvmf/common.sh@295 -- # local -ga e810 00:14:07.579 09:37:30 -- nvmf/common.sh@296 -- # x722=() 00:14:07.579 09:37:30 -- nvmf/common.sh@296 -- # local -ga x722 00:14:07.579 09:37:30 -- nvmf/common.sh@297 -- # mlx=() 00:14:07.579 09:37:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:07.579 09:37:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:07.579 09:37:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:07.579 09:37:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:07.579 09:37:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:07.579 09:37:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:07.579 09:37:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:07.579 09:37:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:07.579 09:37:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:07.579 09:37:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:07.579 09:37:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:07.579 09:37:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:07.579 09:37:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:07.579 09:37:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:07.579 09:37:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:07.579 09:37:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:07.579 09:37:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:07.579 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:07.579 09:37:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:07.579 09:37:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:07.579 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:07.579 09:37:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:07.579 09:37:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:07.579 09:37:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:07.579 09:37:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:07.579 09:37:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:07.579 09:37:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:07.579 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:07.579 09:37:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:07.579 09:37:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:07.579 09:37:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:07.579 09:37:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:07.579 09:37:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:07.579 09:37:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:07.579 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:07.579 09:37:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:07.579 09:37:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:07.579 09:37:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:07.579 09:37:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:07.579 09:37:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:07.579 09:37:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:07.579 09:37:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:07.579 09:37:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:07.579 09:37:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:07.579 09:37:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:07.579 09:37:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:07.579 09:37:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:07.579 09:37:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:07.580 09:37:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:07.580 09:37:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:07.580 09:37:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:07.580 09:37:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:07.580 09:37:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:07.838 09:37:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:07.838 09:37:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:07.838 09:37:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:07.838 09:37:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:07.838 09:37:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:07.838 09:37:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:07.838 09:37:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:07.838 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:07.838 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.182 ms 00:14:07.838 00:14:07.838 --- 10.0.0.2 ping statistics --- 00:14:07.838 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:07.838 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:14:07.838 09:37:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:07.838 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:07.838 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.052 ms 00:14:07.838 00:14:07.838 --- 10.0.0.1 ping statistics --- 00:14:07.838 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:07.838 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:14:07.838 09:37:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:07.838 09:37:30 -- nvmf/common.sh@410 -- # return 0 00:14:07.838 09:37:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:07.838 09:37:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:07.838 09:37:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:07.838 09:37:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:07.838 09:37:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:07.838 09:37:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:07.838 09:37:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:07.838 09:37:30 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:07.838 09:37:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:07.838 09:37:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:07.838 09:37:30 -- common/autotest_common.sh@10 -- # set +x 00:14:07.838 ************************************ 00:14:07.838 START TEST nvmf_host_management 00:14:07.838 ************************************ 00:14:07.838 09:37:30 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:14:07.838 09:37:30 -- target/host_management.sh@69 -- # starttarget 00:14:07.838 09:37:30 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:07.838 09:37:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:07.838 09:37:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:07.838 09:37:30 -- common/autotest_common.sh@10 -- # set +x 00:14:07.838 09:37:30 -- nvmf/common.sh@469 -- # nvmfpid=2282 00:14:07.838 09:37:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:07.838 09:37:30 -- nvmf/common.sh@470 -- # waitforlisten 2282 00:14:07.838 09:37:30 -- common/autotest_common.sh@829 -- # '[' -z 2282 ']' 00:14:07.838 09:37:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:07.838 09:37:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:07.838 09:37:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:07.838 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:07.838 09:37:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:07.838 09:37:30 -- common/autotest_common.sh@10 -- # set +x 00:14:07.839 [2024-11-29 09:37:30.632023] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:07.839 [2024-11-29 09:37:30.632093] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:07.839 EAL: No free 2048 kB hugepages reported on node 1 00:14:08.100 [2024-11-29 09:37:30.699929] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:08.100 [2024-11-29 09:37:30.807543] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:08.100 [2024-11-29 09:37:30.807689] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:08.100 [2024-11-29 09:37:30.807710] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:08.100 [2024-11-29 09:37:30.807724] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:08.100 [2024-11-29 09:37:30.807815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:08.100 [2024-11-29 09:37:30.807903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:08.100 [2024-11-29 09:37:30.807967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:08.100 [2024-11-29 09:37:30.807970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:09.037 09:37:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:09.037 09:37:31 -- common/autotest_common.sh@862 -- # return 0 00:14:09.037 09:37:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:09.037 09:37:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:09.037 09:37:31 -- common/autotest_common.sh@10 -- # set +x 00:14:09.037 09:37:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:09.037 09:37:31 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:09.037 09:37:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:09.037 09:37:31 -- common/autotest_common.sh@10 -- # set +x 00:14:09.037 [2024-11-29 09:37:31.650018] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:09.037 09:37:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:09.037 09:37:31 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:09.037 09:37:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:09.037 09:37:31 -- common/autotest_common.sh@10 -- # set +x 00:14:09.037 09:37:31 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:09.037 09:37:31 -- target/host_management.sh@23 -- # cat 00:14:09.037 09:37:31 -- target/host_management.sh@30 -- # rpc_cmd 00:14:09.037 09:37:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:09.037 09:37:31 -- common/autotest_common.sh@10 -- # set +x 00:14:09.037 Malloc0 00:14:09.037 [2024-11-29 09:37:31.711433] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:09.037 09:37:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:09.037 09:37:31 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:09.037 09:37:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:09.037 09:37:31 -- common/autotest_common.sh@10 -- # set +x 00:14:09.037 09:37:31 -- target/host_management.sh@73 -- # perfpid=2465 00:14:09.038 09:37:31 -- target/host_management.sh@74 -- # waitforlisten 2465 /var/tmp/bdevperf.sock 00:14:09.038 09:37:31 -- common/autotest_common.sh@829 -- # '[' -z 2465 ']' 00:14:09.038 09:37:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:09.038 09:37:31 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:09.038 09:37:31 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:09.038 09:37:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:09.038 09:37:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:09.038 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:09.038 09:37:31 -- nvmf/common.sh@520 -- # config=() 00:14:09.038 09:37:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:09.038 09:37:31 -- nvmf/common.sh@520 -- # local subsystem config 00:14:09.038 09:37:31 -- common/autotest_common.sh@10 -- # set +x 00:14:09.038 09:37:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:09.038 09:37:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:09.038 { 00:14:09.038 "params": { 00:14:09.038 "name": "Nvme$subsystem", 00:14:09.038 "trtype": "$TEST_TRANSPORT", 00:14:09.038 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:09.038 "adrfam": "ipv4", 00:14:09.038 "trsvcid": "$NVMF_PORT", 00:14:09.038 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:09.038 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:09.038 "hdgst": ${hdgst:-false}, 00:14:09.038 "ddgst": ${ddgst:-false} 00:14:09.038 }, 00:14:09.038 "method": "bdev_nvme_attach_controller" 00:14:09.038 } 00:14:09.038 EOF 00:14:09.038 )") 00:14:09.038 09:37:31 -- nvmf/common.sh@542 -- # cat 00:14:09.038 09:37:31 -- nvmf/common.sh@544 -- # jq . 00:14:09.038 09:37:31 -- nvmf/common.sh@545 -- # IFS=, 00:14:09.038 09:37:31 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:09.038 "params": { 00:14:09.038 "name": "Nvme0", 00:14:09.038 "trtype": "tcp", 00:14:09.038 "traddr": "10.0.0.2", 00:14:09.038 "adrfam": "ipv4", 00:14:09.038 "trsvcid": "4420", 00:14:09.038 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:09.038 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:09.038 "hdgst": false, 00:14:09.038 "ddgst": false 00:14:09.038 }, 00:14:09.038 "method": "bdev_nvme_attach_controller" 00:14:09.038 }' 00:14:09.038 [2024-11-29 09:37:31.783240] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:09.038 [2024-11-29 09:37:31.783312] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2465 ] 00:14:09.038 EAL: No free 2048 kB hugepages reported on node 1 00:14:09.038 [2024-11-29 09:37:31.845813] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:09.295 [2024-11-29 09:37:31.954425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:09.555 Running I/O for 10 seconds... 00:14:10.126 09:37:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:10.126 09:37:32 -- common/autotest_common.sh@862 -- # return 0 00:14:10.126 09:37:32 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:10.126 09:37:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.126 09:37:32 -- common/autotest_common.sh@10 -- # set +x 00:14:10.126 09:37:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.126 09:37:32 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:10.126 09:37:32 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:10.126 09:37:32 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:10.126 09:37:32 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:10.126 09:37:32 -- target/host_management.sh@52 -- # local ret=1 00:14:10.126 09:37:32 -- target/host_management.sh@53 -- # local i 00:14:10.126 09:37:32 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:10.126 09:37:32 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:10.126 09:37:32 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:10.126 09:37:32 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:10.126 09:37:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.126 09:37:32 -- common/autotest_common.sh@10 -- # set +x 00:14:10.126 09:37:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.126 09:37:32 -- target/host_management.sh@55 -- # read_io_count=2372 00:14:10.126 09:37:32 -- target/host_management.sh@58 -- # '[' 2372 -ge 100 ']' 00:14:10.126 09:37:32 -- target/host_management.sh@59 -- # ret=0 00:14:10.126 09:37:32 -- target/host_management.sh@60 -- # break 00:14:10.126 09:37:32 -- target/host_management.sh@64 -- # return 0 00:14:10.126 09:37:32 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:10.126 09:37:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.126 09:37:32 -- common/autotest_common.sh@10 -- # set +x 00:14:10.126 [2024-11-29 09:37:32.847211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.126 [2024-11-29 09:37:32.847293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.126 [2024-11-29 09:37:32.847309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.126 [2024-11-29 09:37:32.847322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.126 [2024-11-29 09:37:32.847335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.126 [2024-11-29 09:37:32.847349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.126 [2024-11-29 09:37:32.847363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.126 [2024-11-29 09:37:32.847376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.126 [2024-11-29 09:37:32.847388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.126 [2024-11-29 09:37:32.847409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.126 [2024-11-29 09:37:32.847422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.126 [2024-11-29 09:37:32.847445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.126 [2024-11-29 09:37:32.847458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.847735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17cbe60 is same with the state(5) to be set 00:14:10.127 [2024-11-29 09:37:32.849247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:64384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:64512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:64640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:65024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:65152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:65280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:65408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:58368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:65664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:65792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:58624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:58752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:59136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:59520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:59776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:65920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:66048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:66176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:66304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:66432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:66560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.849979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:66688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.849992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.850007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:66816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.850021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.850035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:66944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.850048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.850062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:67072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.850076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.850090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:67200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.850104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.850119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:67328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.850132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.850147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:60160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.850160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.850179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:67456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.127 [2024-11-29 09:37:32.850193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.127 [2024-11-29 09:37:32.850208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:60288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:60800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:61312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:61568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:67584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:67712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:67840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:67968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:68096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:68224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:68352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:62848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:68480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:68608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:68736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:68864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:68992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:69120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:69248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:69376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:63360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:63616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:69504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:69632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.850970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:69760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.850984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:69888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.851013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:63872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.851059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:64000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.851090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:70016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.851120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:70144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.851149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:70272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.851179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:64256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.851208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:70400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.851237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:70528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.851268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:70656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:10.128 [2024-11-29 09:37:32.851297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851400] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x18b3030 was disconnected and freed. reset controller. 00:14:10.128 [2024-11-29 09:37:32.851484] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:14:10.128 [2024-11-29 09:37:32.851508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851529] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:14:10.128 [2024-11-29 09:37:32.851543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851558] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:14:10.128 [2024-11-29 09:37:32.851571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851586] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:14:10.128 [2024-11-29 09:37:32.851599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:10.128 [2024-11-29 09:37:32.851613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18b5160 is same with the state(5) to be set 00:14:10.128 09:37:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.129 09:37:32 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:10.129 09:37:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.129 09:37:32 -- common/autotest_common.sh@10 -- # set +x 00:14:10.129 [2024-11-29 09:37:32.852738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:10.129 task offset: 64384 on job bdev=Nvme0n1 fails 00:14:10.129 00:14:10.129 Latency(us) 00:14:10.129 [2024-11-29T08:37:32.972Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:10.129 [2024-11-29T08:37:32.972Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:10.129 [2024-11-29T08:37:32.972Z] Job: Nvme0n1 ended in about 0.64 seconds with error 00:14:10.129 Verification LBA range: start 0x0 length 0x400 00:14:10.129 Nvme0n1 : 0.64 3935.35 245.96 99.28 0.00 15624.03 2754.94 22039.51 00:14:10.129 [2024-11-29T08:37:32.972Z] =================================================================================================================== 00:14:10.129 [2024-11-29T08:37:32.972Z] Total : 3935.35 245.96 99.28 0.00 15624.03 2754.94 22039.51 00:14:10.129 [2024-11-29 09:37:32.854651] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:10.129 [2024-11-29 09:37:32.854679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18b5160 (9): Bad file descriptor 00:14:10.129 09:37:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.129 09:37:32 -- target/host_management.sh@87 -- # sleep 1 00:14:10.129 [2024-11-29 09:37:32.867172] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:11.065 09:37:33 -- target/host_management.sh@91 -- # kill -9 2465 00:14:11.065 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (2465) - No such process 00:14:11.065 09:37:33 -- target/host_management.sh@91 -- # true 00:14:11.065 09:37:33 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:11.065 09:37:33 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:11.065 09:37:33 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:11.065 09:37:33 -- nvmf/common.sh@520 -- # config=() 00:14:11.065 09:37:33 -- nvmf/common.sh@520 -- # local subsystem config 00:14:11.065 09:37:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:11.065 09:37:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:11.065 { 00:14:11.065 "params": { 00:14:11.065 "name": "Nvme$subsystem", 00:14:11.065 "trtype": "$TEST_TRANSPORT", 00:14:11.065 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:11.065 "adrfam": "ipv4", 00:14:11.065 "trsvcid": "$NVMF_PORT", 00:14:11.065 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:11.065 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:11.065 "hdgst": ${hdgst:-false}, 00:14:11.065 "ddgst": ${ddgst:-false} 00:14:11.065 }, 00:14:11.065 "method": "bdev_nvme_attach_controller" 00:14:11.065 } 00:14:11.065 EOF 00:14:11.065 )") 00:14:11.065 09:37:33 -- nvmf/common.sh@542 -- # cat 00:14:11.065 09:37:33 -- nvmf/common.sh@544 -- # jq . 00:14:11.065 09:37:33 -- nvmf/common.sh@545 -- # IFS=, 00:14:11.065 09:37:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:11.065 "params": { 00:14:11.065 "name": "Nvme0", 00:14:11.065 "trtype": "tcp", 00:14:11.065 "traddr": "10.0.0.2", 00:14:11.065 "adrfam": "ipv4", 00:14:11.065 "trsvcid": "4420", 00:14:11.065 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:11.065 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:11.065 "hdgst": false, 00:14:11.065 "ddgst": false 00:14:11.065 }, 00:14:11.065 "method": "bdev_nvme_attach_controller" 00:14:11.065 }' 00:14:11.065 [2024-11-29 09:37:33.904639] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:11.065 [2024-11-29 09:37:33.904756] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2815 ] 00:14:11.326 EAL: No free 2048 kB hugepages reported on node 1 00:14:11.326 [2024-11-29 09:37:33.965919] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:11.326 [2024-11-29 09:37:34.073025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:11.587 Running I/O for 1 seconds... 00:14:12.966 00:14:12.966 Latency(us) 00:14:12.966 [2024-11-29T08:37:35.809Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:12.966 [2024-11-29T08:37:35.809Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:12.966 Verification LBA range: start 0x0 length 0x400 00:14:12.966 Nvme0n1 : 1.05 3854.41 240.90 0.00 0.00 15729.43 2038.90 43496.49 00:14:12.966 [2024-11-29T08:37:35.809Z] =================================================================================================================== 00:14:12.966 [2024-11-29T08:37:35.809Z] Total : 3854.41 240.90 0.00 0.00 15729.43 2038.90 43496.49 00:14:12.966 09:37:35 -- target/host_management.sh@101 -- # stoptarget 00:14:12.966 09:37:35 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:12.966 09:37:35 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:12.966 09:37:35 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:12.966 09:37:35 -- target/host_management.sh@40 -- # nvmftestfini 00:14:12.966 09:37:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:12.966 09:37:35 -- nvmf/common.sh@116 -- # sync 00:14:12.966 09:37:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:12.966 09:37:35 -- nvmf/common.sh@119 -- # set +e 00:14:12.966 09:37:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:12.966 09:37:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:12.966 rmmod nvme_tcp 00:14:12.966 rmmod nvme_fabrics 00:14:12.966 rmmod nvme_keyring 00:14:12.966 09:37:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:12.966 09:37:35 -- nvmf/common.sh@123 -- # set -e 00:14:12.966 09:37:35 -- nvmf/common.sh@124 -- # return 0 00:14:12.966 09:37:35 -- nvmf/common.sh@477 -- # '[' -n 2282 ']' 00:14:12.966 09:37:35 -- nvmf/common.sh@478 -- # killprocess 2282 00:14:12.966 09:37:35 -- common/autotest_common.sh@936 -- # '[' -z 2282 ']' 00:14:12.966 09:37:35 -- common/autotest_common.sh@940 -- # kill -0 2282 00:14:12.966 09:37:35 -- common/autotest_common.sh@941 -- # uname 00:14:12.966 09:37:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:12.966 09:37:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2282 00:14:12.966 09:37:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:12.966 09:37:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:12.966 09:37:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2282' 00:14:12.966 killing process with pid 2282 00:14:12.966 09:37:35 -- common/autotest_common.sh@955 -- # kill 2282 00:14:12.966 09:37:35 -- common/autotest_common.sh@960 -- # wait 2282 00:14:13.226 [2024-11-29 09:37:36.042667] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:13.485 09:37:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:13.485 09:37:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:13.485 09:37:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:13.485 09:37:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:13.485 09:37:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:13.485 09:37:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:13.485 09:37:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:13.485 09:37:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:15.395 09:37:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:15.395 00:14:15.395 real 0m7.525s 00:14:15.395 user 0m23.480s 00:14:15.395 sys 0m1.513s 00:14:15.395 09:37:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:15.395 09:37:38 -- common/autotest_common.sh@10 -- # set +x 00:14:15.395 ************************************ 00:14:15.395 END TEST nvmf_host_management 00:14:15.395 ************************************ 00:14:15.395 09:37:38 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:15.395 00:14:15.395 real 0m9.880s 00:14:15.395 user 0m24.334s 00:14:15.395 sys 0m2.985s 00:14:15.395 09:37:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:15.395 09:37:38 -- common/autotest_common.sh@10 -- # set +x 00:14:15.395 ************************************ 00:14:15.395 END TEST nvmf_host_management 00:14:15.395 ************************************ 00:14:15.395 09:37:38 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:15.395 09:37:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:15.395 09:37:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:15.395 09:37:38 -- common/autotest_common.sh@10 -- # set +x 00:14:15.395 ************************************ 00:14:15.395 START TEST nvmf_lvol 00:14:15.395 ************************************ 00:14:15.395 09:37:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:15.395 * Looking for test storage... 00:14:15.395 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:15.395 09:37:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:15.395 09:37:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:15.395 09:37:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:15.656 09:37:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:15.656 09:37:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:15.656 09:37:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:15.656 09:37:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:15.656 09:37:38 -- scripts/common.sh@335 -- # IFS=.-: 00:14:15.656 09:37:38 -- scripts/common.sh@335 -- # read -ra ver1 00:14:15.656 09:37:38 -- scripts/common.sh@336 -- # IFS=.-: 00:14:15.656 09:37:38 -- scripts/common.sh@336 -- # read -ra ver2 00:14:15.656 09:37:38 -- scripts/common.sh@337 -- # local 'op=<' 00:14:15.656 09:37:38 -- scripts/common.sh@339 -- # ver1_l=2 00:14:15.656 09:37:38 -- scripts/common.sh@340 -- # ver2_l=1 00:14:15.656 09:37:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:15.656 09:37:38 -- scripts/common.sh@343 -- # case "$op" in 00:14:15.656 09:37:38 -- scripts/common.sh@344 -- # : 1 00:14:15.656 09:37:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:15.656 09:37:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:15.656 09:37:38 -- scripts/common.sh@364 -- # decimal 1 00:14:15.656 09:37:38 -- scripts/common.sh@352 -- # local d=1 00:14:15.656 09:37:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:15.656 09:37:38 -- scripts/common.sh@354 -- # echo 1 00:14:15.656 09:37:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:15.656 09:37:38 -- scripts/common.sh@365 -- # decimal 2 00:14:15.656 09:37:38 -- scripts/common.sh@352 -- # local d=2 00:14:15.656 09:37:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:15.656 09:37:38 -- scripts/common.sh@354 -- # echo 2 00:14:15.656 09:37:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:15.656 09:37:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:15.656 09:37:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:15.656 09:37:38 -- scripts/common.sh@367 -- # return 0 00:14:15.656 09:37:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:15.656 09:37:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:15.656 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:15.656 --rc genhtml_branch_coverage=1 00:14:15.656 --rc genhtml_function_coverage=1 00:14:15.656 --rc genhtml_legend=1 00:14:15.656 --rc geninfo_all_blocks=1 00:14:15.656 --rc geninfo_unexecuted_blocks=1 00:14:15.656 00:14:15.656 ' 00:14:15.656 09:37:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:15.656 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:15.656 --rc genhtml_branch_coverage=1 00:14:15.656 --rc genhtml_function_coverage=1 00:14:15.656 --rc genhtml_legend=1 00:14:15.656 --rc geninfo_all_blocks=1 00:14:15.656 --rc geninfo_unexecuted_blocks=1 00:14:15.656 00:14:15.656 ' 00:14:15.656 09:37:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:15.656 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:15.656 --rc genhtml_branch_coverage=1 00:14:15.656 --rc genhtml_function_coverage=1 00:14:15.656 --rc genhtml_legend=1 00:14:15.656 --rc geninfo_all_blocks=1 00:14:15.656 --rc geninfo_unexecuted_blocks=1 00:14:15.656 00:14:15.656 ' 00:14:15.656 09:37:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:15.656 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:15.656 --rc genhtml_branch_coverage=1 00:14:15.656 --rc genhtml_function_coverage=1 00:14:15.656 --rc genhtml_legend=1 00:14:15.656 --rc geninfo_all_blocks=1 00:14:15.657 --rc geninfo_unexecuted_blocks=1 00:14:15.657 00:14:15.657 ' 00:14:15.657 09:37:38 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:15.657 09:37:38 -- nvmf/common.sh@7 -- # uname -s 00:14:15.657 09:37:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:15.657 09:37:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:15.657 09:37:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:15.657 09:37:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:15.657 09:37:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:15.657 09:37:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:15.657 09:37:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:15.657 09:37:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:15.657 09:37:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:15.657 09:37:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:15.657 09:37:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:15.657 09:37:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:15.657 09:37:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:15.657 09:37:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:15.657 09:37:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:15.657 09:37:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:15.657 09:37:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:15.657 09:37:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:15.657 09:37:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:15.657 09:37:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:15.657 09:37:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:15.657 09:37:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:15.657 09:37:38 -- paths/export.sh@5 -- # export PATH 00:14:15.657 09:37:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:15.657 09:37:38 -- nvmf/common.sh@46 -- # : 0 00:14:15.657 09:37:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:15.657 09:37:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:15.657 09:37:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:15.657 09:37:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:15.657 09:37:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:15.657 09:37:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:15.657 09:37:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:15.657 09:37:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:15.657 09:37:38 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:15.657 09:37:38 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:15.657 09:37:38 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:15.657 09:37:38 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:15.657 09:37:38 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:15.657 09:37:38 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:15.657 09:37:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:15.657 09:37:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:15.657 09:37:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:15.657 09:37:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:15.657 09:37:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:15.657 09:37:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:15.657 09:37:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:15.657 09:37:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:15.657 09:37:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:15.657 09:37:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:15.657 09:37:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:15.657 09:37:38 -- common/autotest_common.sh@10 -- # set +x 00:14:17.567 09:37:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:17.567 09:37:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:17.567 09:37:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:17.567 09:37:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:17.567 09:37:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:17.567 09:37:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:17.567 09:37:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:17.567 09:37:40 -- nvmf/common.sh@294 -- # net_devs=() 00:14:17.567 09:37:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:17.567 09:37:40 -- nvmf/common.sh@295 -- # e810=() 00:14:17.567 09:37:40 -- nvmf/common.sh@295 -- # local -ga e810 00:14:17.567 09:37:40 -- nvmf/common.sh@296 -- # x722=() 00:14:17.567 09:37:40 -- nvmf/common.sh@296 -- # local -ga x722 00:14:17.567 09:37:40 -- nvmf/common.sh@297 -- # mlx=() 00:14:17.567 09:37:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:17.567 09:37:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:17.567 09:37:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:17.567 09:37:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:17.567 09:37:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:17.567 09:37:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:17.567 09:37:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:17.567 09:37:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:17.567 09:37:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:17.567 09:37:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:17.567 09:37:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:17.567 09:37:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:17.567 09:37:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:17.567 09:37:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:17.567 09:37:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:17.567 09:37:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:17.567 09:37:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:17.567 09:37:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:17.567 09:37:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:17.567 09:37:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:17.567 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:17.567 09:37:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:17.567 09:37:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:17.567 09:37:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:17.567 09:37:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:17.567 09:37:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:17.568 09:37:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:17.568 09:37:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:17.568 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:17.568 09:37:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:17.568 09:37:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:17.568 09:37:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:17.568 09:37:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:17.568 09:37:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:17.568 09:37:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:17.568 09:37:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:17.568 09:37:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:17.568 09:37:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:17.568 09:37:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:17.568 09:37:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:17.568 09:37:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:17.568 09:37:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:17.568 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:17.568 09:37:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:17.568 09:37:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:17.568 09:37:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:17.568 09:37:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:17.568 09:37:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:17.568 09:37:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:17.568 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:17.568 09:37:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:17.568 09:37:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:17.568 09:37:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:17.568 09:37:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:17.568 09:37:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:17.568 09:37:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:17.568 09:37:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:17.568 09:37:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:17.568 09:37:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:17.568 09:37:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:17.568 09:37:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:17.568 09:37:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:17.568 09:37:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:17.568 09:37:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:17.568 09:37:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:17.568 09:37:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:17.568 09:37:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:17.568 09:37:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:17.568 09:37:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:17.827 09:37:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:17.827 09:37:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:17.827 09:37:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:17.827 09:37:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:17.827 09:37:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:17.827 09:37:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:17.827 09:37:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:17.827 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:17.827 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:14:17.827 00:14:17.827 --- 10.0.0.2 ping statistics --- 00:14:17.827 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:17.827 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:14:17.827 09:37:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:17.827 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:17.827 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:14:17.827 00:14:17.827 --- 10.0.0.1 ping statistics --- 00:14:17.827 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:17.827 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:14:17.827 09:37:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:17.827 09:37:40 -- nvmf/common.sh@410 -- # return 0 00:14:17.827 09:37:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:17.827 09:37:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:17.827 09:37:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:17.827 09:37:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:17.827 09:37:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:17.827 09:37:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:17.827 09:37:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:17.827 09:37:40 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:17.827 09:37:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:17.827 09:37:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:17.827 09:37:40 -- common/autotest_common.sh@10 -- # set +x 00:14:17.827 09:37:40 -- nvmf/common.sh@469 -- # nvmfpid=4960 00:14:17.827 09:37:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:17.827 09:37:40 -- nvmf/common.sh@470 -- # waitforlisten 4960 00:14:17.827 09:37:40 -- common/autotest_common.sh@829 -- # '[' -z 4960 ']' 00:14:17.827 09:37:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:17.827 09:37:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:17.827 09:37:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:17.827 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:17.827 09:37:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:17.827 09:37:40 -- common/autotest_common.sh@10 -- # set +x 00:14:17.827 [2024-11-29 09:37:40.553724] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:17.827 [2024-11-29 09:37:40.553812] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:17.827 EAL: No free 2048 kB hugepages reported on node 1 00:14:17.827 [2024-11-29 09:37:40.626929] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:18.086 [2024-11-29 09:37:40.741937] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:18.086 [2024-11-29 09:37:40.742109] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:18.086 [2024-11-29 09:37:40.742130] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:18.086 [2024-11-29 09:37:40.742145] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:18.086 [2024-11-29 09:37:40.742229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:18.086 [2024-11-29 09:37:40.742301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:18.086 [2024-11-29 09:37:40.742304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:19.022 09:37:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:19.022 09:37:41 -- common/autotest_common.sh@862 -- # return 0 00:14:19.022 09:37:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:19.022 09:37:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:19.022 09:37:41 -- common/autotest_common.sh@10 -- # set +x 00:14:19.022 09:37:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:19.022 09:37:41 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:19.022 [2024-11-29 09:37:41.812456] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:19.022 09:37:41 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:19.589 09:37:42 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:19.589 09:37:42 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:19.589 09:37:42 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:19.589 09:37:42 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:19.847 09:37:42 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:20.107 09:37:42 -- target/nvmf_lvol.sh@29 -- # lvs=00606005-9488-4c61-b642-926450817dab 00:14:20.107 09:37:42 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 00606005-9488-4c61-b642-926450817dab lvol 20 00:14:20.365 09:37:43 -- target/nvmf_lvol.sh@32 -- # lvol=56c366d6-fff9-43f4-a554-1839867e5ee5 00:14:20.365 09:37:43 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:20.624 09:37:43 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 56c366d6-fff9-43f4-a554-1839867e5ee5 00:14:20.882 09:37:43 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:21.140 [2024-11-29 09:37:43.936182] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:21.140 09:37:43 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:21.398 09:37:44 -- target/nvmf_lvol.sh@42 -- # perf_pid=5506 00:14:21.398 09:37:44 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:21.398 09:37:44 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:21.398 EAL: No free 2048 kB hugepages reported on node 1 00:14:22.778 09:37:45 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 56c366d6-fff9-43f4-a554-1839867e5ee5 MY_SNAPSHOT 00:14:22.778 09:37:45 -- target/nvmf_lvol.sh@47 -- # snapshot=c54b26c5-17a9-4348-bf37-3cf7282020ea 00:14:22.778 09:37:45 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 56c366d6-fff9-43f4-a554-1839867e5ee5 30 00:14:23.035 09:37:45 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone c54b26c5-17a9-4348-bf37-3cf7282020ea MY_CLONE 00:14:23.293 09:37:46 -- target/nvmf_lvol.sh@49 -- # clone=a0e92029-cd16-410a-939f-4cf5a5606a5a 00:14:23.293 09:37:46 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate a0e92029-cd16-410a-939f-4cf5a5606a5a 00:14:23.861 09:37:46 -- target/nvmf_lvol.sh@53 -- # wait 5506 00:14:32.077 Initializing NVMe Controllers 00:14:32.077 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:32.077 Controller IO queue size 128, less than required. 00:14:32.077 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:32.077 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:32.077 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:32.077 Initialization complete. Launching workers. 00:14:32.077 ======================================================== 00:14:32.077 Latency(us) 00:14:32.077 Device Information : IOPS MiB/s Average min max 00:14:32.077 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10695.60 41.78 11977.60 2252.60 76094.16 00:14:32.077 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10658.30 41.63 12020.58 2226.41 58084.34 00:14:32.077 ======================================================== 00:14:32.077 Total : 21353.90 83.41 11999.05 2226.41 76094.16 00:14:32.077 00:14:32.077 09:37:54 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:32.077 09:37:54 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 56c366d6-fff9-43f4-a554-1839867e5ee5 00:14:32.335 09:37:55 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 00606005-9488-4c61-b642-926450817dab 00:14:32.594 09:37:55 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:32.594 09:37:55 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:32.594 09:37:55 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:32.594 09:37:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:32.594 09:37:55 -- nvmf/common.sh@116 -- # sync 00:14:32.594 09:37:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:32.594 09:37:55 -- nvmf/common.sh@119 -- # set +e 00:14:32.594 09:37:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:32.594 09:37:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:32.594 rmmod nvme_tcp 00:14:32.853 rmmod nvme_fabrics 00:14:32.853 rmmod nvme_keyring 00:14:32.853 09:37:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:32.853 09:37:55 -- nvmf/common.sh@123 -- # set -e 00:14:32.853 09:37:55 -- nvmf/common.sh@124 -- # return 0 00:14:32.853 09:37:55 -- nvmf/common.sh@477 -- # '[' -n 4960 ']' 00:14:32.853 09:37:55 -- nvmf/common.sh@478 -- # killprocess 4960 00:14:32.853 09:37:55 -- common/autotest_common.sh@936 -- # '[' -z 4960 ']' 00:14:32.853 09:37:55 -- common/autotest_common.sh@940 -- # kill -0 4960 00:14:32.853 09:37:55 -- common/autotest_common.sh@941 -- # uname 00:14:32.853 09:37:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:32.853 09:37:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 4960 00:14:32.853 09:37:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:32.853 09:37:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:32.853 09:37:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 4960' 00:14:32.853 killing process with pid 4960 00:14:32.853 09:37:55 -- common/autotest_common.sh@955 -- # kill 4960 00:14:32.853 09:37:55 -- common/autotest_common.sh@960 -- # wait 4960 00:14:33.112 09:37:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:33.112 09:37:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:33.112 09:37:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:33.112 09:37:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:33.112 09:37:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:33.112 09:37:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:33.112 09:37:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:33.112 09:37:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:35.654 09:37:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:35.654 00:14:35.654 real 0m19.729s 00:14:35.654 user 1m7.378s 00:14:35.654 sys 0m5.278s 00:14:35.654 09:37:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:35.654 09:37:57 -- common/autotest_common.sh@10 -- # set +x 00:14:35.654 ************************************ 00:14:35.654 END TEST nvmf_lvol 00:14:35.654 ************************************ 00:14:35.654 09:37:57 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:35.654 09:37:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:35.654 09:37:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:35.654 09:37:57 -- common/autotest_common.sh@10 -- # set +x 00:14:35.654 ************************************ 00:14:35.654 START TEST nvmf_lvs_grow 00:14:35.654 ************************************ 00:14:35.654 09:37:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:35.654 * Looking for test storage... 00:14:35.654 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:35.654 09:37:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:35.654 09:37:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:35.654 09:37:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:35.654 09:37:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:35.654 09:37:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:35.654 09:37:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:35.654 09:37:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:35.654 09:37:58 -- scripts/common.sh@335 -- # IFS=.-: 00:14:35.654 09:37:58 -- scripts/common.sh@335 -- # read -ra ver1 00:14:35.654 09:37:58 -- scripts/common.sh@336 -- # IFS=.-: 00:14:35.654 09:37:58 -- scripts/common.sh@336 -- # read -ra ver2 00:14:35.654 09:37:58 -- scripts/common.sh@337 -- # local 'op=<' 00:14:35.654 09:37:58 -- scripts/common.sh@339 -- # ver1_l=2 00:14:35.654 09:37:58 -- scripts/common.sh@340 -- # ver2_l=1 00:14:35.654 09:37:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:35.654 09:37:58 -- scripts/common.sh@343 -- # case "$op" in 00:14:35.654 09:37:58 -- scripts/common.sh@344 -- # : 1 00:14:35.654 09:37:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:35.654 09:37:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:35.654 09:37:58 -- scripts/common.sh@364 -- # decimal 1 00:14:35.654 09:37:58 -- scripts/common.sh@352 -- # local d=1 00:14:35.654 09:37:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:35.654 09:37:58 -- scripts/common.sh@354 -- # echo 1 00:14:35.654 09:37:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:35.654 09:37:58 -- scripts/common.sh@365 -- # decimal 2 00:14:35.654 09:37:58 -- scripts/common.sh@352 -- # local d=2 00:14:35.654 09:37:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:35.654 09:37:58 -- scripts/common.sh@354 -- # echo 2 00:14:35.654 09:37:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:35.654 09:37:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:35.654 09:37:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:35.654 09:37:58 -- scripts/common.sh@367 -- # return 0 00:14:35.654 09:37:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:35.654 09:37:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:35.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:35.654 --rc genhtml_branch_coverage=1 00:14:35.654 --rc genhtml_function_coverage=1 00:14:35.654 --rc genhtml_legend=1 00:14:35.654 --rc geninfo_all_blocks=1 00:14:35.654 --rc geninfo_unexecuted_blocks=1 00:14:35.655 00:14:35.655 ' 00:14:35.655 09:37:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:35.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:35.655 --rc genhtml_branch_coverage=1 00:14:35.655 --rc genhtml_function_coverage=1 00:14:35.655 --rc genhtml_legend=1 00:14:35.655 --rc geninfo_all_blocks=1 00:14:35.655 --rc geninfo_unexecuted_blocks=1 00:14:35.655 00:14:35.655 ' 00:14:35.655 09:37:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:35.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:35.655 --rc genhtml_branch_coverage=1 00:14:35.655 --rc genhtml_function_coverage=1 00:14:35.655 --rc genhtml_legend=1 00:14:35.655 --rc geninfo_all_blocks=1 00:14:35.655 --rc geninfo_unexecuted_blocks=1 00:14:35.655 00:14:35.655 ' 00:14:35.655 09:37:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:35.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:35.655 --rc genhtml_branch_coverage=1 00:14:35.655 --rc genhtml_function_coverage=1 00:14:35.655 --rc genhtml_legend=1 00:14:35.655 --rc geninfo_all_blocks=1 00:14:35.655 --rc geninfo_unexecuted_blocks=1 00:14:35.655 00:14:35.655 ' 00:14:35.655 09:37:58 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:35.655 09:37:58 -- nvmf/common.sh@7 -- # uname -s 00:14:35.655 09:37:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:35.655 09:37:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:35.655 09:37:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:35.655 09:37:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:35.655 09:37:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:35.655 09:37:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:35.655 09:37:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:35.655 09:37:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:35.655 09:37:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:35.655 09:37:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:35.655 09:37:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:35.655 09:37:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:35.655 09:37:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:35.655 09:37:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:35.655 09:37:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:35.655 09:37:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:35.655 09:37:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:35.655 09:37:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:35.655 09:37:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:35.655 09:37:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.655 09:37:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.655 09:37:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.655 09:37:58 -- paths/export.sh@5 -- # export PATH 00:14:35.655 09:37:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.655 09:37:58 -- nvmf/common.sh@46 -- # : 0 00:14:35.655 09:37:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:35.655 09:37:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:35.655 09:37:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:35.655 09:37:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:35.655 09:37:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:35.655 09:37:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:35.655 09:37:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:35.655 09:37:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:35.655 09:37:58 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:35.655 09:37:58 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:35.655 09:37:58 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:35.655 09:37:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:35.655 09:37:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:35.655 09:37:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:35.655 09:37:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:35.655 09:37:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:35.655 09:37:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:35.655 09:37:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:35.655 09:37:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:35.655 09:37:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:35.655 09:37:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:35.655 09:37:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:35.655 09:37:58 -- common/autotest_common.sh@10 -- # set +x 00:14:37.564 09:37:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:37.564 09:37:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:37.564 09:37:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:37.564 09:37:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:37.564 09:37:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:37.564 09:37:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:37.564 09:37:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:37.564 09:37:59 -- nvmf/common.sh@294 -- # net_devs=() 00:14:37.564 09:37:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:37.564 09:37:59 -- nvmf/common.sh@295 -- # e810=() 00:14:37.564 09:37:59 -- nvmf/common.sh@295 -- # local -ga e810 00:14:37.564 09:37:59 -- nvmf/common.sh@296 -- # x722=() 00:14:37.564 09:37:59 -- nvmf/common.sh@296 -- # local -ga x722 00:14:37.564 09:37:59 -- nvmf/common.sh@297 -- # mlx=() 00:14:37.564 09:37:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:37.564 09:37:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:37.564 09:37:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:37.564 09:37:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:37.564 09:37:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:37.564 09:37:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:37.564 09:37:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:37.564 09:37:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:37.564 09:37:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:37.564 09:37:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:37.564 09:37:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:37.564 09:37:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:37.564 09:37:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:37.564 09:37:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:37.564 09:37:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:37.564 09:37:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:37.564 09:37:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:37.564 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:37.564 09:37:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:37.564 09:37:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:37.564 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:37.564 09:37:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:37.564 09:37:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:37.564 09:37:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:37.564 09:37:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:37.564 09:37:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:37.564 09:37:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:37.564 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:37.564 09:37:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:37.564 09:37:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:37.564 09:37:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:37.564 09:37:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:37.564 09:37:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:37.564 09:37:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:37.564 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:37.564 09:37:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:37.564 09:37:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:37.564 09:37:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:37.564 09:37:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:37.564 09:37:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:37.564 09:37:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:37.564 09:37:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:37.564 09:37:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:37.564 09:37:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:37.564 09:37:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:37.564 09:37:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:37.564 09:37:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:37.564 09:37:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:37.564 09:37:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:37.564 09:37:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:37.564 09:37:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:37.564 09:37:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:37.564 09:37:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:37.564 09:38:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:37.564 09:38:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:37.564 09:38:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:37.564 09:38:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:37.564 09:38:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:37.564 09:38:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:37.564 09:38:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:37.564 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:37.564 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.215 ms 00:14:37.564 00:14:37.564 --- 10.0.0.2 ping statistics --- 00:14:37.564 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:37.564 rtt min/avg/max/mdev = 0.215/0.215/0.215/0.000 ms 00:14:37.564 09:38:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:37.564 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:37.564 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:14:37.564 00:14:37.564 --- 10.0.0.1 ping statistics --- 00:14:37.564 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:37.564 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:14:37.564 09:38:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:37.564 09:38:00 -- nvmf/common.sh@410 -- # return 0 00:14:37.564 09:38:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:37.564 09:38:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:37.564 09:38:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:37.564 09:38:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:37.564 09:38:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:37.564 09:38:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:37.564 09:38:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:37.564 09:38:00 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:37.564 09:38:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:37.564 09:38:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:37.564 09:38:00 -- common/autotest_common.sh@10 -- # set +x 00:14:37.564 09:38:00 -- nvmf/common.sh@469 -- # nvmfpid=8836 00:14:37.564 09:38:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:37.564 09:38:00 -- nvmf/common.sh@470 -- # waitforlisten 8836 00:14:37.564 09:38:00 -- common/autotest_common.sh@829 -- # '[' -z 8836 ']' 00:14:37.564 09:38:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:37.565 09:38:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:37.565 09:38:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:37.565 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:37.565 09:38:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:37.565 09:38:00 -- common/autotest_common.sh@10 -- # set +x 00:14:37.565 [2024-11-29 09:38:00.188038] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:37.565 [2024-11-29 09:38:00.188151] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:37.565 EAL: No free 2048 kB hugepages reported on node 1 00:14:37.565 [2024-11-29 09:38:00.256739] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:37.565 [2024-11-29 09:38:00.371858] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:37.565 [2024-11-29 09:38:00.372040] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:37.565 [2024-11-29 09:38:00.372061] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:37.565 [2024-11-29 09:38:00.372075] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:37.565 [2024-11-29 09:38:00.372104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:38.499 09:38:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:38.499 09:38:01 -- common/autotest_common.sh@862 -- # return 0 00:14:38.499 09:38:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:38.499 09:38:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:38.499 09:38:01 -- common/autotest_common.sh@10 -- # set +x 00:14:38.499 09:38:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:38.499 09:38:01 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:38.756 [2024-11-29 09:38:01.463137] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:38.756 09:38:01 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:38.756 09:38:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:38.756 09:38:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:38.756 09:38:01 -- common/autotest_common.sh@10 -- # set +x 00:14:38.756 ************************************ 00:14:38.756 START TEST lvs_grow_clean 00:14:38.756 ************************************ 00:14:38.756 09:38:01 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:38.756 09:38:01 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:38.756 09:38:01 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:38.756 09:38:01 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:38.756 09:38:01 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:38.756 09:38:01 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:38.756 09:38:01 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:38.756 09:38:01 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:38.756 09:38:01 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:38.756 09:38:01 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:39.012 09:38:01 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:39.012 09:38:01 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:39.270 09:38:02 -- target/nvmf_lvs_grow.sh@28 -- # lvs=83cedb7f-9758-407c-8437-0d932c4173c2 00:14:39.527 09:38:02 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 83cedb7f-9758-407c-8437-0d932c4173c2 00:14:39.527 09:38:02 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:39.527 09:38:02 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:39.527 09:38:02 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:39.527 09:38:02 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 83cedb7f-9758-407c-8437-0d932c4173c2 lvol 150 00:14:40.124 09:38:02 -- target/nvmf_lvs_grow.sh@33 -- # lvol=df0faa31-91f5-48c3-b030-be9fc75e6f22 00:14:40.124 09:38:02 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:40.124 09:38:02 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:40.124 [2024-11-29 09:38:02.880981] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:40.124 [2024-11-29 09:38:02.881076] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:40.124 true 00:14:40.124 09:38:02 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 83cedb7f-9758-407c-8437-0d932c4173c2 00:14:40.124 09:38:02 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:40.382 09:38:03 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:40.382 09:38:03 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:40.638 09:38:03 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 df0faa31-91f5-48c3-b030-be9fc75e6f22 00:14:40.894 09:38:03 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:41.151 [2024-11-29 09:38:03.944237] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:41.151 09:38:03 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:41.718 09:38:04 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=9325 00:14:41.718 09:38:04 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:41.718 09:38:04 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:41.718 09:38:04 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 9325 /var/tmp/bdevperf.sock 00:14:41.718 09:38:04 -- common/autotest_common.sh@829 -- # '[' -z 9325 ']' 00:14:41.718 09:38:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:41.718 09:38:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:41.718 09:38:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:41.718 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:41.718 09:38:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:41.718 09:38:04 -- common/autotest_common.sh@10 -- # set +x 00:14:41.718 [2024-11-29 09:38:04.297969] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:41.718 [2024-11-29 09:38:04.298040] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid9325 ] 00:14:41.718 EAL: No free 2048 kB hugepages reported on node 1 00:14:41.718 [2024-11-29 09:38:04.360768] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:41.718 [2024-11-29 09:38:04.474807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:42.655 09:38:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:42.656 09:38:05 -- common/autotest_common.sh@862 -- # return 0 00:14:42.656 09:38:05 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:42.913 Nvme0n1 00:14:42.913 09:38:05 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:43.171 [ 00:14:43.171 { 00:14:43.171 "name": "Nvme0n1", 00:14:43.171 "aliases": [ 00:14:43.171 "df0faa31-91f5-48c3-b030-be9fc75e6f22" 00:14:43.171 ], 00:14:43.171 "product_name": "NVMe disk", 00:14:43.171 "block_size": 4096, 00:14:43.171 "num_blocks": 38912, 00:14:43.171 "uuid": "df0faa31-91f5-48c3-b030-be9fc75e6f22", 00:14:43.171 "assigned_rate_limits": { 00:14:43.171 "rw_ios_per_sec": 0, 00:14:43.171 "rw_mbytes_per_sec": 0, 00:14:43.171 "r_mbytes_per_sec": 0, 00:14:43.171 "w_mbytes_per_sec": 0 00:14:43.171 }, 00:14:43.171 "claimed": false, 00:14:43.171 "zoned": false, 00:14:43.171 "supported_io_types": { 00:14:43.171 "read": true, 00:14:43.171 "write": true, 00:14:43.171 "unmap": true, 00:14:43.171 "write_zeroes": true, 00:14:43.171 "flush": true, 00:14:43.171 "reset": true, 00:14:43.171 "compare": true, 00:14:43.171 "compare_and_write": true, 00:14:43.171 "abort": true, 00:14:43.171 "nvme_admin": true, 00:14:43.171 "nvme_io": true 00:14:43.171 }, 00:14:43.171 "driver_specific": { 00:14:43.171 "nvme": [ 00:14:43.171 { 00:14:43.171 "trid": { 00:14:43.171 "trtype": "TCP", 00:14:43.171 "adrfam": "IPv4", 00:14:43.171 "traddr": "10.0.0.2", 00:14:43.171 "trsvcid": "4420", 00:14:43.171 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:43.171 }, 00:14:43.171 "ctrlr_data": { 00:14:43.171 "cntlid": 1, 00:14:43.171 "vendor_id": "0x8086", 00:14:43.171 "model_number": "SPDK bdev Controller", 00:14:43.171 "serial_number": "SPDK0", 00:14:43.171 "firmware_revision": "24.01.1", 00:14:43.171 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:43.171 "oacs": { 00:14:43.171 "security": 0, 00:14:43.171 "format": 0, 00:14:43.171 "firmware": 0, 00:14:43.171 "ns_manage": 0 00:14:43.171 }, 00:14:43.171 "multi_ctrlr": true, 00:14:43.171 "ana_reporting": false 00:14:43.171 }, 00:14:43.171 "vs": { 00:14:43.171 "nvme_version": "1.3" 00:14:43.171 }, 00:14:43.171 "ns_data": { 00:14:43.171 "id": 1, 00:14:43.171 "can_share": true 00:14:43.171 } 00:14:43.171 } 00:14:43.171 ], 00:14:43.171 "mp_policy": "active_passive" 00:14:43.171 } 00:14:43.171 } 00:14:43.171 ] 00:14:43.171 09:38:05 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=9570 00:14:43.171 09:38:05 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:43.171 09:38:05 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:43.432 Running I/O for 10 seconds... 00:14:44.372 Latency(us) 00:14:44.372 [2024-11-29T08:38:07.215Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:44.372 [2024-11-29T08:38:07.215Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:44.372 Nvme0n1 : 1.00 14209.00 55.50 0.00 0.00 0.00 0.00 0.00 00:14:44.372 [2024-11-29T08:38:07.215Z] =================================================================================================================== 00:14:44.372 [2024-11-29T08:38:07.216Z] Total : 14209.00 55.50 0.00 0.00 0.00 0.00 0.00 00:14:44.373 00:14:45.312 09:38:07 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 83cedb7f-9758-407c-8437-0d932c4173c2 00:14:45.312 [2024-11-29T08:38:08.155Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:45.312 Nvme0n1 : 2.00 14447.50 56.44 0.00 0.00 0.00 0.00 0.00 00:14:45.312 [2024-11-29T08:38:08.155Z] =================================================================================================================== 00:14:45.312 [2024-11-29T08:38:08.155Z] Total : 14447.50 56.44 0.00 0.00 0.00 0.00 0.00 00:14:45.312 00:14:45.570 true 00:14:45.570 09:38:08 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 83cedb7f-9758-407c-8437-0d932c4173c2 00:14:45.570 09:38:08 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:45.829 09:38:08 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:45.829 09:38:08 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:45.829 09:38:08 -- target/nvmf_lvs_grow.sh@65 -- # wait 9570 00:14:46.400 [2024-11-29T08:38:09.243Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:46.400 Nvme0n1 : 3.00 14529.00 56.75 0.00 0.00 0.00 0.00 0.00 00:14:46.400 [2024-11-29T08:38:09.243Z] =================================================================================================================== 00:14:46.400 [2024-11-29T08:38:09.243Z] Total : 14529.00 56.75 0.00 0.00 0.00 0.00 0.00 00:14:46.400 00:14:47.337 [2024-11-29T08:38:10.180Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:47.337 Nvme0n1 : 4.00 14599.25 57.03 0.00 0.00 0.00 0.00 0.00 00:14:47.337 [2024-11-29T08:38:10.180Z] =================================================================================================================== 00:14:47.337 [2024-11-29T08:38:10.180Z] Total : 14599.25 57.03 0.00 0.00 0.00 0.00 0.00 00:14:47.337 00:14:48.273 [2024-11-29T08:38:11.116Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:48.273 Nvme0n1 : 5.00 14632.00 57.16 0.00 0.00 0.00 0.00 0.00 00:14:48.273 [2024-11-29T08:38:11.116Z] =================================================================================================================== 00:14:48.273 [2024-11-29T08:38:11.116Z] Total : 14632.00 57.16 0.00 0.00 0.00 0.00 0.00 00:14:48.273 00:14:49.655 [2024-11-29T08:38:12.498Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:49.655 Nvme0n1 : 6.00 14697.00 57.41 0.00 0.00 0.00 0.00 0.00 00:14:49.655 [2024-11-29T08:38:12.498Z] =================================================================================================================== 00:14:49.655 [2024-11-29T08:38:12.498Z] Total : 14697.00 57.41 0.00 0.00 0.00 0.00 0.00 00:14:49.655 00:14:50.594 [2024-11-29T08:38:13.437Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:50.594 Nvme0n1 : 7.00 14795.71 57.80 0.00 0.00 0.00 0.00 0.00 00:14:50.594 [2024-11-29T08:38:13.437Z] =================================================================================================================== 00:14:50.594 [2024-11-29T08:38:13.437Z] Total : 14795.71 57.80 0.00 0.00 0.00 0.00 0.00 00:14:50.594 00:14:51.531 [2024-11-29T08:38:14.374Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:51.531 Nvme0n1 : 8.00 14817.00 57.88 0.00 0.00 0.00 0.00 0.00 00:14:51.531 [2024-11-29T08:38:14.374Z] =================================================================================================================== 00:14:51.531 [2024-11-29T08:38:14.374Z] Total : 14817.00 57.88 0.00 0.00 0.00 0.00 0.00 00:14:51.531 00:14:52.471 [2024-11-29T08:38:15.315Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:52.472 Nvme0n1 : 9.00 14847.33 58.00 0.00 0.00 0.00 0.00 0.00 00:14:52.472 [2024-11-29T08:38:15.315Z] =================================================================================================================== 00:14:52.472 [2024-11-29T08:38:15.315Z] Total : 14847.33 58.00 0.00 0.00 0.00 0.00 0.00 00:14:52.472 00:14:53.409 [2024-11-29T08:38:16.252Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:53.409 Nvme0n1 : 10.00 14919.60 58.28 0.00 0.00 0.00 0.00 0.00 00:14:53.409 [2024-11-29T08:38:16.252Z] =================================================================================================================== 00:14:53.409 [2024-11-29T08:38:16.252Z] Total : 14919.60 58.28 0.00 0.00 0.00 0.00 0.00 00:14:53.409 00:14:53.409 00:14:53.409 Latency(us) 00:14:53.409 [2024-11-29T08:38:16.252Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:53.409 [2024-11-29T08:38:16.252Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:53.409 Nvme0n1 : 10.01 14920.20 58.28 0.00 0.00 8574.30 5048.70 20777.34 00:14:53.409 [2024-11-29T08:38:16.252Z] =================================================================================================================== 00:14:53.409 [2024-11-29T08:38:16.252Z] Total : 14920.20 58.28 0.00 0.00 8574.30 5048.70 20777.34 00:14:53.409 0 00:14:53.409 09:38:16 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 9325 00:14:53.409 09:38:16 -- common/autotest_common.sh@936 -- # '[' -z 9325 ']' 00:14:53.409 09:38:16 -- common/autotest_common.sh@940 -- # kill -0 9325 00:14:53.409 09:38:16 -- common/autotest_common.sh@941 -- # uname 00:14:53.409 09:38:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:53.409 09:38:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 9325 00:14:53.409 09:38:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:53.409 09:38:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:53.409 09:38:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 9325' 00:14:53.409 killing process with pid 9325 00:14:53.409 09:38:16 -- common/autotest_common.sh@955 -- # kill 9325 00:14:53.409 Received shutdown signal, test time was about 10.000000 seconds 00:14:53.409 00:14:53.409 Latency(us) 00:14:53.409 [2024-11-29T08:38:16.252Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:53.409 [2024-11-29T08:38:16.252Z] =================================================================================================================== 00:14:53.409 [2024-11-29T08:38:16.252Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:53.409 09:38:16 -- common/autotest_common.sh@960 -- # wait 9325 00:14:53.668 09:38:16 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:53.926 09:38:16 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 83cedb7f-9758-407c-8437-0d932c4173c2 00:14:53.926 09:38:16 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:54.492 09:38:17 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:54.492 09:38:17 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:54.492 09:38:17 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:54.492 [2024-11-29 09:38:17.298333] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:54.753 09:38:17 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 83cedb7f-9758-407c-8437-0d932c4173c2 00:14:54.753 09:38:17 -- common/autotest_common.sh@650 -- # local es=0 00:14:54.753 09:38:17 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 83cedb7f-9758-407c-8437-0d932c4173c2 00:14:54.753 09:38:17 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:54.753 09:38:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:54.753 09:38:17 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:54.753 09:38:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:54.753 09:38:17 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:54.753 09:38:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:54.753 09:38:17 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:54.753 09:38:17 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:54.753 09:38:17 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 83cedb7f-9758-407c-8437-0d932c4173c2 00:14:54.753 request: 00:14:54.753 { 00:14:54.753 "uuid": "83cedb7f-9758-407c-8437-0d932c4173c2", 00:14:54.753 "method": "bdev_lvol_get_lvstores", 00:14:54.753 "req_id": 1 00:14:54.753 } 00:14:54.753 Got JSON-RPC error response 00:14:54.753 response: 00:14:54.753 { 00:14:54.753 "code": -19, 00:14:54.753 "message": "No such device" 00:14:54.753 } 00:14:54.753 09:38:17 -- common/autotest_common.sh@653 -- # es=1 00:14:54.753 09:38:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:54.753 09:38:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:54.753 09:38:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:54.753 09:38:17 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:55.013 aio_bdev 00:14:55.013 09:38:17 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev df0faa31-91f5-48c3-b030-be9fc75e6f22 00:14:55.013 09:38:17 -- common/autotest_common.sh@897 -- # local bdev_name=df0faa31-91f5-48c3-b030-be9fc75e6f22 00:14:55.013 09:38:17 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:55.013 09:38:17 -- common/autotest_common.sh@899 -- # local i 00:14:55.013 09:38:17 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:55.013 09:38:17 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:55.013 09:38:17 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:55.272 09:38:18 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b df0faa31-91f5-48c3-b030-be9fc75e6f22 -t 2000 00:14:55.531 [ 00:14:55.531 { 00:14:55.531 "name": "df0faa31-91f5-48c3-b030-be9fc75e6f22", 00:14:55.531 "aliases": [ 00:14:55.531 "lvs/lvol" 00:14:55.531 ], 00:14:55.531 "product_name": "Logical Volume", 00:14:55.531 "block_size": 4096, 00:14:55.531 "num_blocks": 38912, 00:14:55.531 "uuid": "df0faa31-91f5-48c3-b030-be9fc75e6f22", 00:14:55.531 "assigned_rate_limits": { 00:14:55.531 "rw_ios_per_sec": 0, 00:14:55.531 "rw_mbytes_per_sec": 0, 00:14:55.531 "r_mbytes_per_sec": 0, 00:14:55.531 "w_mbytes_per_sec": 0 00:14:55.531 }, 00:14:55.531 "claimed": false, 00:14:55.531 "zoned": false, 00:14:55.531 "supported_io_types": { 00:14:55.531 "read": true, 00:14:55.531 "write": true, 00:14:55.531 "unmap": true, 00:14:55.531 "write_zeroes": true, 00:14:55.531 "flush": false, 00:14:55.531 "reset": true, 00:14:55.531 "compare": false, 00:14:55.531 "compare_and_write": false, 00:14:55.531 "abort": false, 00:14:55.531 "nvme_admin": false, 00:14:55.531 "nvme_io": false 00:14:55.531 }, 00:14:55.531 "driver_specific": { 00:14:55.531 "lvol": { 00:14:55.531 "lvol_store_uuid": "83cedb7f-9758-407c-8437-0d932c4173c2", 00:14:55.531 "base_bdev": "aio_bdev", 00:14:55.531 "thin_provision": false, 00:14:55.531 "snapshot": false, 00:14:55.531 "clone": false, 00:14:55.531 "esnap_clone": false 00:14:55.531 } 00:14:55.531 } 00:14:55.531 } 00:14:55.531 ] 00:14:55.531 09:38:18 -- common/autotest_common.sh@905 -- # return 0 00:14:55.531 09:38:18 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 83cedb7f-9758-407c-8437-0d932c4173c2 00:14:55.531 09:38:18 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:55.791 09:38:18 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:55.791 09:38:18 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 83cedb7f-9758-407c-8437-0d932c4173c2 00:14:55.791 09:38:18 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:56.051 09:38:18 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:56.051 09:38:18 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete df0faa31-91f5-48c3-b030-be9fc75e6f22 00:14:56.312 09:38:19 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 83cedb7f-9758-407c-8437-0d932c4173c2 00:14:56.571 09:38:19 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:56.830 09:38:19 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:56.830 00:14:56.830 real 0m18.167s 00:14:56.830 user 0m17.893s 00:14:56.830 sys 0m1.789s 00:14:56.830 09:38:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:56.830 09:38:19 -- common/autotest_common.sh@10 -- # set +x 00:14:56.830 ************************************ 00:14:56.830 END TEST lvs_grow_clean 00:14:56.830 ************************************ 00:14:57.090 09:38:19 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:57.090 09:38:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:57.090 09:38:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:57.090 09:38:19 -- common/autotest_common.sh@10 -- # set +x 00:14:57.090 ************************************ 00:14:57.090 START TEST lvs_grow_dirty 00:14:57.090 ************************************ 00:14:57.090 09:38:19 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:14:57.090 09:38:19 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:57.090 09:38:19 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:57.090 09:38:19 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:57.090 09:38:19 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:57.090 09:38:19 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:57.090 09:38:19 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:57.090 09:38:19 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:57.090 09:38:19 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:57.090 09:38:19 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:57.348 09:38:19 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:57.348 09:38:19 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:57.608 09:38:20 -- target/nvmf_lvs_grow.sh@28 -- # lvs=d1e9d021-3980-47f5-8d6e-f1525de58e15 00:14:57.608 09:38:20 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d1e9d021-3980-47f5-8d6e-f1525de58e15 00:14:57.608 09:38:20 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:57.867 09:38:20 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:57.867 09:38:20 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:57.867 09:38:20 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u d1e9d021-3980-47f5-8d6e-f1525de58e15 lvol 150 00:14:58.127 09:38:20 -- target/nvmf_lvs_grow.sh@33 -- # lvol=600574c2-ab76-4fbd-be7b-32ad715b7fd1 00:14:58.127 09:38:20 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:58.127 09:38:20 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:58.386 [2024-11-29 09:38:21.002844] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:58.386 [2024-11-29 09:38:21.002931] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:58.386 true 00:14:58.386 09:38:21 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d1e9d021-3980-47f5-8d6e-f1525de58e15 00:14:58.386 09:38:21 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:58.644 09:38:21 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:58.644 09:38:21 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:58.904 09:38:21 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 600574c2-ab76-4fbd-be7b-32ad715b7fd1 00:14:59.164 09:38:21 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:59.424 09:38:22 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:59.683 09:38:22 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=11556 00:14:59.683 09:38:22 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:59.683 09:38:22 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:59.683 09:38:22 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 11556 /var/tmp/bdevperf.sock 00:14:59.683 09:38:22 -- common/autotest_common.sh@829 -- # '[' -z 11556 ']' 00:14:59.683 09:38:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:59.683 09:38:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:59.683 09:38:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:59.683 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:59.683 09:38:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:59.683 09:38:22 -- common/autotest_common.sh@10 -- # set +x 00:14:59.683 [2024-11-29 09:38:22.323177] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:59.683 [2024-11-29 09:38:22.323248] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid11556 ] 00:14:59.683 EAL: No free 2048 kB hugepages reported on node 1 00:14:59.683 [2024-11-29 09:38:22.383444] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:59.683 [2024-11-29 09:38:22.499797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:00.619 09:38:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:00.619 09:38:23 -- common/autotest_common.sh@862 -- # return 0 00:15:00.619 09:38:23 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:00.878 Nvme0n1 00:15:00.878 09:38:23 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:01.445 [ 00:15:01.445 { 00:15:01.445 "name": "Nvme0n1", 00:15:01.445 "aliases": [ 00:15:01.445 "600574c2-ab76-4fbd-be7b-32ad715b7fd1" 00:15:01.445 ], 00:15:01.445 "product_name": "NVMe disk", 00:15:01.445 "block_size": 4096, 00:15:01.445 "num_blocks": 38912, 00:15:01.445 "uuid": "600574c2-ab76-4fbd-be7b-32ad715b7fd1", 00:15:01.445 "assigned_rate_limits": { 00:15:01.445 "rw_ios_per_sec": 0, 00:15:01.445 "rw_mbytes_per_sec": 0, 00:15:01.445 "r_mbytes_per_sec": 0, 00:15:01.445 "w_mbytes_per_sec": 0 00:15:01.445 }, 00:15:01.445 "claimed": false, 00:15:01.445 "zoned": false, 00:15:01.445 "supported_io_types": { 00:15:01.445 "read": true, 00:15:01.445 "write": true, 00:15:01.445 "unmap": true, 00:15:01.445 "write_zeroes": true, 00:15:01.445 "flush": true, 00:15:01.445 "reset": true, 00:15:01.445 "compare": true, 00:15:01.445 "compare_and_write": true, 00:15:01.445 "abort": true, 00:15:01.445 "nvme_admin": true, 00:15:01.445 "nvme_io": true 00:15:01.445 }, 00:15:01.445 "driver_specific": { 00:15:01.445 "nvme": [ 00:15:01.445 { 00:15:01.445 "trid": { 00:15:01.445 "trtype": "TCP", 00:15:01.445 "adrfam": "IPv4", 00:15:01.445 "traddr": "10.0.0.2", 00:15:01.445 "trsvcid": "4420", 00:15:01.445 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:01.445 }, 00:15:01.445 "ctrlr_data": { 00:15:01.445 "cntlid": 1, 00:15:01.445 "vendor_id": "0x8086", 00:15:01.445 "model_number": "SPDK bdev Controller", 00:15:01.445 "serial_number": "SPDK0", 00:15:01.445 "firmware_revision": "24.01.1", 00:15:01.445 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:01.445 "oacs": { 00:15:01.445 "security": 0, 00:15:01.445 "format": 0, 00:15:01.445 "firmware": 0, 00:15:01.445 "ns_manage": 0 00:15:01.445 }, 00:15:01.445 "multi_ctrlr": true, 00:15:01.445 "ana_reporting": false 00:15:01.445 }, 00:15:01.445 "vs": { 00:15:01.445 "nvme_version": "1.3" 00:15:01.445 }, 00:15:01.445 "ns_data": { 00:15:01.445 "id": 1, 00:15:01.445 "can_share": true 00:15:01.445 } 00:15:01.445 } 00:15:01.445 ], 00:15:01.445 "mp_policy": "active_passive" 00:15:01.445 } 00:15:01.445 } 00:15:01.445 ] 00:15:01.445 09:38:23 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=11823 00:15:01.445 09:38:23 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:01.445 09:38:23 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:01.445 Running I/O for 10 seconds... 00:15:02.386 Latency(us) 00:15:02.386 [2024-11-29T08:38:25.229Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:02.386 [2024-11-29T08:38:25.229Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.386 Nvme0n1 : 1.00 15185.00 59.32 0.00 0.00 0.00 0.00 0.00 00:15:02.386 [2024-11-29T08:38:25.229Z] =================================================================================================================== 00:15:02.386 [2024-11-29T08:38:25.229Z] Total : 15185.00 59.32 0.00 0.00 0.00 0.00 0.00 00:15:02.386 00:15:03.321 09:38:26 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u d1e9d021-3980-47f5-8d6e-f1525de58e15 00:15:03.321 [2024-11-29T08:38:26.164Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:03.321 Nvme0n1 : 2.00 15159.00 59.21 0.00 0.00 0.00 0.00 0.00 00:15:03.321 [2024-11-29T08:38:26.164Z] =================================================================================================================== 00:15:03.321 [2024-11-29T08:38:26.164Z] Total : 15159.00 59.21 0.00 0.00 0.00 0.00 0.00 00:15:03.321 00:15:03.630 true 00:15:03.631 09:38:26 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d1e9d021-3980-47f5-8d6e-f1525de58e15 00:15:03.631 09:38:26 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:03.933 09:38:26 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:03.933 09:38:26 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:03.933 09:38:26 -- target/nvmf_lvs_grow.sh@65 -- # wait 11823 00:15:04.501 [2024-11-29T08:38:27.344Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:04.501 Nvme0n1 : 3.00 15188.33 59.33 0.00 0.00 0.00 0.00 0.00 00:15:04.501 [2024-11-29T08:38:27.344Z] =================================================================================================================== 00:15:04.501 [2024-11-29T08:38:27.344Z] Total : 15188.33 59.33 0.00 0.00 0.00 0.00 0.00 00:15:04.501 00:15:05.440 [2024-11-29T08:38:28.283Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:05.440 Nvme0n1 : 4.00 15222.25 59.46 0.00 0.00 0.00 0.00 0.00 00:15:05.440 [2024-11-29T08:38:28.283Z] =================================================================================================================== 00:15:05.440 [2024-11-29T08:38:28.283Z] Total : 15222.25 59.46 0.00 0.00 0.00 0.00 0.00 00:15:05.440 00:15:06.377 [2024-11-29T08:38:29.220Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:06.377 Nvme0n1 : 5.00 15266.60 59.64 0.00 0.00 0.00 0.00 0.00 00:15:06.377 [2024-11-29T08:38:29.220Z] =================================================================================================================== 00:15:06.377 [2024-11-29T08:38:29.220Z] Total : 15266.60 59.64 0.00 0.00 0.00 0.00 0.00 00:15:06.377 00:15:07.317 [2024-11-29T08:38:30.160Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:07.317 Nvme0n1 : 6.00 15270.67 59.65 0.00 0.00 0.00 0.00 0.00 00:15:07.317 [2024-11-29T08:38:30.160Z] =================================================================================================================== 00:15:07.317 [2024-11-29T08:38:30.160Z] Total : 15270.67 59.65 0.00 0.00 0.00 0.00 0.00 00:15:07.317 00:15:08.694 [2024-11-29T08:38:31.537Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:08.694 Nvme0n1 : 7.00 15368.14 60.03 0.00 0.00 0.00 0.00 0.00 00:15:08.694 [2024-11-29T08:38:31.537Z] =================================================================================================================== 00:15:08.694 [2024-11-29T08:38:31.537Z] Total : 15368.14 60.03 0.00 0.00 0.00 0.00 0.00 00:15:08.694 00:15:09.632 [2024-11-29T08:38:32.475Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:09.632 Nvme0n1 : 8.00 15429.00 60.27 0.00 0.00 0.00 0.00 0.00 00:15:09.632 [2024-11-29T08:38:32.475Z] =================================================================================================================== 00:15:09.632 [2024-11-29T08:38:32.475Z] Total : 15429.00 60.27 0.00 0.00 0.00 0.00 0.00 00:15:09.632 00:15:10.568 [2024-11-29T08:38:33.411Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:10.568 Nvme0n1 : 9.00 15445.78 60.34 0.00 0.00 0.00 0.00 0.00 00:15:10.568 [2024-11-29T08:38:33.411Z] =================================================================================================================== 00:15:10.568 [2024-11-29T08:38:33.411Z] Total : 15445.78 60.34 0.00 0.00 0.00 0.00 0.00 00:15:10.568 00:15:11.508 [2024-11-29T08:38:34.351Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:11.508 Nvme0n1 : 10.00 15454.20 60.37 0.00 0.00 0.00 0.00 0.00 00:15:11.508 [2024-11-29T08:38:34.351Z] =================================================================================================================== 00:15:11.508 [2024-11-29T08:38:34.351Z] Total : 15454.20 60.37 0.00 0.00 0.00 0.00 0.00 00:15:11.508 00:15:11.508 00:15:11.508 Latency(us) 00:15:11.508 [2024-11-29T08:38:34.351Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:11.508 [2024-11-29T08:38:34.351Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:11.508 Nvme0n1 : 10.00 15460.04 60.39 0.00 0.00 8275.01 4708.88 15437.37 00:15:11.508 [2024-11-29T08:38:34.351Z] =================================================================================================================== 00:15:11.508 [2024-11-29T08:38:34.351Z] Total : 15460.04 60.39 0.00 0.00 8275.01 4708.88 15437.37 00:15:11.508 0 00:15:11.508 09:38:34 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 11556 00:15:11.508 09:38:34 -- common/autotest_common.sh@936 -- # '[' -z 11556 ']' 00:15:11.508 09:38:34 -- common/autotest_common.sh@940 -- # kill -0 11556 00:15:11.508 09:38:34 -- common/autotest_common.sh@941 -- # uname 00:15:11.508 09:38:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:11.508 09:38:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 11556 00:15:11.508 09:38:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:11.508 09:38:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:11.508 09:38:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 11556' 00:15:11.508 killing process with pid 11556 00:15:11.508 09:38:34 -- common/autotest_common.sh@955 -- # kill 11556 00:15:11.508 Received shutdown signal, test time was about 10.000000 seconds 00:15:11.508 00:15:11.508 Latency(us) 00:15:11.508 [2024-11-29T08:38:34.351Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:11.508 [2024-11-29T08:38:34.351Z] =================================================================================================================== 00:15:11.508 [2024-11-29T08:38:34.351Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:11.508 09:38:34 -- common/autotest_common.sh@960 -- # wait 11556 00:15:11.767 09:38:34 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:12.025 09:38:34 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d1e9d021-3980-47f5-8d6e-f1525de58e15 00:15:12.025 09:38:34 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:12.283 09:38:35 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:12.283 09:38:35 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:12.283 09:38:35 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 8836 00:15:12.283 09:38:35 -- target/nvmf_lvs_grow.sh@74 -- # wait 8836 00:15:12.283 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 8836 Killed "${NVMF_APP[@]}" "$@" 00:15:12.283 09:38:35 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:12.283 09:38:35 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:12.283 09:38:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:12.283 09:38:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:12.283 09:38:35 -- common/autotest_common.sh@10 -- # set +x 00:15:12.283 09:38:35 -- nvmf/common.sh@469 -- # nvmfpid=13192 00:15:12.283 09:38:35 -- nvmf/common.sh@470 -- # waitforlisten 13192 00:15:12.283 09:38:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:12.283 09:38:35 -- common/autotest_common.sh@829 -- # '[' -z 13192 ']' 00:15:12.283 09:38:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:12.283 09:38:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:12.283 09:38:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:12.283 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:12.283 09:38:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:12.283 09:38:35 -- common/autotest_common.sh@10 -- # set +x 00:15:12.283 [2024-11-29 09:38:35.103429] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:12.283 [2024-11-29 09:38:35.103521] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:12.543 EAL: No free 2048 kB hugepages reported on node 1 00:15:12.543 [2024-11-29 09:38:35.175030] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:12.543 [2024-11-29 09:38:35.287970] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:12.543 [2024-11-29 09:38:35.288151] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:12.543 [2024-11-29 09:38:35.288172] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:12.543 [2024-11-29 09:38:35.288187] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:12.543 [2024-11-29 09:38:35.288233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:13.480 09:38:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:13.480 09:38:36 -- common/autotest_common.sh@862 -- # return 0 00:15:13.480 09:38:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:13.480 09:38:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:13.480 09:38:36 -- common/autotest_common.sh@10 -- # set +x 00:15:13.480 09:38:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:13.480 09:38:36 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:13.738 [2024-11-29 09:38:36.325926] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:13.738 [2024-11-29 09:38:36.326075] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:13.738 [2024-11-29 09:38:36.326124] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:13.738 09:38:36 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:13.738 09:38:36 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 600574c2-ab76-4fbd-be7b-32ad715b7fd1 00:15:13.738 09:38:36 -- common/autotest_common.sh@897 -- # local bdev_name=600574c2-ab76-4fbd-be7b-32ad715b7fd1 00:15:13.738 09:38:36 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:13.738 09:38:36 -- common/autotest_common.sh@899 -- # local i 00:15:13.738 09:38:36 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:13.738 09:38:36 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:13.738 09:38:36 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:13.997 09:38:36 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 600574c2-ab76-4fbd-be7b-32ad715b7fd1 -t 2000 00:15:14.259 [ 00:15:14.259 { 00:15:14.259 "name": "600574c2-ab76-4fbd-be7b-32ad715b7fd1", 00:15:14.259 "aliases": [ 00:15:14.259 "lvs/lvol" 00:15:14.259 ], 00:15:14.259 "product_name": "Logical Volume", 00:15:14.259 "block_size": 4096, 00:15:14.259 "num_blocks": 38912, 00:15:14.259 "uuid": "600574c2-ab76-4fbd-be7b-32ad715b7fd1", 00:15:14.259 "assigned_rate_limits": { 00:15:14.259 "rw_ios_per_sec": 0, 00:15:14.259 "rw_mbytes_per_sec": 0, 00:15:14.259 "r_mbytes_per_sec": 0, 00:15:14.259 "w_mbytes_per_sec": 0 00:15:14.259 }, 00:15:14.259 "claimed": false, 00:15:14.259 "zoned": false, 00:15:14.259 "supported_io_types": { 00:15:14.259 "read": true, 00:15:14.259 "write": true, 00:15:14.259 "unmap": true, 00:15:14.259 "write_zeroes": true, 00:15:14.259 "flush": false, 00:15:14.259 "reset": true, 00:15:14.259 "compare": false, 00:15:14.259 "compare_and_write": false, 00:15:14.259 "abort": false, 00:15:14.259 "nvme_admin": false, 00:15:14.259 "nvme_io": false 00:15:14.259 }, 00:15:14.259 "driver_specific": { 00:15:14.259 "lvol": { 00:15:14.259 "lvol_store_uuid": "d1e9d021-3980-47f5-8d6e-f1525de58e15", 00:15:14.259 "base_bdev": "aio_bdev", 00:15:14.259 "thin_provision": false, 00:15:14.259 "snapshot": false, 00:15:14.259 "clone": false, 00:15:14.259 "esnap_clone": false 00:15:14.259 } 00:15:14.259 } 00:15:14.259 } 00:15:14.259 ] 00:15:14.259 09:38:36 -- common/autotest_common.sh@905 -- # return 0 00:15:14.259 09:38:36 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d1e9d021-3980-47f5-8d6e-f1525de58e15 00:15:14.259 09:38:36 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:14.518 09:38:37 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:14.518 09:38:37 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d1e9d021-3980-47f5-8d6e-f1525de58e15 00:15:14.518 09:38:37 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:14.776 09:38:37 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:14.776 09:38:37 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:15.034 [2024-11-29 09:38:37.667415] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:15.034 09:38:37 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d1e9d021-3980-47f5-8d6e-f1525de58e15 00:15:15.034 09:38:37 -- common/autotest_common.sh@650 -- # local es=0 00:15:15.034 09:38:37 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d1e9d021-3980-47f5-8d6e-f1525de58e15 00:15:15.034 09:38:37 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:15.034 09:38:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:15.034 09:38:37 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:15.034 09:38:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:15.034 09:38:37 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:15.034 09:38:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:15.034 09:38:37 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:15.034 09:38:37 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:15.034 09:38:37 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d1e9d021-3980-47f5-8d6e-f1525de58e15 00:15:15.292 request: 00:15:15.292 { 00:15:15.292 "uuid": "d1e9d021-3980-47f5-8d6e-f1525de58e15", 00:15:15.292 "method": "bdev_lvol_get_lvstores", 00:15:15.292 "req_id": 1 00:15:15.292 } 00:15:15.292 Got JSON-RPC error response 00:15:15.292 response: 00:15:15.292 { 00:15:15.292 "code": -19, 00:15:15.292 "message": "No such device" 00:15:15.292 } 00:15:15.292 09:38:37 -- common/autotest_common.sh@653 -- # es=1 00:15:15.292 09:38:37 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:15.292 09:38:37 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:15.292 09:38:37 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:15.292 09:38:37 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:15.550 aio_bdev 00:15:15.550 09:38:38 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 600574c2-ab76-4fbd-be7b-32ad715b7fd1 00:15:15.550 09:38:38 -- common/autotest_common.sh@897 -- # local bdev_name=600574c2-ab76-4fbd-be7b-32ad715b7fd1 00:15:15.550 09:38:38 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:15.550 09:38:38 -- common/autotest_common.sh@899 -- # local i 00:15:15.550 09:38:38 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:15.550 09:38:38 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:15.550 09:38:38 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:15.809 09:38:38 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 600574c2-ab76-4fbd-be7b-32ad715b7fd1 -t 2000 00:15:16.070 [ 00:15:16.070 { 00:15:16.070 "name": "600574c2-ab76-4fbd-be7b-32ad715b7fd1", 00:15:16.070 "aliases": [ 00:15:16.070 "lvs/lvol" 00:15:16.070 ], 00:15:16.070 "product_name": "Logical Volume", 00:15:16.070 "block_size": 4096, 00:15:16.070 "num_blocks": 38912, 00:15:16.070 "uuid": "600574c2-ab76-4fbd-be7b-32ad715b7fd1", 00:15:16.070 "assigned_rate_limits": { 00:15:16.070 "rw_ios_per_sec": 0, 00:15:16.070 "rw_mbytes_per_sec": 0, 00:15:16.070 "r_mbytes_per_sec": 0, 00:15:16.070 "w_mbytes_per_sec": 0 00:15:16.070 }, 00:15:16.070 "claimed": false, 00:15:16.070 "zoned": false, 00:15:16.070 "supported_io_types": { 00:15:16.070 "read": true, 00:15:16.070 "write": true, 00:15:16.070 "unmap": true, 00:15:16.070 "write_zeroes": true, 00:15:16.070 "flush": false, 00:15:16.070 "reset": true, 00:15:16.070 "compare": false, 00:15:16.070 "compare_and_write": false, 00:15:16.070 "abort": false, 00:15:16.070 "nvme_admin": false, 00:15:16.070 "nvme_io": false 00:15:16.070 }, 00:15:16.070 "driver_specific": { 00:15:16.070 "lvol": { 00:15:16.070 "lvol_store_uuid": "d1e9d021-3980-47f5-8d6e-f1525de58e15", 00:15:16.070 "base_bdev": "aio_bdev", 00:15:16.070 "thin_provision": false, 00:15:16.070 "snapshot": false, 00:15:16.070 "clone": false, 00:15:16.070 "esnap_clone": false 00:15:16.070 } 00:15:16.070 } 00:15:16.070 } 00:15:16.070 ] 00:15:16.070 09:38:38 -- common/autotest_common.sh@905 -- # return 0 00:15:16.070 09:38:38 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d1e9d021-3980-47f5-8d6e-f1525de58e15 00:15:16.070 09:38:38 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:16.328 09:38:38 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:16.329 09:38:38 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d1e9d021-3980-47f5-8d6e-f1525de58e15 00:15:16.329 09:38:38 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:16.587 09:38:39 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:16.587 09:38:39 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 600574c2-ab76-4fbd-be7b-32ad715b7fd1 00:15:16.846 09:38:39 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u d1e9d021-3980-47f5-8d6e-f1525de58e15 00:15:17.106 09:38:39 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:17.367 09:38:40 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:17.367 00:15:17.367 real 0m20.359s 00:15:17.367 user 0m51.319s 00:15:17.367 sys 0m4.643s 00:15:17.367 09:38:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:17.367 09:38:40 -- common/autotest_common.sh@10 -- # set +x 00:15:17.367 ************************************ 00:15:17.367 END TEST lvs_grow_dirty 00:15:17.367 ************************************ 00:15:17.367 09:38:40 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:17.367 09:38:40 -- common/autotest_common.sh@806 -- # type=--id 00:15:17.367 09:38:40 -- common/autotest_common.sh@807 -- # id=0 00:15:17.367 09:38:40 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:15:17.367 09:38:40 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:17.367 09:38:40 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:15:17.367 09:38:40 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:15:17.367 09:38:40 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:15:17.367 09:38:40 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:17.367 nvmf_trace.0 00:15:17.367 09:38:40 -- common/autotest_common.sh@821 -- # return 0 00:15:17.367 09:38:40 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:17.367 09:38:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:17.367 09:38:40 -- nvmf/common.sh@116 -- # sync 00:15:17.367 09:38:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:17.367 09:38:40 -- nvmf/common.sh@119 -- # set +e 00:15:17.367 09:38:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:17.367 09:38:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:17.367 rmmod nvme_tcp 00:15:17.367 rmmod nvme_fabrics 00:15:17.367 rmmod nvme_keyring 00:15:17.367 09:38:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:17.367 09:38:40 -- nvmf/common.sh@123 -- # set -e 00:15:17.367 09:38:40 -- nvmf/common.sh@124 -- # return 0 00:15:17.367 09:38:40 -- nvmf/common.sh@477 -- # '[' -n 13192 ']' 00:15:17.367 09:38:40 -- nvmf/common.sh@478 -- # killprocess 13192 00:15:17.367 09:38:40 -- common/autotest_common.sh@936 -- # '[' -z 13192 ']' 00:15:17.367 09:38:40 -- common/autotest_common.sh@940 -- # kill -0 13192 00:15:17.367 09:38:40 -- common/autotest_common.sh@941 -- # uname 00:15:17.367 09:38:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:17.367 09:38:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 13192 00:15:17.367 09:38:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:17.367 09:38:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:17.367 09:38:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 13192' 00:15:17.367 killing process with pid 13192 00:15:17.367 09:38:40 -- common/autotest_common.sh@955 -- # kill 13192 00:15:17.367 09:38:40 -- common/autotest_common.sh@960 -- # wait 13192 00:15:17.626 09:38:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:17.626 09:38:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:17.626 09:38:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:17.626 09:38:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:17.626 09:38:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:17.626 09:38:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:17.626 09:38:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:17.626 09:38:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:20.164 09:38:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:20.164 00:15:20.164 real 0m44.578s 00:15:20.164 user 1m15.942s 00:15:20.164 sys 0m8.287s 00:15:20.164 09:38:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:20.164 09:38:42 -- common/autotest_common.sh@10 -- # set +x 00:15:20.164 ************************************ 00:15:20.164 END TEST nvmf_lvs_grow 00:15:20.164 ************************************ 00:15:20.164 09:38:42 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:20.164 09:38:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:20.164 09:38:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:20.164 09:38:42 -- common/autotest_common.sh@10 -- # set +x 00:15:20.164 ************************************ 00:15:20.164 START TEST nvmf_bdev_io_wait 00:15:20.164 ************************************ 00:15:20.164 09:38:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:20.164 * Looking for test storage... 00:15:20.164 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:20.164 09:38:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:20.164 09:38:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:20.164 09:38:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:20.164 09:38:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:20.164 09:38:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:20.164 09:38:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:20.164 09:38:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:20.164 09:38:42 -- scripts/common.sh@335 -- # IFS=.-: 00:15:20.164 09:38:42 -- scripts/common.sh@335 -- # read -ra ver1 00:15:20.164 09:38:42 -- scripts/common.sh@336 -- # IFS=.-: 00:15:20.164 09:38:42 -- scripts/common.sh@336 -- # read -ra ver2 00:15:20.164 09:38:42 -- scripts/common.sh@337 -- # local 'op=<' 00:15:20.164 09:38:42 -- scripts/common.sh@339 -- # ver1_l=2 00:15:20.164 09:38:42 -- scripts/common.sh@340 -- # ver2_l=1 00:15:20.164 09:38:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:20.164 09:38:42 -- scripts/common.sh@343 -- # case "$op" in 00:15:20.164 09:38:42 -- scripts/common.sh@344 -- # : 1 00:15:20.164 09:38:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:20.164 09:38:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:20.164 09:38:42 -- scripts/common.sh@364 -- # decimal 1 00:15:20.164 09:38:42 -- scripts/common.sh@352 -- # local d=1 00:15:20.164 09:38:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:20.164 09:38:42 -- scripts/common.sh@354 -- # echo 1 00:15:20.164 09:38:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:20.164 09:38:42 -- scripts/common.sh@365 -- # decimal 2 00:15:20.164 09:38:42 -- scripts/common.sh@352 -- # local d=2 00:15:20.164 09:38:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:20.164 09:38:42 -- scripts/common.sh@354 -- # echo 2 00:15:20.164 09:38:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:20.164 09:38:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:20.164 09:38:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:20.164 09:38:42 -- scripts/common.sh@367 -- # return 0 00:15:20.164 09:38:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:20.164 09:38:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:20.164 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:20.164 --rc genhtml_branch_coverage=1 00:15:20.164 --rc genhtml_function_coverage=1 00:15:20.164 --rc genhtml_legend=1 00:15:20.164 --rc geninfo_all_blocks=1 00:15:20.164 --rc geninfo_unexecuted_blocks=1 00:15:20.164 00:15:20.164 ' 00:15:20.164 09:38:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:20.164 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:20.164 --rc genhtml_branch_coverage=1 00:15:20.164 --rc genhtml_function_coverage=1 00:15:20.164 --rc genhtml_legend=1 00:15:20.164 --rc geninfo_all_blocks=1 00:15:20.164 --rc geninfo_unexecuted_blocks=1 00:15:20.164 00:15:20.164 ' 00:15:20.164 09:38:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:20.164 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:20.164 --rc genhtml_branch_coverage=1 00:15:20.164 --rc genhtml_function_coverage=1 00:15:20.164 --rc genhtml_legend=1 00:15:20.164 --rc geninfo_all_blocks=1 00:15:20.164 --rc geninfo_unexecuted_blocks=1 00:15:20.164 00:15:20.164 ' 00:15:20.164 09:38:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:20.164 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:20.164 --rc genhtml_branch_coverage=1 00:15:20.164 --rc genhtml_function_coverage=1 00:15:20.164 --rc genhtml_legend=1 00:15:20.164 --rc geninfo_all_blocks=1 00:15:20.164 --rc geninfo_unexecuted_blocks=1 00:15:20.164 00:15:20.164 ' 00:15:20.164 09:38:42 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:20.164 09:38:42 -- nvmf/common.sh@7 -- # uname -s 00:15:20.164 09:38:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:20.164 09:38:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:20.164 09:38:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:20.164 09:38:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:20.164 09:38:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:20.164 09:38:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:20.164 09:38:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:20.164 09:38:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:20.164 09:38:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:20.164 09:38:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:20.164 09:38:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:20.164 09:38:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:20.164 09:38:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:20.164 09:38:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:20.164 09:38:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:20.164 09:38:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:20.164 09:38:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:20.164 09:38:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:20.164 09:38:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:20.164 09:38:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.164 09:38:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.164 09:38:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.164 09:38:42 -- paths/export.sh@5 -- # export PATH 00:15:20.164 09:38:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:20.164 09:38:42 -- nvmf/common.sh@46 -- # : 0 00:15:20.164 09:38:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:20.164 09:38:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:20.164 09:38:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:20.164 09:38:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:20.165 09:38:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:20.165 09:38:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:20.165 09:38:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:20.165 09:38:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:20.165 09:38:42 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:20.165 09:38:42 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:20.165 09:38:42 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:20.165 09:38:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:20.165 09:38:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:20.165 09:38:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:20.165 09:38:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:20.165 09:38:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:20.165 09:38:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:20.165 09:38:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:20.165 09:38:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:20.165 09:38:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:20.165 09:38:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:20.165 09:38:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:20.165 09:38:42 -- common/autotest_common.sh@10 -- # set +x 00:15:22.069 09:38:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:22.069 09:38:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:22.069 09:38:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:22.069 09:38:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:22.069 09:38:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:22.069 09:38:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:22.069 09:38:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:22.069 09:38:44 -- nvmf/common.sh@294 -- # net_devs=() 00:15:22.069 09:38:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:22.069 09:38:44 -- nvmf/common.sh@295 -- # e810=() 00:15:22.069 09:38:44 -- nvmf/common.sh@295 -- # local -ga e810 00:15:22.069 09:38:44 -- nvmf/common.sh@296 -- # x722=() 00:15:22.069 09:38:44 -- nvmf/common.sh@296 -- # local -ga x722 00:15:22.069 09:38:44 -- nvmf/common.sh@297 -- # mlx=() 00:15:22.069 09:38:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:22.069 09:38:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:22.069 09:38:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:22.069 09:38:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:22.069 09:38:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:22.069 09:38:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:22.069 09:38:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:22.069 09:38:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:22.069 09:38:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:22.069 09:38:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:22.069 09:38:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:22.069 09:38:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:22.069 09:38:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:22.069 09:38:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:22.069 09:38:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:22.069 09:38:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:22.069 09:38:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:22.069 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:22.069 09:38:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:22.069 09:38:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:22.069 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:22.069 09:38:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:22.069 09:38:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:22.069 09:38:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:22.069 09:38:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:22.069 09:38:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:22.069 09:38:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:22.069 09:38:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:22.069 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:22.069 09:38:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:22.069 09:38:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:22.069 09:38:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:22.069 09:38:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:22.069 09:38:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:22.070 09:38:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:22.070 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:22.070 09:38:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:22.070 09:38:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:22.070 09:38:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:22.070 09:38:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:22.070 09:38:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:22.070 09:38:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:22.070 09:38:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:22.070 09:38:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:22.070 09:38:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:22.070 09:38:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:22.070 09:38:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:22.070 09:38:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:22.070 09:38:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:22.070 09:38:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:22.070 09:38:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:22.070 09:38:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:22.070 09:38:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:22.070 09:38:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:22.070 09:38:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:22.070 09:38:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:22.070 09:38:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:22.070 09:38:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:22.070 09:38:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:22.070 09:38:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:22.070 09:38:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:22.070 09:38:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:22.070 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:22.070 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:15:22.070 00:15:22.070 --- 10.0.0.2 ping statistics --- 00:15:22.070 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:22.070 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:15:22.070 09:38:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:22.070 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:22.070 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:15:22.070 00:15:22.070 --- 10.0.0.1 ping statistics --- 00:15:22.070 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:22.070 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:15:22.070 09:38:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:22.070 09:38:44 -- nvmf/common.sh@410 -- # return 0 00:15:22.070 09:38:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:22.070 09:38:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:22.070 09:38:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:22.070 09:38:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:22.070 09:38:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:22.070 09:38:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:22.070 09:38:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:22.070 09:38:44 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:22.070 09:38:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:22.070 09:38:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:22.070 09:38:44 -- common/autotest_common.sh@10 -- # set +x 00:15:22.070 09:38:44 -- nvmf/common.sh@469 -- # nvmfpid=15754 00:15:22.070 09:38:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:22.070 09:38:44 -- nvmf/common.sh@470 -- # waitforlisten 15754 00:15:22.070 09:38:44 -- common/autotest_common.sh@829 -- # '[' -z 15754 ']' 00:15:22.070 09:38:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:22.070 09:38:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:22.070 09:38:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:22.070 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:22.070 09:38:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:22.070 09:38:44 -- common/autotest_common.sh@10 -- # set +x 00:15:22.070 [2024-11-29 09:38:44.845473] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:22.070 [2024-11-29 09:38:44.845558] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:22.070 EAL: No free 2048 kB hugepages reported on node 1 00:15:22.329 [2024-11-29 09:38:44.915074] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:22.329 [2024-11-29 09:38:45.035969] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:22.329 [2024-11-29 09:38:45.036132] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:22.329 [2024-11-29 09:38:45.036152] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:22.329 [2024-11-29 09:38:45.036166] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:22.329 [2024-11-29 09:38:45.036230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:22.329 [2024-11-29 09:38:45.036305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:22.329 [2024-11-29 09:38:45.036443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:22.329 [2024-11-29 09:38:45.036448] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:22.329 09:38:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:22.329 09:38:45 -- common/autotest_common.sh@862 -- # return 0 00:15:22.329 09:38:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:22.329 09:38:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:22.329 09:38:45 -- common/autotest_common.sh@10 -- # set +x 00:15:22.329 09:38:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:22.329 09:38:45 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:22.329 09:38:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.329 09:38:45 -- common/autotest_common.sh@10 -- # set +x 00:15:22.329 09:38:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.329 09:38:45 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:22.329 09:38:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.329 09:38:45 -- common/autotest_common.sh@10 -- # set +x 00:15:22.329 09:38:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.329 09:38:45 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:22.329 09:38:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.329 09:38:45 -- common/autotest_common.sh@10 -- # set +x 00:15:22.594 [2024-11-29 09:38:45.174316] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:22.594 09:38:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.594 09:38:45 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:22.594 09:38:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.594 09:38:45 -- common/autotest_common.sh@10 -- # set +x 00:15:22.594 Malloc0 00:15:22.594 09:38:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:22.595 09:38:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.595 09:38:45 -- common/autotest_common.sh@10 -- # set +x 00:15:22.595 09:38:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:22.595 09:38:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.595 09:38:45 -- common/autotest_common.sh@10 -- # set +x 00:15:22.595 09:38:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:22.595 09:38:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.595 09:38:45 -- common/autotest_common.sh@10 -- # set +x 00:15:22.595 [2024-11-29 09:38:45.244193] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:22.595 09:38:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=15905 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@30 -- # READ_PID=15906 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=15908 00:15:22.595 09:38:45 -- nvmf/common.sh@520 -- # config=() 00:15:22.595 09:38:45 -- nvmf/common.sh@520 -- # local subsystem config 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:22.595 09:38:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:22.595 09:38:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:22.595 { 00:15:22.595 "params": { 00:15:22.595 "name": "Nvme$subsystem", 00:15:22.595 "trtype": "$TEST_TRANSPORT", 00:15:22.595 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:22.595 "adrfam": "ipv4", 00:15:22.595 "trsvcid": "$NVMF_PORT", 00:15:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:22.595 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:22.595 "hdgst": ${hdgst:-false}, 00:15:22.595 "ddgst": ${ddgst:-false} 00:15:22.595 }, 00:15:22.595 "method": "bdev_nvme_attach_controller" 00:15:22.595 } 00:15:22.595 EOF 00:15:22.595 )") 00:15:22.595 09:38:45 -- nvmf/common.sh@520 -- # config=() 00:15:22.595 09:38:45 -- nvmf/common.sh@520 -- # local subsystem config 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=15911 00:15:22.595 09:38:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:22.595 09:38:45 -- nvmf/common.sh@520 -- # config=() 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@35 -- # sync 00:15:22.595 09:38:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:22.595 { 00:15:22.595 "params": { 00:15:22.595 "name": "Nvme$subsystem", 00:15:22.595 "trtype": "$TEST_TRANSPORT", 00:15:22.595 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:22.595 "adrfam": "ipv4", 00:15:22.595 "trsvcid": "$NVMF_PORT", 00:15:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:22.595 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:22.595 "hdgst": ${hdgst:-false}, 00:15:22.595 "ddgst": ${ddgst:-false} 00:15:22.595 }, 00:15:22.595 "method": "bdev_nvme_attach_controller" 00:15:22.595 } 00:15:22.595 EOF 00:15:22.595 )") 00:15:22.595 09:38:45 -- nvmf/common.sh@520 -- # local subsystem config 00:15:22.595 09:38:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:22.595 09:38:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:22.595 { 00:15:22.595 "params": { 00:15:22.595 "name": "Nvme$subsystem", 00:15:22.595 "trtype": "$TEST_TRANSPORT", 00:15:22.595 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:22.595 "adrfam": "ipv4", 00:15:22.595 "trsvcid": "$NVMF_PORT", 00:15:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:22.595 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:22.595 "hdgst": ${hdgst:-false}, 00:15:22.595 "ddgst": ${ddgst:-false} 00:15:22.595 }, 00:15:22.595 "method": "bdev_nvme_attach_controller" 00:15:22.595 } 00:15:22.595 EOF 00:15:22.595 )") 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:22.595 09:38:45 -- nvmf/common.sh@542 -- # cat 00:15:22.595 09:38:45 -- nvmf/common.sh@520 -- # config=() 00:15:22.595 09:38:45 -- nvmf/common.sh@520 -- # local subsystem config 00:15:22.595 09:38:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:22.595 09:38:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:22.595 { 00:15:22.595 "params": { 00:15:22.595 "name": "Nvme$subsystem", 00:15:22.595 "trtype": "$TEST_TRANSPORT", 00:15:22.595 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:22.595 "adrfam": "ipv4", 00:15:22.595 "trsvcid": "$NVMF_PORT", 00:15:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:22.595 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:22.595 "hdgst": ${hdgst:-false}, 00:15:22.595 "ddgst": ${ddgst:-false} 00:15:22.595 }, 00:15:22.595 "method": "bdev_nvme_attach_controller" 00:15:22.595 } 00:15:22.595 EOF 00:15:22.595 )") 00:15:22.595 09:38:45 -- nvmf/common.sh@542 -- # cat 00:15:22.595 09:38:45 -- nvmf/common.sh@542 -- # cat 00:15:22.595 09:38:45 -- target/bdev_io_wait.sh@37 -- # wait 15905 00:15:22.595 09:38:45 -- nvmf/common.sh@542 -- # cat 00:15:22.595 09:38:45 -- nvmf/common.sh@544 -- # jq . 00:15:22.595 09:38:45 -- nvmf/common.sh@544 -- # jq . 00:15:22.595 09:38:45 -- nvmf/common.sh@544 -- # jq . 00:15:22.595 09:38:45 -- nvmf/common.sh@545 -- # IFS=, 00:15:22.595 09:38:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:22.595 "params": { 00:15:22.595 "name": "Nvme1", 00:15:22.595 "trtype": "tcp", 00:15:22.595 "traddr": "10.0.0.2", 00:15:22.595 "adrfam": "ipv4", 00:15:22.595 "trsvcid": "4420", 00:15:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:22.595 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:22.595 "hdgst": false, 00:15:22.595 "ddgst": false 00:15:22.595 }, 00:15:22.595 "method": "bdev_nvme_attach_controller" 00:15:22.595 }' 00:15:22.595 09:38:45 -- nvmf/common.sh@544 -- # jq . 00:15:22.595 09:38:45 -- nvmf/common.sh@545 -- # IFS=, 00:15:22.595 09:38:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:22.595 "params": { 00:15:22.595 "name": "Nvme1", 00:15:22.595 "trtype": "tcp", 00:15:22.595 "traddr": "10.0.0.2", 00:15:22.595 "adrfam": "ipv4", 00:15:22.595 "trsvcid": "4420", 00:15:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:22.595 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:22.595 "hdgst": false, 00:15:22.595 "ddgst": false 00:15:22.595 }, 00:15:22.595 "method": "bdev_nvme_attach_controller" 00:15:22.595 }' 00:15:22.595 09:38:45 -- nvmf/common.sh@545 -- # IFS=, 00:15:22.595 09:38:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:22.595 "params": { 00:15:22.595 "name": "Nvme1", 00:15:22.595 "trtype": "tcp", 00:15:22.595 "traddr": "10.0.0.2", 00:15:22.595 "adrfam": "ipv4", 00:15:22.595 "trsvcid": "4420", 00:15:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:22.595 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:22.595 "hdgst": false, 00:15:22.595 "ddgst": false 00:15:22.595 }, 00:15:22.595 "method": "bdev_nvme_attach_controller" 00:15:22.595 }' 00:15:22.595 09:38:45 -- nvmf/common.sh@545 -- # IFS=, 00:15:22.595 09:38:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:22.595 "params": { 00:15:22.595 "name": "Nvme1", 00:15:22.595 "trtype": "tcp", 00:15:22.595 "traddr": "10.0.0.2", 00:15:22.595 "adrfam": "ipv4", 00:15:22.595 "trsvcid": "4420", 00:15:22.595 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:22.595 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:22.595 "hdgst": false, 00:15:22.595 "ddgst": false 00:15:22.595 }, 00:15:22.595 "method": "bdev_nvme_attach_controller" 00:15:22.595 }' 00:15:22.595 [2024-11-29 09:38:45.286980] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:22.595 [2024-11-29 09:38:45.286980] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:22.595 [2024-11-29 09:38:45.286980] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:22.595 [2024-11-29 09:38:45.287057] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-29 09:38:45.287057] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:22.595 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:22.595 [2024-11-29 09:38:45.287060] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:22.595 [2024-11-29 09:38:45.287756] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:22.595 [2024-11-29 09:38:45.287828] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:22.595 EAL: No free 2048 kB hugepages reported on node 1 00:15:22.595 EAL: No free 2048 kB hugepages reported on node 1 00:15:22.853 [2024-11-29 09:38:45.461706] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:22.853 EAL: No free 2048 kB hugepages reported on node 1 00:15:22.853 [2024-11-29 09:38:45.555457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:22.853 [2024-11-29 09:38:45.560115] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:22.853 EAL: No free 2048 kB hugepages reported on node 1 00:15:22.853 [2024-11-29 09:38:45.656299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:22.853 [2024-11-29 09:38:45.658595] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:23.113 [2024-11-29 09:38:45.734080] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:23.113 [2024-11-29 09:38:45.759204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:23.113 [2024-11-29 09:38:45.827135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:23.113 Running I/O for 1 seconds... 00:15:23.113 Running I/O for 1 seconds... 00:15:23.371 Running I/O for 1 seconds... 00:15:23.371 Running I/O for 1 seconds... 00:15:24.308 00:15:24.308 Latency(us) 00:15:24.308 [2024-11-29T08:38:47.151Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:24.308 [2024-11-29T08:38:47.151Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:24.308 Nvme1n1 : 1.00 197407.84 771.12 0.00 0.00 645.89 253.35 922.36 00:15:24.308 [2024-11-29T08:38:47.151Z] =================================================================================================================== 00:15:24.308 [2024-11-29T08:38:47.151Z] Total : 197407.84 771.12 0.00 0.00 645.89 253.35 922.36 00:15:24.308 00:15:24.308 Latency(us) 00:15:24.308 [2024-11-29T08:38:47.151Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:24.308 [2024-11-29T08:38:47.151Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:24.308 Nvme1n1 : 1.02 6616.07 25.84 0.00 0.00 19189.32 8301.23 23884.23 00:15:24.308 [2024-11-29T08:38:47.151Z] =================================================================================================================== 00:15:24.308 [2024-11-29T08:38:47.151Z] Total : 6616.07 25.84 0.00 0.00 19189.32 8301.23 23884.23 00:15:24.308 00:15:24.308 Latency(us) 00:15:24.308 [2024-11-29T08:38:47.151Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:24.308 [2024-11-29T08:38:47.151Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:24.308 Nvme1n1 : 1.01 10044.02 39.23 0.00 0.00 12696.90 6262.33 23495.87 00:15:24.308 [2024-11-29T08:38:47.151Z] =================================================================================================================== 00:15:24.308 [2024-11-29T08:38:47.151Z] Total : 10044.02 39.23 0.00 0.00 12696.90 6262.33 23495.87 00:15:24.308 00:15:24.308 Latency(us) 00:15:24.308 [2024-11-29T08:38:47.151Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:24.308 [2024-11-29T08:38:47.151Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:24.308 Nvme1n1 : 1.01 6458.24 25.23 0.00 0.00 19761.11 5121.52 44273.21 00:15:24.308 [2024-11-29T08:38:47.151Z] =================================================================================================================== 00:15:24.308 [2024-11-29T08:38:47.151Z] Total : 6458.24 25.23 0.00 0.00 19761.11 5121.52 44273.21 00:15:24.567 09:38:47 -- target/bdev_io_wait.sh@38 -- # wait 15906 00:15:24.567 09:38:47 -- target/bdev_io_wait.sh@39 -- # wait 15908 00:15:24.567 09:38:47 -- target/bdev_io_wait.sh@40 -- # wait 15911 00:15:24.567 09:38:47 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:24.567 09:38:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:24.567 09:38:47 -- common/autotest_common.sh@10 -- # set +x 00:15:24.827 09:38:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:24.827 09:38:47 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:24.827 09:38:47 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:24.827 09:38:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:24.827 09:38:47 -- nvmf/common.sh@116 -- # sync 00:15:24.827 09:38:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:24.827 09:38:47 -- nvmf/common.sh@119 -- # set +e 00:15:24.827 09:38:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:24.827 09:38:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:24.827 rmmod nvme_tcp 00:15:24.827 rmmod nvme_fabrics 00:15:24.827 rmmod nvme_keyring 00:15:24.827 09:38:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:24.827 09:38:47 -- nvmf/common.sh@123 -- # set -e 00:15:24.827 09:38:47 -- nvmf/common.sh@124 -- # return 0 00:15:24.827 09:38:47 -- nvmf/common.sh@477 -- # '[' -n 15754 ']' 00:15:24.827 09:38:47 -- nvmf/common.sh@478 -- # killprocess 15754 00:15:24.827 09:38:47 -- common/autotest_common.sh@936 -- # '[' -z 15754 ']' 00:15:24.827 09:38:47 -- common/autotest_common.sh@940 -- # kill -0 15754 00:15:24.827 09:38:47 -- common/autotest_common.sh@941 -- # uname 00:15:24.827 09:38:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:24.827 09:38:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 15754 00:15:24.827 09:38:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:24.827 09:38:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:24.827 09:38:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 15754' 00:15:24.827 killing process with pid 15754 00:15:24.827 09:38:47 -- common/autotest_common.sh@955 -- # kill 15754 00:15:24.827 09:38:47 -- common/autotest_common.sh@960 -- # wait 15754 00:15:25.088 09:38:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:25.088 09:38:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:25.088 09:38:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:25.088 09:38:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:25.088 09:38:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:25.088 09:38:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:25.088 09:38:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:25.088 09:38:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:26.993 09:38:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:26.993 00:15:26.993 real 0m7.286s 00:15:26.993 user 0m16.972s 00:15:26.993 sys 0m3.321s 00:15:26.993 09:38:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:26.993 09:38:49 -- common/autotest_common.sh@10 -- # set +x 00:15:26.993 ************************************ 00:15:26.993 END TEST nvmf_bdev_io_wait 00:15:26.993 ************************************ 00:15:27.252 09:38:49 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:27.252 09:38:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:27.252 09:38:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:27.252 09:38:49 -- common/autotest_common.sh@10 -- # set +x 00:15:27.252 ************************************ 00:15:27.252 START TEST nvmf_queue_depth 00:15:27.252 ************************************ 00:15:27.252 09:38:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:27.252 * Looking for test storage... 00:15:27.252 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:27.252 09:38:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:27.252 09:38:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:27.252 09:38:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:27.252 09:38:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:27.252 09:38:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:27.252 09:38:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:27.252 09:38:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:27.252 09:38:49 -- scripts/common.sh@335 -- # IFS=.-: 00:15:27.252 09:38:49 -- scripts/common.sh@335 -- # read -ra ver1 00:15:27.252 09:38:49 -- scripts/common.sh@336 -- # IFS=.-: 00:15:27.252 09:38:49 -- scripts/common.sh@336 -- # read -ra ver2 00:15:27.252 09:38:49 -- scripts/common.sh@337 -- # local 'op=<' 00:15:27.252 09:38:49 -- scripts/common.sh@339 -- # ver1_l=2 00:15:27.252 09:38:49 -- scripts/common.sh@340 -- # ver2_l=1 00:15:27.252 09:38:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:27.252 09:38:49 -- scripts/common.sh@343 -- # case "$op" in 00:15:27.252 09:38:49 -- scripts/common.sh@344 -- # : 1 00:15:27.252 09:38:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:27.252 09:38:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:27.252 09:38:49 -- scripts/common.sh@364 -- # decimal 1 00:15:27.252 09:38:49 -- scripts/common.sh@352 -- # local d=1 00:15:27.252 09:38:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:27.252 09:38:49 -- scripts/common.sh@354 -- # echo 1 00:15:27.252 09:38:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:27.252 09:38:49 -- scripts/common.sh@365 -- # decimal 2 00:15:27.252 09:38:49 -- scripts/common.sh@352 -- # local d=2 00:15:27.252 09:38:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:27.252 09:38:49 -- scripts/common.sh@354 -- # echo 2 00:15:27.252 09:38:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:27.252 09:38:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:27.252 09:38:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:27.252 09:38:49 -- scripts/common.sh@367 -- # return 0 00:15:27.252 09:38:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:27.252 09:38:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:27.252 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:27.252 --rc genhtml_branch_coverage=1 00:15:27.252 --rc genhtml_function_coverage=1 00:15:27.252 --rc genhtml_legend=1 00:15:27.252 --rc geninfo_all_blocks=1 00:15:27.252 --rc geninfo_unexecuted_blocks=1 00:15:27.252 00:15:27.252 ' 00:15:27.252 09:38:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:27.252 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:27.252 --rc genhtml_branch_coverage=1 00:15:27.252 --rc genhtml_function_coverage=1 00:15:27.252 --rc genhtml_legend=1 00:15:27.252 --rc geninfo_all_blocks=1 00:15:27.252 --rc geninfo_unexecuted_blocks=1 00:15:27.252 00:15:27.252 ' 00:15:27.252 09:38:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:27.253 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:27.253 --rc genhtml_branch_coverage=1 00:15:27.253 --rc genhtml_function_coverage=1 00:15:27.253 --rc genhtml_legend=1 00:15:27.253 --rc geninfo_all_blocks=1 00:15:27.253 --rc geninfo_unexecuted_blocks=1 00:15:27.253 00:15:27.253 ' 00:15:27.253 09:38:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:27.253 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:27.253 --rc genhtml_branch_coverage=1 00:15:27.253 --rc genhtml_function_coverage=1 00:15:27.253 --rc genhtml_legend=1 00:15:27.253 --rc geninfo_all_blocks=1 00:15:27.253 --rc geninfo_unexecuted_blocks=1 00:15:27.253 00:15:27.253 ' 00:15:27.253 09:38:49 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:27.253 09:38:49 -- nvmf/common.sh@7 -- # uname -s 00:15:27.253 09:38:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:27.253 09:38:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:27.253 09:38:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:27.253 09:38:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:27.253 09:38:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:27.253 09:38:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:27.253 09:38:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:27.253 09:38:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:27.253 09:38:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:27.253 09:38:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:27.253 09:38:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:27.253 09:38:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:27.253 09:38:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:27.253 09:38:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:27.253 09:38:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:27.253 09:38:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:27.253 09:38:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:27.253 09:38:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:27.253 09:38:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:27.253 09:38:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.253 09:38:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.253 09:38:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.253 09:38:49 -- paths/export.sh@5 -- # export PATH 00:15:27.253 09:38:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:27.253 09:38:49 -- nvmf/common.sh@46 -- # : 0 00:15:27.253 09:38:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:27.253 09:38:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:27.253 09:38:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:27.253 09:38:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:27.253 09:38:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:27.253 09:38:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:27.253 09:38:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:27.253 09:38:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:27.253 09:38:49 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:27.253 09:38:49 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:27.253 09:38:49 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:27.253 09:38:49 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:27.253 09:38:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:27.253 09:38:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:27.253 09:38:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:27.253 09:38:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:27.253 09:38:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:27.253 09:38:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:27.253 09:38:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:27.253 09:38:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:27.253 09:38:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:27.253 09:38:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:27.253 09:38:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:27.253 09:38:49 -- common/autotest_common.sh@10 -- # set +x 00:15:29.158 09:38:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:29.158 09:38:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:29.158 09:38:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:29.158 09:38:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:29.158 09:38:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:29.158 09:38:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:29.158 09:38:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:29.158 09:38:51 -- nvmf/common.sh@294 -- # net_devs=() 00:15:29.158 09:38:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:29.158 09:38:51 -- nvmf/common.sh@295 -- # e810=() 00:15:29.158 09:38:51 -- nvmf/common.sh@295 -- # local -ga e810 00:15:29.158 09:38:51 -- nvmf/common.sh@296 -- # x722=() 00:15:29.158 09:38:51 -- nvmf/common.sh@296 -- # local -ga x722 00:15:29.158 09:38:51 -- nvmf/common.sh@297 -- # mlx=() 00:15:29.158 09:38:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:29.158 09:38:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:29.158 09:38:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:29.158 09:38:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:29.158 09:38:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:29.158 09:38:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:29.158 09:38:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:29.158 09:38:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:29.158 09:38:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:29.158 09:38:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:29.158 09:38:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:29.158 09:38:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:29.158 09:38:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:29.158 09:38:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:29.158 09:38:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:29.158 09:38:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:29.158 09:38:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:29.158 09:38:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:29.158 09:38:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:29.158 09:38:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:29.158 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:29.158 09:38:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:29.158 09:38:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:29.158 09:38:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:29.158 09:38:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:29.158 09:38:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:29.158 09:38:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:29.158 09:38:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:29.158 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:29.158 09:38:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:29.158 09:38:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:29.158 09:38:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:29.158 09:38:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:29.158 09:38:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:29.158 09:38:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:29.158 09:38:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:29.159 09:38:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:29.159 09:38:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:29.159 09:38:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:29.159 09:38:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:29.159 09:38:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:29.159 09:38:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:29.159 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:29.159 09:38:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:29.159 09:38:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:29.159 09:38:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:29.159 09:38:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:29.159 09:38:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:29.159 09:38:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:29.159 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:29.159 09:38:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:29.159 09:38:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:29.159 09:38:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:29.159 09:38:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:29.159 09:38:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:29.159 09:38:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:29.159 09:38:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:29.159 09:38:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:29.159 09:38:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:29.159 09:38:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:29.159 09:38:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:29.159 09:38:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:29.159 09:38:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:29.159 09:38:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:29.159 09:38:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:29.159 09:38:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:29.159 09:38:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:29.159 09:38:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:29.159 09:38:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:29.420 09:38:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:29.420 09:38:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:29.420 09:38:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:29.420 09:38:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:29.420 09:38:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:29.420 09:38:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:29.420 09:38:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:29.420 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:29.420 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.326 ms 00:15:29.420 00:15:29.420 --- 10.0.0.2 ping statistics --- 00:15:29.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:29.420 rtt min/avg/max/mdev = 0.326/0.326/0.326/0.000 ms 00:15:29.420 09:38:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:29.420 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:29.420 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:15:29.420 00:15:29.420 --- 10.0.0.1 ping statistics --- 00:15:29.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:29.420 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:15:29.420 09:38:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:29.420 09:38:52 -- nvmf/common.sh@410 -- # return 0 00:15:29.420 09:38:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:29.420 09:38:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:29.420 09:38:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:29.420 09:38:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:29.420 09:38:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:29.420 09:38:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:29.420 09:38:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:29.420 09:38:52 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:29.420 09:38:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:29.420 09:38:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:29.420 09:38:52 -- common/autotest_common.sh@10 -- # set +x 00:15:29.420 09:38:52 -- nvmf/common.sh@469 -- # nvmfpid=18151 00:15:29.420 09:38:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:29.420 09:38:52 -- nvmf/common.sh@470 -- # waitforlisten 18151 00:15:29.420 09:38:52 -- common/autotest_common.sh@829 -- # '[' -z 18151 ']' 00:15:29.420 09:38:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:29.420 09:38:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:29.420 09:38:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:29.420 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:29.420 09:38:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:29.420 09:38:52 -- common/autotest_common.sh@10 -- # set +x 00:15:29.420 [2024-11-29 09:38:52.188024] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:29.420 [2024-11-29 09:38:52.188105] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:29.420 EAL: No free 2048 kB hugepages reported on node 1 00:15:29.420 [2024-11-29 09:38:52.253070] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:29.681 [2024-11-29 09:38:52.361410] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:29.681 [2024-11-29 09:38:52.361559] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:29.681 [2024-11-29 09:38:52.361576] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:29.681 [2024-11-29 09:38:52.361588] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:29.681 [2024-11-29 09:38:52.361638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:30.618 09:38:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:30.618 09:38:53 -- common/autotest_common.sh@862 -- # return 0 00:15:30.618 09:38:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:30.618 09:38:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:30.618 09:38:53 -- common/autotest_common.sh@10 -- # set +x 00:15:30.618 09:38:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:30.618 09:38:53 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:30.618 09:38:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.618 09:38:53 -- common/autotest_common.sh@10 -- # set +x 00:15:30.618 [2024-11-29 09:38:53.188128] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:30.618 09:38:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.618 09:38:53 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:30.618 09:38:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.618 09:38:53 -- common/autotest_common.sh@10 -- # set +x 00:15:30.618 Malloc0 00:15:30.618 09:38:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.618 09:38:53 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:30.618 09:38:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.618 09:38:53 -- common/autotest_common.sh@10 -- # set +x 00:15:30.618 09:38:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.618 09:38:53 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:30.618 09:38:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.618 09:38:53 -- common/autotest_common.sh@10 -- # set +x 00:15:30.618 09:38:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.618 09:38:53 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:30.618 09:38:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.618 09:38:53 -- common/autotest_common.sh@10 -- # set +x 00:15:30.618 [2024-11-29 09:38:53.248326] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:30.618 09:38:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.618 09:38:53 -- target/queue_depth.sh@30 -- # bdevperf_pid=18309 00:15:30.618 09:38:53 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:30.618 09:38:53 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:30.618 09:38:53 -- target/queue_depth.sh@33 -- # waitforlisten 18309 /var/tmp/bdevperf.sock 00:15:30.618 09:38:53 -- common/autotest_common.sh@829 -- # '[' -z 18309 ']' 00:15:30.618 09:38:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:30.618 09:38:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:30.618 09:38:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:30.618 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:30.618 09:38:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:30.618 09:38:53 -- common/autotest_common.sh@10 -- # set +x 00:15:30.618 [2024-11-29 09:38:53.290620] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:30.618 [2024-11-29 09:38:53.290698] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid18309 ] 00:15:30.618 EAL: No free 2048 kB hugepages reported on node 1 00:15:30.618 [2024-11-29 09:38:53.353468] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:30.878 [2024-11-29 09:38:53.469289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:31.817 09:38:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:31.817 09:38:54 -- common/autotest_common.sh@862 -- # return 0 00:15:31.817 09:38:54 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:31.817 09:38:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.817 09:38:54 -- common/autotest_common.sh@10 -- # set +x 00:15:31.817 NVMe0n1 00:15:31.817 09:38:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.817 09:38:54 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:31.817 Running I/O for 10 seconds... 00:15:44.028 00:15:44.028 Latency(us) 00:15:44.028 [2024-11-29T08:39:06.871Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:44.028 [2024-11-29T08:39:06.871Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:44.028 Verification LBA range: start 0x0 length 0x4000 00:15:44.028 NVMe0n1 : 10.07 12342.68 48.21 0.00 0.00 82637.03 14951.92 62914.56 00:15:44.028 [2024-11-29T08:39:06.871Z] =================================================================================================================== 00:15:44.028 [2024-11-29T08:39:06.871Z] Total : 12342.68 48.21 0.00 0.00 82637.03 14951.92 62914.56 00:15:44.028 0 00:15:44.028 09:39:04 -- target/queue_depth.sh@39 -- # killprocess 18309 00:15:44.028 09:39:04 -- common/autotest_common.sh@936 -- # '[' -z 18309 ']' 00:15:44.028 09:39:04 -- common/autotest_common.sh@940 -- # kill -0 18309 00:15:44.028 09:39:04 -- common/autotest_common.sh@941 -- # uname 00:15:44.028 09:39:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:44.028 09:39:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 18309 00:15:44.028 09:39:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:44.028 09:39:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:44.028 09:39:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 18309' 00:15:44.028 killing process with pid 18309 00:15:44.028 09:39:04 -- common/autotest_common.sh@955 -- # kill 18309 00:15:44.028 Received shutdown signal, test time was about 10.000000 seconds 00:15:44.028 00:15:44.028 Latency(us) 00:15:44.028 [2024-11-29T08:39:06.871Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:44.028 [2024-11-29T08:39:06.871Z] =================================================================================================================== 00:15:44.028 [2024-11-29T08:39:06.871Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:44.028 09:39:04 -- common/autotest_common.sh@960 -- # wait 18309 00:15:44.028 09:39:05 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:44.028 09:39:05 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:44.028 09:39:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:44.028 09:39:05 -- nvmf/common.sh@116 -- # sync 00:15:44.028 09:39:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:44.028 09:39:05 -- nvmf/common.sh@119 -- # set +e 00:15:44.028 09:39:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:44.028 09:39:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:44.028 rmmod nvme_tcp 00:15:44.028 rmmod nvme_fabrics 00:15:44.028 rmmod nvme_keyring 00:15:44.028 09:39:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:44.028 09:39:05 -- nvmf/common.sh@123 -- # set -e 00:15:44.028 09:39:05 -- nvmf/common.sh@124 -- # return 0 00:15:44.028 09:39:05 -- nvmf/common.sh@477 -- # '[' -n 18151 ']' 00:15:44.028 09:39:05 -- nvmf/common.sh@478 -- # killprocess 18151 00:15:44.028 09:39:05 -- common/autotest_common.sh@936 -- # '[' -z 18151 ']' 00:15:44.028 09:39:05 -- common/autotest_common.sh@940 -- # kill -0 18151 00:15:44.028 09:39:05 -- common/autotest_common.sh@941 -- # uname 00:15:44.028 09:39:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:44.028 09:39:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 18151 00:15:44.028 09:39:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:44.028 09:39:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:44.028 09:39:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 18151' 00:15:44.028 killing process with pid 18151 00:15:44.028 09:39:05 -- common/autotest_common.sh@955 -- # kill 18151 00:15:44.028 09:39:05 -- common/autotest_common.sh@960 -- # wait 18151 00:15:44.028 09:39:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:44.028 09:39:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:44.028 09:39:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:44.028 09:39:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:44.028 09:39:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:44.028 09:39:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:44.029 09:39:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:44.029 09:39:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:44.988 09:39:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:44.988 00:15:44.988 real 0m17.662s 00:15:44.988 user 0m25.406s 00:15:44.988 sys 0m3.174s 00:15:44.988 09:39:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:44.988 09:39:07 -- common/autotest_common.sh@10 -- # set +x 00:15:44.988 ************************************ 00:15:44.988 END TEST nvmf_queue_depth 00:15:44.988 ************************************ 00:15:44.988 09:39:07 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:44.988 09:39:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:44.988 09:39:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:44.988 09:39:07 -- common/autotest_common.sh@10 -- # set +x 00:15:44.988 ************************************ 00:15:44.988 START TEST nvmf_multipath 00:15:44.988 ************************************ 00:15:44.988 09:39:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:44.988 * Looking for test storage... 00:15:44.988 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:44.988 09:39:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:44.988 09:39:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:44.988 09:39:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:44.988 09:39:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:44.988 09:39:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:44.988 09:39:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:44.988 09:39:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:44.989 09:39:07 -- scripts/common.sh@335 -- # IFS=.-: 00:15:44.989 09:39:07 -- scripts/common.sh@335 -- # read -ra ver1 00:15:44.989 09:39:07 -- scripts/common.sh@336 -- # IFS=.-: 00:15:44.989 09:39:07 -- scripts/common.sh@336 -- # read -ra ver2 00:15:44.989 09:39:07 -- scripts/common.sh@337 -- # local 'op=<' 00:15:44.989 09:39:07 -- scripts/common.sh@339 -- # ver1_l=2 00:15:44.989 09:39:07 -- scripts/common.sh@340 -- # ver2_l=1 00:15:44.989 09:39:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:44.989 09:39:07 -- scripts/common.sh@343 -- # case "$op" in 00:15:44.989 09:39:07 -- scripts/common.sh@344 -- # : 1 00:15:44.989 09:39:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:44.989 09:39:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:44.989 09:39:07 -- scripts/common.sh@364 -- # decimal 1 00:15:44.989 09:39:07 -- scripts/common.sh@352 -- # local d=1 00:15:44.989 09:39:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:44.989 09:39:07 -- scripts/common.sh@354 -- # echo 1 00:15:44.989 09:39:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:44.989 09:39:07 -- scripts/common.sh@365 -- # decimal 2 00:15:44.989 09:39:07 -- scripts/common.sh@352 -- # local d=2 00:15:44.989 09:39:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:44.989 09:39:07 -- scripts/common.sh@354 -- # echo 2 00:15:44.989 09:39:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:44.989 09:39:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:44.989 09:39:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:44.989 09:39:07 -- scripts/common.sh@367 -- # return 0 00:15:44.989 09:39:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:44.989 09:39:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:44.989 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:44.989 --rc genhtml_branch_coverage=1 00:15:44.989 --rc genhtml_function_coverage=1 00:15:44.989 --rc genhtml_legend=1 00:15:44.989 --rc geninfo_all_blocks=1 00:15:44.989 --rc geninfo_unexecuted_blocks=1 00:15:44.989 00:15:44.989 ' 00:15:44.989 09:39:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:44.989 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:44.989 --rc genhtml_branch_coverage=1 00:15:44.989 --rc genhtml_function_coverage=1 00:15:44.989 --rc genhtml_legend=1 00:15:44.989 --rc geninfo_all_blocks=1 00:15:44.989 --rc geninfo_unexecuted_blocks=1 00:15:44.989 00:15:44.989 ' 00:15:44.989 09:39:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:44.989 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:44.989 --rc genhtml_branch_coverage=1 00:15:44.989 --rc genhtml_function_coverage=1 00:15:44.989 --rc genhtml_legend=1 00:15:44.989 --rc geninfo_all_blocks=1 00:15:44.989 --rc geninfo_unexecuted_blocks=1 00:15:44.989 00:15:44.989 ' 00:15:44.989 09:39:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:44.989 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:44.989 --rc genhtml_branch_coverage=1 00:15:44.989 --rc genhtml_function_coverage=1 00:15:44.989 --rc genhtml_legend=1 00:15:44.989 --rc geninfo_all_blocks=1 00:15:44.989 --rc geninfo_unexecuted_blocks=1 00:15:44.989 00:15:44.989 ' 00:15:44.989 09:39:07 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:44.989 09:39:07 -- nvmf/common.sh@7 -- # uname -s 00:15:44.989 09:39:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:44.989 09:39:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:44.989 09:39:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:44.989 09:39:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:44.989 09:39:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:44.989 09:39:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:44.989 09:39:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:44.989 09:39:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:44.989 09:39:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:44.989 09:39:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:44.989 09:39:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:44.989 09:39:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:44.989 09:39:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:44.989 09:39:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:44.989 09:39:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:44.989 09:39:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:44.989 09:39:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:44.989 09:39:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:44.989 09:39:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:44.989 09:39:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.989 09:39:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.989 09:39:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.989 09:39:07 -- paths/export.sh@5 -- # export PATH 00:15:44.989 09:39:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:44.989 09:39:07 -- nvmf/common.sh@46 -- # : 0 00:15:44.989 09:39:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:44.989 09:39:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:44.989 09:39:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:44.989 09:39:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:44.989 09:39:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:44.989 09:39:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:44.989 09:39:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:44.989 09:39:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:44.989 09:39:07 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:44.989 09:39:07 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:44.989 09:39:07 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:44.989 09:39:07 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:44.989 09:39:07 -- target/multipath.sh@43 -- # nvmftestinit 00:15:44.989 09:39:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:44.989 09:39:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:44.989 09:39:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:44.989 09:39:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:44.989 09:39:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:44.989 09:39:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:44.989 09:39:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:44.989 09:39:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:44.989 09:39:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:44.989 09:39:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:44.989 09:39:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:44.989 09:39:07 -- common/autotest_common.sh@10 -- # set +x 00:15:46.912 09:39:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:46.912 09:39:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:46.912 09:39:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:46.912 09:39:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:46.912 09:39:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:46.912 09:39:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:46.912 09:39:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:46.912 09:39:09 -- nvmf/common.sh@294 -- # net_devs=() 00:15:46.912 09:39:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:46.912 09:39:09 -- nvmf/common.sh@295 -- # e810=() 00:15:46.912 09:39:09 -- nvmf/common.sh@295 -- # local -ga e810 00:15:46.912 09:39:09 -- nvmf/common.sh@296 -- # x722=() 00:15:46.912 09:39:09 -- nvmf/common.sh@296 -- # local -ga x722 00:15:46.912 09:39:09 -- nvmf/common.sh@297 -- # mlx=() 00:15:46.912 09:39:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:46.912 09:39:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:46.912 09:39:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:46.912 09:39:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:46.912 09:39:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:46.912 09:39:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:46.912 09:39:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:46.912 09:39:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:46.912 09:39:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:46.912 09:39:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:46.912 09:39:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:46.912 09:39:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:46.912 09:39:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:46.912 09:39:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:46.912 09:39:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:46.912 09:39:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:46.912 09:39:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:46.912 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:46.912 09:39:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:46.912 09:39:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:46.912 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:46.912 09:39:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:46.912 09:39:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:46.912 09:39:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:46.912 09:39:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:46.912 09:39:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:46.912 09:39:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:46.912 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:46.912 09:39:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:46.912 09:39:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:46.912 09:39:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:46.912 09:39:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:46.912 09:39:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:46.912 09:39:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:46.912 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:46.912 09:39:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:46.912 09:39:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:46.912 09:39:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:46.912 09:39:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:46.912 09:39:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:46.912 09:39:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:46.912 09:39:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:46.912 09:39:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:46.912 09:39:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:46.912 09:39:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:46.912 09:39:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:46.912 09:39:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:46.912 09:39:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:46.912 09:39:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:46.912 09:39:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:46.912 09:39:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:46.912 09:39:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:46.912 09:39:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:46.912 09:39:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:46.912 09:39:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:46.912 09:39:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:46.912 09:39:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:46.912 09:39:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:46.912 09:39:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:46.912 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:46.912 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.173 ms 00:15:46.912 00:15:46.912 --- 10.0.0.2 ping statistics --- 00:15:46.912 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:46.912 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:15:46.912 09:39:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:46.912 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:46.912 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.136 ms 00:15:46.912 00:15:46.912 --- 10.0.0.1 ping statistics --- 00:15:46.912 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:46.912 rtt min/avg/max/mdev = 0.136/0.136/0.136/0.000 ms 00:15:46.912 09:39:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:46.912 09:39:09 -- nvmf/common.sh@410 -- # return 0 00:15:46.912 09:39:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:46.912 09:39:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:46.912 09:39:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:46.912 09:39:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:46.912 09:39:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:46.912 09:39:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:46.912 09:39:09 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:46.912 09:39:09 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:46.912 only one NIC for nvmf test 00:15:46.912 09:39:09 -- target/multipath.sh@47 -- # nvmftestfini 00:15:46.912 09:39:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:46.912 09:39:09 -- nvmf/common.sh@116 -- # sync 00:15:46.912 09:39:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:46.912 09:39:09 -- nvmf/common.sh@119 -- # set +e 00:15:46.912 09:39:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:46.912 09:39:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:46.912 rmmod nvme_tcp 00:15:47.173 rmmod nvme_fabrics 00:15:47.173 rmmod nvme_keyring 00:15:47.173 09:39:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:47.173 09:39:09 -- nvmf/common.sh@123 -- # set -e 00:15:47.173 09:39:09 -- nvmf/common.sh@124 -- # return 0 00:15:47.173 09:39:09 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:47.173 09:39:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:47.173 09:39:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:47.173 09:39:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:47.173 09:39:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:47.173 09:39:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:47.173 09:39:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:47.173 09:39:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:47.173 09:39:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:49.084 09:39:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:49.084 09:39:11 -- target/multipath.sh@48 -- # exit 0 00:15:49.084 09:39:11 -- target/multipath.sh@1 -- # nvmftestfini 00:15:49.084 09:39:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:49.084 09:39:11 -- nvmf/common.sh@116 -- # sync 00:15:49.084 09:39:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:49.084 09:39:11 -- nvmf/common.sh@119 -- # set +e 00:15:49.084 09:39:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:49.084 09:39:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:49.084 09:39:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:49.084 09:39:11 -- nvmf/common.sh@123 -- # set -e 00:15:49.084 09:39:11 -- nvmf/common.sh@124 -- # return 0 00:15:49.084 09:39:11 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:49.084 09:39:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:49.084 09:39:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:49.084 09:39:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:49.084 09:39:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:49.084 09:39:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:49.084 09:39:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:49.084 09:39:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:49.084 09:39:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:49.084 09:39:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:49.084 00:15:49.084 real 0m4.307s 00:15:49.084 user 0m0.813s 00:15:49.084 sys 0m1.477s 00:15:49.084 09:39:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:49.084 09:39:11 -- common/autotest_common.sh@10 -- # set +x 00:15:49.084 ************************************ 00:15:49.084 END TEST nvmf_multipath 00:15:49.084 ************************************ 00:15:49.084 09:39:11 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:49.084 09:39:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:49.084 09:39:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:49.084 09:39:11 -- common/autotest_common.sh@10 -- # set +x 00:15:49.084 ************************************ 00:15:49.084 START TEST nvmf_zcopy 00:15:49.084 ************************************ 00:15:49.084 09:39:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:49.084 * Looking for test storage... 00:15:49.084 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:49.084 09:39:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:49.084 09:39:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:49.084 09:39:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:49.345 09:39:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:49.345 09:39:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:49.345 09:39:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:49.345 09:39:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:49.345 09:39:11 -- scripts/common.sh@335 -- # IFS=.-: 00:15:49.345 09:39:11 -- scripts/common.sh@335 -- # read -ra ver1 00:15:49.345 09:39:11 -- scripts/common.sh@336 -- # IFS=.-: 00:15:49.345 09:39:11 -- scripts/common.sh@336 -- # read -ra ver2 00:15:49.345 09:39:11 -- scripts/common.sh@337 -- # local 'op=<' 00:15:49.345 09:39:12 -- scripts/common.sh@339 -- # ver1_l=2 00:15:49.345 09:39:12 -- scripts/common.sh@340 -- # ver2_l=1 00:15:49.345 09:39:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:49.345 09:39:12 -- scripts/common.sh@343 -- # case "$op" in 00:15:49.345 09:39:12 -- scripts/common.sh@344 -- # : 1 00:15:49.345 09:39:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:49.345 09:39:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:49.345 09:39:12 -- scripts/common.sh@364 -- # decimal 1 00:15:49.345 09:39:12 -- scripts/common.sh@352 -- # local d=1 00:15:49.345 09:39:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:49.345 09:39:12 -- scripts/common.sh@354 -- # echo 1 00:15:49.345 09:39:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:49.345 09:39:12 -- scripts/common.sh@365 -- # decimal 2 00:15:49.345 09:39:12 -- scripts/common.sh@352 -- # local d=2 00:15:49.345 09:39:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:49.345 09:39:12 -- scripts/common.sh@354 -- # echo 2 00:15:49.345 09:39:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:49.345 09:39:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:49.345 09:39:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:49.345 09:39:12 -- scripts/common.sh@367 -- # return 0 00:15:49.345 09:39:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:49.345 09:39:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:49.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:49.345 --rc genhtml_branch_coverage=1 00:15:49.345 --rc genhtml_function_coverage=1 00:15:49.345 --rc genhtml_legend=1 00:15:49.345 --rc geninfo_all_blocks=1 00:15:49.345 --rc geninfo_unexecuted_blocks=1 00:15:49.345 00:15:49.345 ' 00:15:49.345 09:39:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:49.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:49.345 --rc genhtml_branch_coverage=1 00:15:49.345 --rc genhtml_function_coverage=1 00:15:49.345 --rc genhtml_legend=1 00:15:49.345 --rc geninfo_all_blocks=1 00:15:49.345 --rc geninfo_unexecuted_blocks=1 00:15:49.345 00:15:49.345 ' 00:15:49.345 09:39:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:49.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:49.345 --rc genhtml_branch_coverage=1 00:15:49.345 --rc genhtml_function_coverage=1 00:15:49.345 --rc genhtml_legend=1 00:15:49.345 --rc geninfo_all_blocks=1 00:15:49.345 --rc geninfo_unexecuted_blocks=1 00:15:49.345 00:15:49.345 ' 00:15:49.345 09:39:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:49.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:49.345 --rc genhtml_branch_coverage=1 00:15:49.345 --rc genhtml_function_coverage=1 00:15:49.345 --rc genhtml_legend=1 00:15:49.345 --rc geninfo_all_blocks=1 00:15:49.345 --rc geninfo_unexecuted_blocks=1 00:15:49.345 00:15:49.346 ' 00:15:49.346 09:39:12 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:49.346 09:39:12 -- nvmf/common.sh@7 -- # uname -s 00:15:49.346 09:39:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:49.346 09:39:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:49.346 09:39:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:49.346 09:39:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:49.346 09:39:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:49.346 09:39:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:49.346 09:39:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:49.346 09:39:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:49.346 09:39:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:49.346 09:39:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:49.346 09:39:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:49.346 09:39:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:49.346 09:39:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:49.346 09:39:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:49.346 09:39:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:49.346 09:39:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:49.346 09:39:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:49.346 09:39:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:49.346 09:39:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:49.346 09:39:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.346 09:39:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.346 09:39:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.346 09:39:12 -- paths/export.sh@5 -- # export PATH 00:15:49.346 09:39:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.346 09:39:12 -- nvmf/common.sh@46 -- # : 0 00:15:49.346 09:39:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:49.346 09:39:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:49.346 09:39:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:49.346 09:39:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:49.346 09:39:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:49.346 09:39:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:49.346 09:39:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:49.346 09:39:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:49.346 09:39:12 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:49.346 09:39:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:49.346 09:39:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:49.346 09:39:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:49.346 09:39:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:49.346 09:39:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:49.346 09:39:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:49.346 09:39:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:49.346 09:39:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:49.346 09:39:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:49.346 09:39:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:49.346 09:39:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:49.346 09:39:12 -- common/autotest_common.sh@10 -- # set +x 00:15:51.254 09:39:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:51.254 09:39:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:51.254 09:39:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:51.254 09:39:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:51.254 09:39:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:51.254 09:39:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:51.254 09:39:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:51.254 09:39:13 -- nvmf/common.sh@294 -- # net_devs=() 00:15:51.254 09:39:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:51.254 09:39:13 -- nvmf/common.sh@295 -- # e810=() 00:15:51.254 09:39:13 -- nvmf/common.sh@295 -- # local -ga e810 00:15:51.254 09:39:13 -- nvmf/common.sh@296 -- # x722=() 00:15:51.254 09:39:13 -- nvmf/common.sh@296 -- # local -ga x722 00:15:51.254 09:39:13 -- nvmf/common.sh@297 -- # mlx=() 00:15:51.254 09:39:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:51.254 09:39:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:51.254 09:39:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:51.254 09:39:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:51.254 09:39:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:51.254 09:39:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:51.254 09:39:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:51.254 09:39:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:51.254 09:39:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:51.254 09:39:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:51.254 09:39:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:51.254 09:39:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:51.254 09:39:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:51.254 09:39:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:51.254 09:39:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:51.254 09:39:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:51.254 09:39:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:51.254 09:39:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:51.254 09:39:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:51.254 09:39:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:51.254 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:51.254 09:39:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:51.254 09:39:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:51.254 09:39:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:51.254 09:39:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:51.254 09:39:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:51.254 09:39:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:51.254 09:39:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:51.254 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:51.254 09:39:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:51.254 09:39:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:51.254 09:39:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:51.254 09:39:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:51.254 09:39:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:51.254 09:39:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:51.255 09:39:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:51.255 09:39:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:51.255 09:39:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:51.255 09:39:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:51.255 09:39:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:51.255 09:39:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:51.255 09:39:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:51.255 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:51.255 09:39:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:51.255 09:39:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:51.255 09:39:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:51.255 09:39:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:51.255 09:39:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:51.255 09:39:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:51.255 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:51.255 09:39:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:51.255 09:39:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:51.255 09:39:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:51.255 09:39:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:51.255 09:39:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:51.255 09:39:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:51.255 09:39:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:51.255 09:39:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:51.255 09:39:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:51.255 09:39:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:51.255 09:39:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:51.255 09:39:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:51.255 09:39:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:51.255 09:39:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:51.255 09:39:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:51.255 09:39:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:51.255 09:39:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:51.255 09:39:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:51.255 09:39:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:51.255 09:39:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:51.255 09:39:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:51.255 09:39:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:51.255 09:39:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:51.516 09:39:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:51.516 09:39:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:51.516 09:39:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:51.516 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:51.516 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:15:51.516 00:15:51.516 --- 10.0.0.2 ping statistics --- 00:15:51.516 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:51.516 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:15:51.516 09:39:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:51.516 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:51.516 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:15:51.516 00:15:51.516 --- 10.0.0.1 ping statistics --- 00:15:51.516 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:51.516 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:15:51.516 09:39:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:51.516 09:39:14 -- nvmf/common.sh@410 -- # return 0 00:15:51.516 09:39:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:51.516 09:39:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:51.516 09:39:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:51.516 09:39:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:51.516 09:39:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:51.516 09:39:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:51.516 09:39:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:51.516 09:39:14 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:51.516 09:39:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:51.516 09:39:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:51.516 09:39:14 -- common/autotest_common.sh@10 -- # set +x 00:15:51.516 09:39:14 -- nvmf/common.sh@469 -- # nvmfpid=24198 00:15:51.516 09:39:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:51.516 09:39:14 -- nvmf/common.sh@470 -- # waitforlisten 24198 00:15:51.516 09:39:14 -- common/autotest_common.sh@829 -- # '[' -z 24198 ']' 00:15:51.516 09:39:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:51.516 09:39:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:51.516 09:39:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:51.516 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:51.516 09:39:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:51.516 09:39:14 -- common/autotest_common.sh@10 -- # set +x 00:15:51.516 [2024-11-29 09:39:14.186791] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:51.516 [2024-11-29 09:39:14.186862] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:51.516 EAL: No free 2048 kB hugepages reported on node 1 00:15:51.516 [2024-11-29 09:39:14.247838] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:51.517 [2024-11-29 09:39:14.356248] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:51.517 [2024-11-29 09:39:14.356426] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:51.517 [2024-11-29 09:39:14.356445] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:51.517 [2024-11-29 09:39:14.356458] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:51.517 [2024-11-29 09:39:14.356493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:52.471 09:39:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:52.471 09:39:15 -- common/autotest_common.sh@862 -- # return 0 00:15:52.471 09:39:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:52.471 09:39:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:52.471 09:39:15 -- common/autotest_common.sh@10 -- # set +x 00:15:52.471 09:39:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:52.471 09:39:15 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:52.471 09:39:15 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:52.471 09:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:52.471 09:39:15 -- common/autotest_common.sh@10 -- # set +x 00:15:52.471 [2024-11-29 09:39:15.203275] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:52.471 09:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:52.471 09:39:15 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:52.472 09:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:52.472 09:39:15 -- common/autotest_common.sh@10 -- # set +x 00:15:52.472 09:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:52.472 09:39:15 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:52.472 09:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:52.472 09:39:15 -- common/autotest_common.sh@10 -- # set +x 00:15:52.472 [2024-11-29 09:39:15.219497] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:52.472 09:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:52.472 09:39:15 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:52.472 09:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:52.472 09:39:15 -- common/autotest_common.sh@10 -- # set +x 00:15:52.472 09:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:52.472 09:39:15 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:52.472 09:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:52.472 09:39:15 -- common/autotest_common.sh@10 -- # set +x 00:15:52.472 malloc0 00:15:52.472 09:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:52.472 09:39:15 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:52.472 09:39:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:52.472 09:39:15 -- common/autotest_common.sh@10 -- # set +x 00:15:52.472 09:39:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:52.472 09:39:15 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:52.472 09:39:15 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:52.472 09:39:15 -- nvmf/common.sh@520 -- # config=() 00:15:52.472 09:39:15 -- nvmf/common.sh@520 -- # local subsystem config 00:15:52.472 09:39:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:52.472 09:39:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:52.472 { 00:15:52.473 "params": { 00:15:52.473 "name": "Nvme$subsystem", 00:15:52.473 "trtype": "$TEST_TRANSPORT", 00:15:52.473 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:52.473 "adrfam": "ipv4", 00:15:52.473 "trsvcid": "$NVMF_PORT", 00:15:52.473 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:52.473 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:52.473 "hdgst": ${hdgst:-false}, 00:15:52.473 "ddgst": ${ddgst:-false} 00:15:52.473 }, 00:15:52.473 "method": "bdev_nvme_attach_controller" 00:15:52.473 } 00:15:52.473 EOF 00:15:52.473 )") 00:15:52.473 09:39:15 -- nvmf/common.sh@542 -- # cat 00:15:52.473 09:39:15 -- nvmf/common.sh@544 -- # jq . 00:15:52.473 09:39:15 -- nvmf/common.sh@545 -- # IFS=, 00:15:52.473 09:39:15 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:52.473 "params": { 00:15:52.473 "name": "Nvme1", 00:15:52.473 "trtype": "tcp", 00:15:52.473 "traddr": "10.0.0.2", 00:15:52.473 "adrfam": "ipv4", 00:15:52.473 "trsvcid": "4420", 00:15:52.473 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:52.473 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:52.473 "hdgst": false, 00:15:52.473 "ddgst": false 00:15:52.473 }, 00:15:52.473 "method": "bdev_nvme_attach_controller" 00:15:52.473 }' 00:15:52.473 [2024-11-29 09:39:15.288064] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:52.473 [2024-11-29 09:39:15.288153] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid24356 ] 00:15:52.731 EAL: No free 2048 kB hugepages reported on node 1 00:15:52.731 [2024-11-29 09:39:15.352716] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:52.731 [2024-11-29 09:39:15.470182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:52.989 Running I/O for 10 seconds... 00:16:02.979 00:16:02.979 Latency(us) 00:16:02.979 [2024-11-29T08:39:25.822Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:02.979 [2024-11-29T08:39:25.822Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:02.979 Verification LBA range: start 0x0 length 0x1000 00:16:02.979 Nvme1n1 : 10.01 8676.73 67.79 0.00 0.00 14716.86 1450.29 22524.97 00:16:02.979 [2024-11-29T08:39:25.822Z] =================================================================================================================== 00:16:02.979 [2024-11-29T08:39:25.822Z] Total : 8676.73 67.79 0.00 0.00 14716.86 1450.29 22524.97 00:16:03.548 09:39:26 -- target/zcopy.sh@39 -- # perfpid=25664 00:16:03.548 09:39:26 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:03.548 09:39:26 -- common/autotest_common.sh@10 -- # set +x 00:16:03.548 09:39:26 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:03.548 09:39:26 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:03.548 09:39:26 -- nvmf/common.sh@520 -- # config=() 00:16:03.548 09:39:26 -- nvmf/common.sh@520 -- # local subsystem config 00:16:03.549 09:39:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:03.549 09:39:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:03.549 { 00:16:03.549 "params": { 00:16:03.549 "name": "Nvme$subsystem", 00:16:03.549 "trtype": "$TEST_TRANSPORT", 00:16:03.549 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:03.549 "adrfam": "ipv4", 00:16:03.549 "trsvcid": "$NVMF_PORT", 00:16:03.549 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:03.549 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:03.549 "hdgst": ${hdgst:-false}, 00:16:03.549 "ddgst": ${ddgst:-false} 00:16:03.549 }, 00:16:03.549 "method": "bdev_nvme_attach_controller" 00:16:03.549 } 00:16:03.549 EOF 00:16:03.549 )") 00:16:03.549 09:39:26 -- nvmf/common.sh@542 -- # cat 00:16:03.549 [2024-11-29 09:39:26.100832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.100880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 09:39:26 -- nvmf/common.sh@544 -- # jq . 00:16:03.549 09:39:26 -- nvmf/common.sh@545 -- # IFS=, 00:16:03.549 09:39:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:03.549 "params": { 00:16:03.549 "name": "Nvme1", 00:16:03.549 "trtype": "tcp", 00:16:03.549 "traddr": "10.0.0.2", 00:16:03.549 "adrfam": "ipv4", 00:16:03.549 "trsvcid": "4420", 00:16:03.549 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:03.549 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:03.549 "hdgst": false, 00:16:03.549 "ddgst": false 00:16:03.549 }, 00:16:03.549 "method": "bdev_nvme_attach_controller" 00:16:03.549 }' 00:16:03.549 [2024-11-29 09:39:26.108796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.108823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.116817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.116843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.124837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.124862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.132859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.132893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.137110] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:03.549 [2024-11-29 09:39:26.137195] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid25664 ] 00:16:03.549 [2024-11-29 09:39:26.140882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.140908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.148904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.148928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.156928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.156953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.164949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.164973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 EAL: No free 2048 kB hugepages reported on node 1 00:16:03.549 [2024-11-29 09:39:26.172972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.172996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.180997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.181022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.189021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.189046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.197044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.197068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.202991] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:03.549 [2024-11-29 09:39:26.205065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.205089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.213121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.213159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.221124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.221157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.229135] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.229160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.237155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.237180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.245178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.245203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.253202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.253228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.261227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.261251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.269262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.269294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.277303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.277344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.285292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.285318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.293315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.293340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.301337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.301361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.309358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.309383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.317380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.317412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.324487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:03.549 [2024-11-29 09:39:26.325409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.325434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.333429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.333453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.341471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.341506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.349503] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.349544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.357521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.357562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.365546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.365590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.373567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.373611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.381589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.381630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.549 [2024-11-29 09:39:26.389611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.549 [2024-11-29 09:39:26.389653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.809 [2024-11-29 09:39:26.397603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.809 [2024-11-29 09:39:26.397629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.809 [2024-11-29 09:39:26.405652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.809 [2024-11-29 09:39:26.405692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.809 [2024-11-29 09:39:26.413676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.809 [2024-11-29 09:39:26.413727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.809 [2024-11-29 09:39:26.421679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.809 [2024-11-29 09:39:26.421709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.809 [2024-11-29 09:39:26.429692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.809 [2024-11-29 09:39:26.429717] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.809 [2024-11-29 09:39:26.437714] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.809 [2024-11-29 09:39:26.437738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.809 [2024-11-29 09:39:26.445761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.809 [2024-11-29 09:39:26.445792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.809 [2024-11-29 09:39:26.453772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.809 [2024-11-29 09:39:26.453800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.809 [2024-11-29 09:39:26.461794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.809 [2024-11-29 09:39:26.461821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.809 [2024-11-29 09:39:26.469855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.809 [2024-11-29 09:39:26.469883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.809 [2024-11-29 09:39:26.477840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.809 [2024-11-29 09:39:26.477868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.809 [2024-11-29 09:39:26.485856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.809 [2024-11-29 09:39:26.485883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.809 [2024-11-29 09:39:26.493877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.493902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.501899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.501924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.509922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.509947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.517943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.517968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.525976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.526002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.533993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.534018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.542019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.542044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.550039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.550063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.558059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.558083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.566117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.566152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.574110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.574137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.582131] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.582156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.590153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.590177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.598179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.598203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.606203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.606227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.614232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.614257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.622254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.622278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 [2024-11-29 09:39:26.630285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.630314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.810 Running I/O for 5 seconds... 00:16:03.810 [2024-11-29 09:39:26.638305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.810 [2024-11-29 09:39:26.638330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.651972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.652006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.662685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.662717] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.673775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.673806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.687131] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.687163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.698045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.698076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.708748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.708779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.721611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.721642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.731611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.731642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.742346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.742377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.753371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.753414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.765711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.765741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.775239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.775270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.786526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.786557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.797561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.797591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.808235] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.808266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.819016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.819048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.829908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.829939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.840680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.840712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.851598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.851629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.070 [2024-11-29 09:39:26.864537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.070 [2024-11-29 09:39:26.864567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.071 [2024-11-29 09:39:26.874295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.071 [2024-11-29 09:39:26.874326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.071 [2024-11-29 09:39:26.885018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.071 [2024-11-29 09:39:26.885049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.071 [2024-11-29 09:39:26.897761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.071 [2024-11-29 09:39:26.897792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.071 [2024-11-29 09:39:26.907762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.071 [2024-11-29 09:39:26.907793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:26.918458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:26.918490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:26.931769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:26.931799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:26.941510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:26.941541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:26.952443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:26.952474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:26.965173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:26.965204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:26.975476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:26.975507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:26.986118] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:26.986149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:26.999250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:26.999280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.009195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.009225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.019795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.019826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.030605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.030636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.041323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.041353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.054454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.054485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.064786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.064818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.075570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.075600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.088410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.088441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.097890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.097921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.109776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.109807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.122907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.122940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.133691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.133722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.144753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.144785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.155741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.155772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.330 [2024-11-29 09:39:27.166835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.330 [2024-11-29 09:39:27.166867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.591 [2024-11-29 09:39:27.179681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.591 [2024-11-29 09:39:27.179712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.591 [2024-11-29 09:39:27.190238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.591 [2024-11-29 09:39:27.190269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.591 [2024-11-29 09:39:27.201173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.591 [2024-11-29 09:39:27.201205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.591 [2024-11-29 09:39:27.214537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.591 [2024-11-29 09:39:27.214568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.591 [2024-11-29 09:39:27.224751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.591 [2024-11-29 09:39:27.224782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.591 [2024-11-29 09:39:27.235780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.591 [2024-11-29 09:39:27.235812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.591 [2024-11-29 09:39:27.248379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.591 [2024-11-29 09:39:27.248419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.591 [2024-11-29 09:39:27.259228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.591 [2024-11-29 09:39:27.259259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.591 [2024-11-29 09:39:27.270257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.591 [2024-11-29 09:39:27.270287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.591 [2024-11-29 09:39:27.281636] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.591 [2024-11-29 09:39:27.281668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.591 [2024-11-29 09:39:27.292747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.591 [2024-11-29 09:39:27.292779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.591 [2024-11-29 09:39:27.303334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.591 [2024-11-29 09:39:27.303364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.591 [2024-11-29 09:39:27.314108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.591 [2024-11-29 09:39:27.314139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.591 [2024-11-29 09:39:27.326697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.591 [2024-11-29 09:39:27.326728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.592 [2024-11-29 09:39:27.336633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.592 [2024-11-29 09:39:27.336663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.592 [2024-11-29 09:39:27.347856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.592 [2024-11-29 09:39:27.347887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.592 [2024-11-29 09:39:27.361336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.592 [2024-11-29 09:39:27.361367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.592 [2024-11-29 09:39:27.371898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.592 [2024-11-29 09:39:27.371928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.592 [2024-11-29 09:39:27.383090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.592 [2024-11-29 09:39:27.383121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.592 [2024-11-29 09:39:27.396191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.592 [2024-11-29 09:39:27.396222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.592 [2024-11-29 09:39:27.406689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.592 [2024-11-29 09:39:27.406720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.592 [2024-11-29 09:39:27.417305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.592 [2024-11-29 09:39:27.417336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.592 [2024-11-29 09:39:27.428421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.592 [2024-11-29 09:39:27.428452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.439683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.439715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.452602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.452632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.463127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.463157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.474307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.474337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.487199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.487229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.497756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.497786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.508476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.508507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.519683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.519714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.530537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.530567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.543625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.543656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.554155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.554185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.564637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.564668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.575325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.575355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.586476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.586506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.597391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.597441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.610025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.610055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.619145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.619176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.632473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.632503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.642719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.642750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.654031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.654063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.666889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.666920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.677459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.677491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.854 [2024-11-29 09:39:27.689162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.854 [2024-11-29 09:39:27.689194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.700505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.700537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.713627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.713658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.724324] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.724355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.735460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.735492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.748644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.748675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.759523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.759554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.770407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.770437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.782848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.782879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.793279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.793310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.804254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.804284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.817278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.817332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.828008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.828039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.838926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.838957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.851619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.851651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.861690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.861721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.872536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.872567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.883195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.883226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.894126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.894156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.905067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.905098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.916957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.916989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.115 [2024-11-29 09:39:27.927843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.115 [2024-11-29 09:39:27.927875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.116 [2024-11-29 09:39:27.940494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.116 [2024-11-29 09:39:27.940533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.116 [2024-11-29 09:39:27.950138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.116 [2024-11-29 09:39:27.950169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.376 [2024-11-29 09:39:27.961333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.376 [2024-11-29 09:39:27.961365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.376 [2024-11-29 09:39:27.972154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.376 [2024-11-29 09:39:27.972184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.376 [2024-11-29 09:39:27.984530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.376 [2024-11-29 09:39:27.984561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.376 [2024-11-29 09:39:27.994573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.376 [2024-11-29 09:39:27.994603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.376 [2024-11-29 09:39:28.006559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.376 [2024-11-29 09:39:28.006590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.376 [2024-11-29 09:39:28.019748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.376 [2024-11-29 09:39:28.019778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.376 [2024-11-29 09:39:28.030458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.376 [2024-11-29 09:39:28.030498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.376 [2024-11-29 09:39:28.041480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.376 [2024-11-29 09:39:28.041512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.376 [2024-11-29 09:39:28.054132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.376 [2024-11-29 09:39:28.054163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.376 [2024-11-29 09:39:28.064390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.376 [2024-11-29 09:39:28.064429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.376 [2024-11-29 09:39:28.075548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.376 [2024-11-29 09:39:28.075579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.376 [2024-11-29 09:39:28.088595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.376 [2024-11-29 09:39:28.088626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.376 [2024-11-29 09:39:28.098669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.376 [2024-11-29 09:39:28.098700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.376 [2024-11-29 09:39:28.109693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.376 [2024-11-29 09:39:28.109723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.377 [2024-11-29 09:39:28.120400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.377 [2024-11-29 09:39:28.120432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.377 [2024-11-29 09:39:28.131630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.377 [2024-11-29 09:39:28.131661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.377 [2024-11-29 09:39:28.142855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.377 [2024-11-29 09:39:28.142885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.377 [2024-11-29 09:39:28.155667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.377 [2024-11-29 09:39:28.155698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.377 [2024-11-29 09:39:28.166275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.377 [2024-11-29 09:39:28.166306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.377 [2024-11-29 09:39:28.177113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.377 [2024-11-29 09:39:28.177144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.377 [2024-11-29 09:39:28.187887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.377 [2024-11-29 09:39:28.187918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.377 [2024-11-29 09:39:28.198957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.377 [2024-11-29 09:39:28.198987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.377 [2024-11-29 09:39:28.212045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.377 [2024-11-29 09:39:28.212076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.637 [2024-11-29 09:39:28.222689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.222722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.233740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.233770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.246506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.246546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.256586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.256617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.267601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.267631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.280377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.280419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.290721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.290752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.301693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.301725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.312772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.312804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.323317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.323349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.334185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.334217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.346854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.346886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.356591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.356623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.367975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.368006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.379110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.379142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.389866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.389897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.402713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.402744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.413652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.413683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.424332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.424364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.435359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.435390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.446177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.446208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.459252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.459282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.638 [2024-11-29 09:39:28.469560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.638 [2024-11-29 09:39:28.469591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.898 [2024-11-29 09:39:28.480403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.480434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.492871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.492902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.502539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.502569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.514161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.514191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.526821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.526852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.536791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.536821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.547478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.547509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.560547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.560578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.570858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.570888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.581747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.581777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.594693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.594724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.604373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.604413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.616256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.616288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.626973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.627004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.637904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.637935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.648763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.648794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.661857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.661888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.672293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.672323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.683268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.683298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.696083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.696113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.706391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.706430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.717030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.717060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.729514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.729544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.899 [2024-11-29 09:39:28.739526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.899 [2024-11-29 09:39:28.739557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.750306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.750338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.763228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.763260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.773276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.773306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.784088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.784119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.796623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.796654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.806885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.806916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.818580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.818611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.829446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.829476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.840308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.840339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.851261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.851291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.862093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.862123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.872924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.872956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.885612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.885643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.895874] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.895904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.906532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.906563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.917271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.917302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.927941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.927972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.938525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.938555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.951327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.951357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.962326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.962355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.973506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.973537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.984351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.984400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.159 [2024-11-29 09:39:28.995217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.159 [2024-11-29 09:39:28.995247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.418 [2024-11-29 09:39:29.007995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.418 [2024-11-29 09:39:29.008026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.418 [2024-11-29 09:39:29.017727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.418 [2024-11-29 09:39:29.017758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.418 [2024-11-29 09:39:29.029291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.418 [2024-11-29 09:39:29.029320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.418 [2024-11-29 09:39:29.042074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.418 [2024-11-29 09:39:29.042105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.418 [2024-11-29 09:39:29.052604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.418 [2024-11-29 09:39:29.052635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.418 [2024-11-29 09:39:29.063579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.418 [2024-11-29 09:39:29.063610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.418 [2024-11-29 09:39:29.074943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.418 [2024-11-29 09:39:29.074974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.418 [2024-11-29 09:39:29.085755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.418 [2024-11-29 09:39:29.085785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.418 [2024-11-29 09:39:29.098980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.099010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.419 [2024-11-29 09:39:29.109326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.109356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.419 [2024-11-29 09:39:29.120057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.120087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.419 [2024-11-29 09:39:29.132385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.132426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.419 [2024-11-29 09:39:29.141825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.141855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.419 [2024-11-29 09:39:29.153104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.153134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.419 [2024-11-29 09:39:29.164250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.164284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.419 [2024-11-29 09:39:29.175276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.175307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.419 [2024-11-29 09:39:29.188387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.188429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.419 [2024-11-29 09:39:29.199001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.199031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.419 [2024-11-29 09:39:29.210148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.210178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.419 [2024-11-29 09:39:29.223294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.223325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.419 [2024-11-29 09:39:29.233599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.233630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.419 [2024-11-29 09:39:29.244179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.244209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.419 [2024-11-29 09:39:29.255153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.419 [2024-11-29 09:39:29.255183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.677 [2024-11-29 09:39:29.266576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.677 [2024-11-29 09:39:29.266607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.677 [2024-11-29 09:39:29.277849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.677 [2024-11-29 09:39:29.277880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.677 [2024-11-29 09:39:29.288467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.677 [2024-11-29 09:39:29.288497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.677 [2024-11-29 09:39:29.299664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.677 [2024-11-29 09:39:29.299703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.677 [2024-11-29 09:39:29.312894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.677 [2024-11-29 09:39:29.312925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.677 [2024-11-29 09:39:29.323301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.677 [2024-11-29 09:39:29.323331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.677 [2024-11-29 09:39:29.333891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.677 [2024-11-29 09:39:29.333922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.677 [2024-11-29 09:39:29.344981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.677 [2024-11-29 09:39:29.345013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.677 [2024-11-29 09:39:29.355860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.355891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.678 [2024-11-29 09:39:29.368474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.368504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.678 [2024-11-29 09:39:29.378718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.378749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.678 [2024-11-29 09:39:29.389616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.389648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.678 [2024-11-29 09:39:29.402646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.402678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.678 [2024-11-29 09:39:29.412716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.412747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.678 [2024-11-29 09:39:29.423374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.423416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.678 [2024-11-29 09:39:29.433963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.433995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.678 [2024-11-29 09:39:29.444710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.444742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.678 [2024-11-29 09:39:29.455602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.455634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.678 [2024-11-29 09:39:29.468498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.468530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.678 [2024-11-29 09:39:29.478805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.478835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.678 [2024-11-29 09:39:29.489665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.489697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.678 [2024-11-29 09:39:29.502334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.502365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.678 [2024-11-29 09:39:29.512269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.678 [2024-11-29 09:39:29.512309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.524326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.524357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.535273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.535304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.546543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.546574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.557307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.557338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.568389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.568428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.579609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.579640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.592434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.592477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.603124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.603154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.614563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.614594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.624882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.624912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.636358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.636389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.649923] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.649954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.660758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.660789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.671910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.671941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.683458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.683488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.694632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.694663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.705328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.705359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.716347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.716378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.727063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.727104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.740070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.740100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.750379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.750418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.761600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.761631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.938 [2024-11-29 09:39:29.774511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.938 [2024-11-29 09:39:29.774542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.784400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.784432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.795717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.795748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.806766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.806796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.817500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.817530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.830340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.830371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.841278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.841308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.852710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.852740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.865956] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.865986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.876436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.876467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.887723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.887755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.900468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.900498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.910549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.910580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.922321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.922352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.932952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.932982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.943935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.943975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.956861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.956893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.967092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.967123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.978029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.978060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:29.990434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:29.990464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:30.000350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:30.000380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:30.011203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:30.011237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:30.024689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:30.024727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.199 [2024-11-29 09:39:30.035227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.199 [2024-11-29 09:39:30.035258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.046428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.046471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.059341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.059373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.069651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.069683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.080704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.080736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.093457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.093489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.103971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.104002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.115551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.115581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.128538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.128569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.138481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.138511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.149147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.149177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.161977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.162009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.172252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.172284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.182883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.182913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.193315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.193346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.204002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.204033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.216546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.216588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.226596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.226627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.237947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.237978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.249200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.249230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.260137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.260168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.270758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.270789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.281755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.281785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.458 [2024-11-29 09:39:30.292667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.458 [2024-11-29 09:39:30.292698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.305194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.305226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.314929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.314960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.325769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.325800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.338715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.338745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.349325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.349356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.359830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.359860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.371182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.371213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.382152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.382183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.393029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.393059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.403904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.403935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.414871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.414901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.427203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.427233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.437190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.437221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.448870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.448901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.461929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.461959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.471930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.471960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.483065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.717 [2024-11-29 09:39:30.483095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.717 [2024-11-29 09:39:30.495992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.718 [2024-11-29 09:39:30.496022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.718 [2024-11-29 09:39:30.505990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.718 [2024-11-29 09:39:30.506020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.718 [2024-11-29 09:39:30.517343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.718 [2024-11-29 09:39:30.517373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.718 [2024-11-29 09:39:30.528209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.718 [2024-11-29 09:39:30.528239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.718 [2024-11-29 09:39:30.539025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.718 [2024-11-29 09:39:30.539054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.718 [2024-11-29 09:39:30.551559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.718 [2024-11-29 09:39:30.551590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.561650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.561684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.572998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.573029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.583694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.583725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.594306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.594337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.605424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.605454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.616846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.616877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.628013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.628044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.639022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.639054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.649992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.650023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.660982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.661013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.671777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.671808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.684307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.684338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.694268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.694298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.705054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.705084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.717518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.717548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.727008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.727038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.738426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.738457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.748946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.748976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.759447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.759478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.769790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.769830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.779953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.779983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.791038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.791069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.801871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.801901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.978 [2024-11-29 09:39:30.812492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.978 [2024-11-29 09:39:30.812523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.239 [2024-11-29 09:39:30.825115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.239 [2024-11-29 09:39:30.825147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.239 [2024-11-29 09:39:30.835023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.239 [2024-11-29 09:39:30.835053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.239 [2024-11-29 09:39:30.845662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.239 [2024-11-29 09:39:30.845694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.239 [2024-11-29 09:39:30.856547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.239 [2024-11-29 09:39:30.856578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.239 [2024-11-29 09:39:30.869673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.239 [2024-11-29 09:39:30.869704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.239 [2024-11-29 09:39:30.880005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.239 [2024-11-29 09:39:30.880035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.239 [2024-11-29 09:39:30.890642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.239 [2024-11-29 09:39:30.890675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.239 [2024-11-29 09:39:30.901881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.239 [2024-11-29 09:39:30.901915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.239 [2024-11-29 09:39:30.912684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.239 [2024-11-29 09:39:30.912715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:30.923730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:30.923760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:30.934479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:30.934509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:30.947508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:30.947539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:30.957669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:30.957700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:30.968212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:30.968242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:30.980920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:30.980951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:30.990901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:30.990945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:31.002367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:31.002407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:31.012952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:31.012984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:31.023785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:31.023816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:31.036668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:31.036698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:31.047101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:31.047131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:31.057952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:31.057983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:31.070657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:31.070687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.240 [2024-11-29 09:39:31.080888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.240 [2024-11-29 09:39:31.080920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.091859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.091890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.104603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.104635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.114414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.114445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.125200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.125231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.135947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.135978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.146858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.146890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.159377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.159417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.169711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.169741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.180822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.180853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.193983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.194014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.204463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.204502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.215079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.215109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.227990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.228020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.237948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.237979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.248869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.248900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.259977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.260008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.270999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.271029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.283414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.283450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.293116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.293146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.304724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.304754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.317618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.317648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.327704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.327735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.501 [2024-11-29 09:39:31.338851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.501 [2024-11-29 09:39:31.338882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.349831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.349862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.361086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.361116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.374210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.374241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.384695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.384726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.395769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.395800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.408742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.408772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.418891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.418931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.429882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.429912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.440813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.440844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.452060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.452091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.464888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.464919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.475191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.475221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.486229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.486260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.503723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.503756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.513545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.513576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.524902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.524933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.535384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.535424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.546209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.546240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.557525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.557556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.568243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.568274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.580964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.580995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.590261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.590292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.762 [2024-11-29 09:39:31.601516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.762 [2024-11-29 09:39:31.601547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.022 [2024-11-29 09:39:31.612007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.022 [2024-11-29 09:39:31.612038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.022 [2024-11-29 09:39:31.622952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.022 [2024-11-29 09:39:31.622982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.022 [2024-11-29 09:39:31.635835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.022 [2024-11-29 09:39:31.635876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.022 [2024-11-29 09:39:31.647361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.022 [2024-11-29 09:39:31.647399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.022 [2024-11-29 09:39:31.655687] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.022 [2024-11-29 09:39:31.655717] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.022 00:16:09.022 Latency(us) 00:16:09.022 [2024-11-29T08:39:31.865Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:09.022 [2024-11-29T08:39:31.865Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:09.022 Nvme1n1 : 5.01 11640.90 90.94 0.00 0.00 10982.65 4684.61 21942.42 00:16:09.022 [2024-11-29T08:39:31.865Z] =================================================================================================================== 00:16:09.022 [2024-11-29T08:39:31.865Z] Total : 11640.90 90.94 0.00 0.00 10982.65 4684.61 21942.42 00:16:09.022 [2024-11-29 09:39:31.662755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.022 [2024-11-29 09:39:31.662784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.022 [2024-11-29 09:39:31.670775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.022 [2024-11-29 09:39:31.670803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.022 [2024-11-29 09:39:31.678793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.022 [2024-11-29 09:39:31.678820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.022 [2024-11-29 09:39:31.686857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.022 [2024-11-29 09:39:31.686905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.022 [2024-11-29 09:39:31.694894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.022 [2024-11-29 09:39:31.694949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.702908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.702958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.710931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.710981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.718955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.719005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.726975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.727026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.734999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.735048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.743035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.743093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.751045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.751095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.759067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.759119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.767089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.767140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.775105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.775165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.783129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.783177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.791151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.791199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.799147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.799185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.807145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.807170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.815167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.815192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.823201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.823230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.831217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.831244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.839275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.839322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.847309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.847357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.855311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.855354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.023 [2024-11-29 09:39:31.863305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.023 [2024-11-29 09:39:31.863329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.282 [2024-11-29 09:39:31.871324] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.282 [2024-11-29 09:39:31.871349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.282 [2024-11-29 09:39:31.879344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.282 [2024-11-29 09:39:31.879368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.282 [2024-11-29 09:39:31.887369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.282 [2024-11-29 09:39:31.887405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.282 [2024-11-29 09:39:31.895436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.282 [2024-11-29 09:39:31.895476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.282 [2024-11-29 09:39:31.903473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.282 [2024-11-29 09:39:31.903523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.283 [2024-11-29 09:39:31.911473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.283 [2024-11-29 09:39:31.911513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.283 [2024-11-29 09:39:31.919463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.283 [2024-11-29 09:39:31.919488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.283 [2024-11-29 09:39:31.927475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.283 [2024-11-29 09:39:31.927500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.283 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (25664) - No such process 00:16:09.283 09:39:31 -- target/zcopy.sh@49 -- # wait 25664 00:16:09.283 09:39:31 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:09.283 09:39:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:09.283 09:39:31 -- common/autotest_common.sh@10 -- # set +x 00:16:09.283 09:39:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:09.283 09:39:31 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:09.283 09:39:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:09.283 09:39:31 -- common/autotest_common.sh@10 -- # set +x 00:16:09.283 delay0 00:16:09.283 09:39:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:09.283 09:39:31 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:09.283 09:39:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:09.283 09:39:31 -- common/autotest_common.sh@10 -- # set +x 00:16:09.283 09:39:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:09.283 09:39:31 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:09.283 EAL: No free 2048 kB hugepages reported on node 1 00:16:09.283 [2024-11-29 09:39:32.049334] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:15.854 Initializing NVMe Controllers 00:16:15.854 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:15.854 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:15.854 Initialization complete. Launching workers. 00:16:15.854 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 107 00:16:15.854 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 394, failed to submit 33 00:16:15.854 success 253, unsuccess 141, failed 0 00:16:15.854 09:39:38 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:15.854 09:39:38 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:15.854 09:39:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:15.854 09:39:38 -- nvmf/common.sh@116 -- # sync 00:16:15.854 09:39:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:15.854 09:39:38 -- nvmf/common.sh@119 -- # set +e 00:16:15.854 09:39:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:15.854 09:39:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:15.854 rmmod nvme_tcp 00:16:15.854 rmmod nvme_fabrics 00:16:15.854 rmmod nvme_keyring 00:16:15.854 09:39:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:15.854 09:39:38 -- nvmf/common.sh@123 -- # set -e 00:16:15.854 09:39:38 -- nvmf/common.sh@124 -- # return 0 00:16:15.854 09:39:38 -- nvmf/common.sh@477 -- # '[' -n 24198 ']' 00:16:15.854 09:39:38 -- nvmf/common.sh@478 -- # killprocess 24198 00:16:15.854 09:39:38 -- common/autotest_common.sh@936 -- # '[' -z 24198 ']' 00:16:15.854 09:39:38 -- common/autotest_common.sh@940 -- # kill -0 24198 00:16:15.854 09:39:38 -- common/autotest_common.sh@941 -- # uname 00:16:15.854 09:39:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:15.854 09:39:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 24198 00:16:15.854 09:39:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:15.854 09:39:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:15.854 09:39:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 24198' 00:16:15.854 killing process with pid 24198 00:16:15.854 09:39:38 -- common/autotest_common.sh@955 -- # kill 24198 00:16:15.854 09:39:38 -- common/autotest_common.sh@960 -- # wait 24198 00:16:15.854 09:39:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:15.854 09:39:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:15.854 09:39:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:15.854 09:39:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:15.854 09:39:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:15.854 09:39:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:15.854 09:39:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:15.854 09:39:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:18.398 09:39:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:18.398 00:16:18.399 real 0m28.785s 00:16:18.399 user 0m42.236s 00:16:18.399 sys 0m8.265s 00:16:18.399 09:39:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:18.399 09:39:40 -- common/autotest_common.sh@10 -- # set +x 00:16:18.399 ************************************ 00:16:18.399 END TEST nvmf_zcopy 00:16:18.399 ************************************ 00:16:18.399 09:39:40 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:18.399 09:39:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:18.399 09:39:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:18.399 09:39:40 -- common/autotest_common.sh@10 -- # set +x 00:16:18.399 ************************************ 00:16:18.399 START TEST nvmf_nmic 00:16:18.399 ************************************ 00:16:18.399 09:39:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:18.399 * Looking for test storage... 00:16:18.399 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:18.399 09:39:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:18.399 09:39:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:18.399 09:39:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:18.399 09:39:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:18.399 09:39:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:18.399 09:39:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:18.399 09:39:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:18.399 09:39:40 -- scripts/common.sh@335 -- # IFS=.-: 00:16:18.399 09:39:40 -- scripts/common.sh@335 -- # read -ra ver1 00:16:18.399 09:39:40 -- scripts/common.sh@336 -- # IFS=.-: 00:16:18.399 09:39:40 -- scripts/common.sh@336 -- # read -ra ver2 00:16:18.399 09:39:40 -- scripts/common.sh@337 -- # local 'op=<' 00:16:18.399 09:39:40 -- scripts/common.sh@339 -- # ver1_l=2 00:16:18.399 09:39:40 -- scripts/common.sh@340 -- # ver2_l=1 00:16:18.399 09:39:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:18.399 09:39:40 -- scripts/common.sh@343 -- # case "$op" in 00:16:18.399 09:39:40 -- scripts/common.sh@344 -- # : 1 00:16:18.399 09:39:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:18.399 09:39:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:18.399 09:39:40 -- scripts/common.sh@364 -- # decimal 1 00:16:18.399 09:39:40 -- scripts/common.sh@352 -- # local d=1 00:16:18.399 09:39:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:18.399 09:39:40 -- scripts/common.sh@354 -- # echo 1 00:16:18.399 09:39:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:18.399 09:39:40 -- scripts/common.sh@365 -- # decimal 2 00:16:18.399 09:39:40 -- scripts/common.sh@352 -- # local d=2 00:16:18.399 09:39:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:18.399 09:39:40 -- scripts/common.sh@354 -- # echo 2 00:16:18.399 09:39:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:18.399 09:39:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:18.399 09:39:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:18.399 09:39:40 -- scripts/common.sh@367 -- # return 0 00:16:18.399 09:39:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:18.399 09:39:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:18.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:18.399 --rc genhtml_branch_coverage=1 00:16:18.399 --rc genhtml_function_coverage=1 00:16:18.399 --rc genhtml_legend=1 00:16:18.399 --rc geninfo_all_blocks=1 00:16:18.399 --rc geninfo_unexecuted_blocks=1 00:16:18.399 00:16:18.399 ' 00:16:18.399 09:39:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:18.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:18.399 --rc genhtml_branch_coverage=1 00:16:18.399 --rc genhtml_function_coverage=1 00:16:18.399 --rc genhtml_legend=1 00:16:18.399 --rc geninfo_all_blocks=1 00:16:18.399 --rc geninfo_unexecuted_blocks=1 00:16:18.399 00:16:18.399 ' 00:16:18.399 09:39:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:18.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:18.399 --rc genhtml_branch_coverage=1 00:16:18.399 --rc genhtml_function_coverage=1 00:16:18.399 --rc genhtml_legend=1 00:16:18.399 --rc geninfo_all_blocks=1 00:16:18.399 --rc geninfo_unexecuted_blocks=1 00:16:18.399 00:16:18.399 ' 00:16:18.399 09:39:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:18.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:18.399 --rc genhtml_branch_coverage=1 00:16:18.399 --rc genhtml_function_coverage=1 00:16:18.399 --rc genhtml_legend=1 00:16:18.399 --rc geninfo_all_blocks=1 00:16:18.399 --rc geninfo_unexecuted_blocks=1 00:16:18.399 00:16:18.399 ' 00:16:18.399 09:39:40 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:18.399 09:39:40 -- nvmf/common.sh@7 -- # uname -s 00:16:18.399 09:39:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:18.399 09:39:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:18.399 09:39:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:18.399 09:39:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:18.399 09:39:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:18.399 09:39:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:18.399 09:39:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:18.399 09:39:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:18.399 09:39:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:18.399 09:39:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:18.399 09:39:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:18.399 09:39:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:18.399 09:39:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:18.399 09:39:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:18.399 09:39:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:18.399 09:39:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:18.399 09:39:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:18.399 09:39:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:18.399 09:39:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:18.399 09:39:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.399 09:39:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.399 09:39:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.399 09:39:40 -- paths/export.sh@5 -- # export PATH 00:16:18.399 09:39:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.399 09:39:40 -- nvmf/common.sh@46 -- # : 0 00:16:18.399 09:39:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:18.399 09:39:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:18.399 09:39:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:18.399 09:39:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:18.399 09:39:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:18.399 09:39:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:18.399 09:39:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:18.399 09:39:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:18.399 09:39:40 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:18.399 09:39:40 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:18.399 09:39:40 -- target/nmic.sh@14 -- # nvmftestinit 00:16:18.399 09:39:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:18.399 09:39:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:18.399 09:39:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:18.399 09:39:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:18.399 09:39:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:18.399 09:39:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:18.399 09:39:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:18.399 09:39:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:18.399 09:39:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:18.399 09:39:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:18.399 09:39:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:18.399 09:39:40 -- common/autotest_common.sh@10 -- # set +x 00:16:20.308 09:39:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:20.308 09:39:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:20.308 09:39:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:20.308 09:39:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:20.308 09:39:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:20.308 09:39:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:20.308 09:39:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:20.308 09:39:42 -- nvmf/common.sh@294 -- # net_devs=() 00:16:20.308 09:39:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:20.308 09:39:42 -- nvmf/common.sh@295 -- # e810=() 00:16:20.308 09:39:42 -- nvmf/common.sh@295 -- # local -ga e810 00:16:20.308 09:39:42 -- nvmf/common.sh@296 -- # x722=() 00:16:20.308 09:39:42 -- nvmf/common.sh@296 -- # local -ga x722 00:16:20.308 09:39:42 -- nvmf/common.sh@297 -- # mlx=() 00:16:20.308 09:39:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:20.308 09:39:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:20.308 09:39:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:20.308 09:39:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:20.308 09:39:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:20.308 09:39:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:20.308 09:39:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:20.308 09:39:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:20.308 09:39:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:20.308 09:39:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:20.308 09:39:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:20.308 09:39:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:20.308 09:39:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:20.308 09:39:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:20.308 09:39:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:20.308 09:39:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:20.308 09:39:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:20.308 09:39:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:20.308 09:39:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:20.308 09:39:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:20.308 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:20.308 09:39:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:20.308 09:39:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:20.308 09:39:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:20.308 09:39:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:20.308 09:39:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:20.308 09:39:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:20.308 09:39:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:20.308 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:20.308 09:39:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:20.308 09:39:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:20.309 09:39:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:20.309 09:39:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:20.309 09:39:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:20.309 09:39:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:20.309 09:39:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:20.309 09:39:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:20.309 09:39:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:20.309 09:39:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:20.309 09:39:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:20.309 09:39:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:20.309 09:39:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:20.309 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:20.309 09:39:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:20.309 09:39:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:20.309 09:39:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:20.309 09:39:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:20.309 09:39:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:20.309 09:39:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:20.309 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:20.309 09:39:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:20.309 09:39:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:20.309 09:39:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:20.309 09:39:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:20.309 09:39:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:20.309 09:39:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:20.309 09:39:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:20.309 09:39:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:20.309 09:39:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:20.309 09:39:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:20.309 09:39:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:20.309 09:39:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:20.309 09:39:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:20.309 09:39:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:20.309 09:39:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:20.309 09:39:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:20.309 09:39:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:20.309 09:39:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:20.309 09:39:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:20.309 09:39:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:20.309 09:39:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:20.309 09:39:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:20.309 09:39:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:20.309 09:39:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:20.309 09:39:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:20.309 09:39:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:20.309 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:20.309 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.176 ms 00:16:20.309 00:16:20.309 --- 10.0.0.2 ping statistics --- 00:16:20.309 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:20.309 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:16:20.309 09:39:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:20.309 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:20.309 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:16:20.309 00:16:20.309 --- 10.0.0.1 ping statistics --- 00:16:20.309 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:20.309 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:16:20.309 09:39:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:20.309 09:39:43 -- nvmf/common.sh@410 -- # return 0 00:16:20.309 09:39:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:20.309 09:39:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:20.309 09:39:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:20.309 09:39:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:20.309 09:39:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:20.309 09:39:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:20.309 09:39:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:20.309 09:39:43 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:20.309 09:39:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:20.309 09:39:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:20.309 09:39:43 -- common/autotest_common.sh@10 -- # set +x 00:16:20.309 09:39:43 -- nvmf/common.sh@469 -- # nvmfpid=29032 00:16:20.309 09:39:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:20.309 09:39:43 -- nvmf/common.sh@470 -- # waitforlisten 29032 00:16:20.309 09:39:43 -- common/autotest_common.sh@829 -- # '[' -z 29032 ']' 00:16:20.309 09:39:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:20.309 09:39:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:20.309 09:39:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:20.309 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:20.309 09:39:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:20.309 09:39:43 -- common/autotest_common.sh@10 -- # set +x 00:16:20.309 [2024-11-29 09:39:43.097203] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:20.309 [2024-11-29 09:39:43.097272] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:20.309 EAL: No free 2048 kB hugepages reported on node 1 00:16:20.570 [2024-11-29 09:39:43.165063] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:20.570 [2024-11-29 09:39:43.274893] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:20.570 [2024-11-29 09:39:43.275054] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:20.570 [2024-11-29 09:39:43.275071] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:20.570 [2024-11-29 09:39:43.275082] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:20.570 [2024-11-29 09:39:43.275159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:20.570 [2024-11-29 09:39:43.275222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:20.570 [2024-11-29 09:39:43.275307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:20.570 [2024-11-29 09:39:43.275304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:21.509 09:39:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:21.509 09:39:44 -- common/autotest_common.sh@862 -- # return 0 00:16:21.509 09:39:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:21.509 09:39:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:21.509 09:39:44 -- common/autotest_common.sh@10 -- # set +x 00:16:21.509 09:39:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:21.509 09:39:44 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:21.509 09:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.509 09:39:44 -- common/autotest_common.sh@10 -- # set +x 00:16:21.509 [2024-11-29 09:39:44.109044] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:21.509 09:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.509 09:39:44 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:21.509 09:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.509 09:39:44 -- common/autotest_common.sh@10 -- # set +x 00:16:21.509 Malloc0 00:16:21.509 09:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.509 09:39:44 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:21.509 09:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.509 09:39:44 -- common/autotest_common.sh@10 -- # set +x 00:16:21.509 09:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.509 09:39:44 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:21.509 09:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.509 09:39:44 -- common/autotest_common.sh@10 -- # set +x 00:16:21.509 09:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.509 09:39:44 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:21.509 09:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.509 09:39:44 -- common/autotest_common.sh@10 -- # set +x 00:16:21.509 [2024-11-29 09:39:44.160293] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:21.509 09:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.509 09:39:44 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:21.509 test case1: single bdev can't be used in multiple subsystems 00:16:21.509 09:39:44 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:21.509 09:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.509 09:39:44 -- common/autotest_common.sh@10 -- # set +x 00:16:21.509 09:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.510 09:39:44 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:21.510 09:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.510 09:39:44 -- common/autotest_common.sh@10 -- # set +x 00:16:21.510 09:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.510 09:39:44 -- target/nmic.sh@28 -- # nmic_status=0 00:16:21.510 09:39:44 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:21.510 09:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.510 09:39:44 -- common/autotest_common.sh@10 -- # set +x 00:16:21.510 [2024-11-29 09:39:44.184162] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:21.510 [2024-11-29 09:39:44.184191] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:21.510 [2024-11-29 09:39:44.184215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.510 request: 00:16:21.510 { 00:16:21.510 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:21.510 "namespace": { 00:16:21.510 "bdev_name": "Malloc0" 00:16:21.510 }, 00:16:21.510 "method": "nvmf_subsystem_add_ns", 00:16:21.510 "req_id": 1 00:16:21.510 } 00:16:21.510 Got JSON-RPC error response 00:16:21.510 response: 00:16:21.510 { 00:16:21.510 "code": -32602, 00:16:21.510 "message": "Invalid parameters" 00:16:21.510 } 00:16:21.510 09:39:44 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:21.510 09:39:44 -- target/nmic.sh@29 -- # nmic_status=1 00:16:21.510 09:39:44 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:21.510 09:39:44 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:21.510 Adding namespace failed - expected result. 00:16:21.510 09:39:44 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:21.510 test case2: host connect to nvmf target in multiple paths 00:16:21.510 09:39:44 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:21.510 09:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.510 09:39:44 -- common/autotest_common.sh@10 -- # set +x 00:16:21.510 [2024-11-29 09:39:44.192298] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:21.510 09:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.510 09:39:44 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:22.079 09:39:44 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:23.017 09:39:45 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:23.017 09:39:45 -- common/autotest_common.sh@1187 -- # local i=0 00:16:23.017 09:39:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:23.017 09:39:45 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:23.017 09:39:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:24.926 09:39:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:24.926 09:39:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:24.926 09:39:47 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:24.926 09:39:47 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:24.926 09:39:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:24.926 09:39:47 -- common/autotest_common.sh@1197 -- # return 0 00:16:24.926 09:39:47 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:24.926 [global] 00:16:24.926 thread=1 00:16:24.926 invalidate=1 00:16:24.926 rw=write 00:16:24.926 time_based=1 00:16:24.926 runtime=1 00:16:24.926 ioengine=libaio 00:16:24.926 direct=1 00:16:24.926 bs=4096 00:16:24.926 iodepth=1 00:16:24.926 norandommap=0 00:16:24.926 numjobs=1 00:16:24.926 00:16:24.926 verify_dump=1 00:16:24.926 verify_backlog=512 00:16:24.926 verify_state_save=0 00:16:24.926 do_verify=1 00:16:24.926 verify=crc32c-intel 00:16:24.926 [job0] 00:16:24.926 filename=/dev/nvme0n1 00:16:24.926 Could not set queue depth (nvme0n1) 00:16:24.926 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:24.926 fio-3.35 00:16:24.926 Starting 1 thread 00:16:26.305 00:16:26.305 job0: (groupid=0, jobs=1): err= 0: pid=29809: Fri Nov 29 09:39:48 2024 00:16:26.305 read: IOPS=2214, BW=8859KiB/s (9072kB/s)(8868KiB/1001msec) 00:16:26.305 slat (nsec): min=3810, max=68990, avg=10864.66, stdev=8973.36 00:16:26.305 clat (usec): min=175, max=493, avg=218.20, stdev=37.26 00:16:26.305 lat (usec): min=180, max=509, avg=229.06, stdev=42.59 00:16:26.305 clat percentiles (usec): 00:16:26.305 | 1.00th=[ 182], 5.00th=[ 188], 10.00th=[ 192], 20.00th=[ 196], 00:16:26.305 | 30.00th=[ 200], 40.00th=[ 204], 50.00th=[ 208], 60.00th=[ 212], 00:16:26.305 | 70.00th=[ 219], 80.00th=[ 227], 90.00th=[ 269], 95.00th=[ 293], 00:16:26.305 | 99.00th=[ 343], 99.50th=[ 400], 99.90th=[ 494], 99.95th=[ 494], 00:16:26.305 | 99.99th=[ 494] 00:16:26.305 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:16:26.305 slat (nsec): min=5482, max=73729, avg=12624.32, stdev=7300.55 00:16:26.305 clat (usec): min=124, max=376, avg=173.44, stdev=42.25 00:16:26.305 lat (usec): min=133, max=396, avg=186.06, stdev=43.85 00:16:26.305 clat percentiles (usec): 00:16:26.305 | 1.00th=[ 133], 5.00th=[ 137], 10.00th=[ 139], 20.00th=[ 145], 00:16:26.305 | 30.00th=[ 147], 40.00th=[ 151], 50.00th=[ 155], 60.00th=[ 161], 00:16:26.305 | 70.00th=[ 178], 80.00th=[ 204], 90.00th=[ 243], 95.00th=[ 260], 00:16:26.305 | 99.00th=[ 310], 99.50th=[ 318], 99.90th=[ 375], 99.95th=[ 375], 00:16:26.305 | 99.99th=[ 375] 00:16:26.305 bw ( KiB/s): min=10288, max=10288, per=100.00%, avg=10288.00, stdev= 0.00, samples=1 00:16:26.305 iops : min= 2572, max= 2572, avg=2572.00, stdev= 0.00, samples=1 00:16:26.305 lat (usec) : 250=89.70%, 500=10.30% 00:16:26.305 cpu : usr=2.20%, sys=6.70%, ctx=4777, majf=0, minf=1 00:16:26.305 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:26.305 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:26.305 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:26.305 issued rwts: total=2217,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:26.305 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:26.305 00:16:26.305 Run status group 0 (all jobs): 00:16:26.305 READ: bw=8859KiB/s (9072kB/s), 8859KiB/s-8859KiB/s (9072kB/s-9072kB/s), io=8868KiB (9081kB), run=1001-1001msec 00:16:26.305 WRITE: bw=9.99MiB/s (10.5MB/s), 9.99MiB/s-9.99MiB/s (10.5MB/s-10.5MB/s), io=10.0MiB (10.5MB), run=1001-1001msec 00:16:26.305 00:16:26.305 Disk stats (read/write): 00:16:26.305 nvme0n1: ios=2098/2243, merge=0/0, ticks=437/372, in_queue=809, util=91.38% 00:16:26.305 09:39:48 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:26.305 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:26.305 09:39:49 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:26.305 09:39:49 -- common/autotest_common.sh@1208 -- # local i=0 00:16:26.305 09:39:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:26.305 09:39:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:26.305 09:39:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:26.305 09:39:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:26.305 09:39:49 -- common/autotest_common.sh@1220 -- # return 0 00:16:26.305 09:39:49 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:26.305 09:39:49 -- target/nmic.sh@53 -- # nvmftestfini 00:16:26.305 09:39:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:26.305 09:39:49 -- nvmf/common.sh@116 -- # sync 00:16:26.305 09:39:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:26.305 09:39:49 -- nvmf/common.sh@119 -- # set +e 00:16:26.305 09:39:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:26.305 09:39:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:26.305 rmmod nvme_tcp 00:16:26.305 rmmod nvme_fabrics 00:16:26.305 rmmod nvme_keyring 00:16:26.305 09:39:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:26.305 09:39:49 -- nvmf/common.sh@123 -- # set -e 00:16:26.305 09:39:49 -- nvmf/common.sh@124 -- # return 0 00:16:26.305 09:39:49 -- nvmf/common.sh@477 -- # '[' -n 29032 ']' 00:16:26.305 09:39:49 -- nvmf/common.sh@478 -- # killprocess 29032 00:16:26.305 09:39:49 -- common/autotest_common.sh@936 -- # '[' -z 29032 ']' 00:16:26.305 09:39:49 -- common/autotest_common.sh@940 -- # kill -0 29032 00:16:26.305 09:39:49 -- common/autotest_common.sh@941 -- # uname 00:16:26.305 09:39:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:26.305 09:39:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 29032 00:16:26.305 09:39:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:26.305 09:39:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:26.305 09:39:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 29032' 00:16:26.305 killing process with pid 29032 00:16:26.305 09:39:49 -- common/autotest_common.sh@955 -- # kill 29032 00:16:26.305 09:39:49 -- common/autotest_common.sh@960 -- # wait 29032 00:16:26.875 09:39:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:26.875 09:39:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:26.875 09:39:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:26.875 09:39:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:26.875 09:39:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:26.875 09:39:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:26.875 09:39:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:26.875 09:39:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:28.832 09:39:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:28.832 00:16:28.832 real 0m10.797s 00:16:28.832 user 0m25.529s 00:16:28.832 sys 0m2.526s 00:16:28.832 09:39:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:28.832 09:39:51 -- common/autotest_common.sh@10 -- # set +x 00:16:28.832 ************************************ 00:16:28.832 END TEST nvmf_nmic 00:16:28.832 ************************************ 00:16:28.832 09:39:51 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:28.832 09:39:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:28.832 09:39:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:28.832 09:39:51 -- common/autotest_common.sh@10 -- # set +x 00:16:28.832 ************************************ 00:16:28.832 START TEST nvmf_fio_target 00:16:28.832 ************************************ 00:16:28.832 09:39:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:28.832 * Looking for test storage... 00:16:28.832 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:28.832 09:39:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:28.832 09:39:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:28.832 09:39:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:29.091 09:39:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:29.091 09:39:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:29.091 09:39:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:29.091 09:39:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:29.091 09:39:51 -- scripts/common.sh@335 -- # IFS=.-: 00:16:29.091 09:39:51 -- scripts/common.sh@335 -- # read -ra ver1 00:16:29.091 09:39:51 -- scripts/common.sh@336 -- # IFS=.-: 00:16:29.091 09:39:51 -- scripts/common.sh@336 -- # read -ra ver2 00:16:29.091 09:39:51 -- scripts/common.sh@337 -- # local 'op=<' 00:16:29.091 09:39:51 -- scripts/common.sh@339 -- # ver1_l=2 00:16:29.091 09:39:51 -- scripts/common.sh@340 -- # ver2_l=1 00:16:29.091 09:39:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:29.091 09:39:51 -- scripts/common.sh@343 -- # case "$op" in 00:16:29.091 09:39:51 -- scripts/common.sh@344 -- # : 1 00:16:29.091 09:39:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:29.091 09:39:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:29.091 09:39:51 -- scripts/common.sh@364 -- # decimal 1 00:16:29.091 09:39:51 -- scripts/common.sh@352 -- # local d=1 00:16:29.091 09:39:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:29.091 09:39:51 -- scripts/common.sh@354 -- # echo 1 00:16:29.091 09:39:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:29.091 09:39:51 -- scripts/common.sh@365 -- # decimal 2 00:16:29.091 09:39:51 -- scripts/common.sh@352 -- # local d=2 00:16:29.091 09:39:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:29.091 09:39:51 -- scripts/common.sh@354 -- # echo 2 00:16:29.091 09:39:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:29.091 09:39:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:29.091 09:39:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:29.091 09:39:51 -- scripts/common.sh@367 -- # return 0 00:16:29.091 09:39:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:29.091 09:39:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:29.091 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.091 --rc genhtml_branch_coverage=1 00:16:29.091 --rc genhtml_function_coverage=1 00:16:29.091 --rc genhtml_legend=1 00:16:29.091 --rc geninfo_all_blocks=1 00:16:29.091 --rc geninfo_unexecuted_blocks=1 00:16:29.091 00:16:29.091 ' 00:16:29.091 09:39:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:29.091 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.091 --rc genhtml_branch_coverage=1 00:16:29.091 --rc genhtml_function_coverage=1 00:16:29.091 --rc genhtml_legend=1 00:16:29.091 --rc geninfo_all_blocks=1 00:16:29.091 --rc geninfo_unexecuted_blocks=1 00:16:29.091 00:16:29.091 ' 00:16:29.091 09:39:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:29.091 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.091 --rc genhtml_branch_coverage=1 00:16:29.091 --rc genhtml_function_coverage=1 00:16:29.091 --rc genhtml_legend=1 00:16:29.091 --rc geninfo_all_blocks=1 00:16:29.091 --rc geninfo_unexecuted_blocks=1 00:16:29.091 00:16:29.091 ' 00:16:29.091 09:39:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:29.091 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:29.091 --rc genhtml_branch_coverage=1 00:16:29.091 --rc genhtml_function_coverage=1 00:16:29.091 --rc genhtml_legend=1 00:16:29.091 --rc geninfo_all_blocks=1 00:16:29.091 --rc geninfo_unexecuted_blocks=1 00:16:29.091 00:16:29.091 ' 00:16:29.091 09:39:51 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:29.091 09:39:51 -- nvmf/common.sh@7 -- # uname -s 00:16:29.091 09:39:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:29.091 09:39:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:29.091 09:39:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:29.091 09:39:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:29.091 09:39:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:29.091 09:39:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:29.091 09:39:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:29.091 09:39:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:29.091 09:39:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:29.091 09:39:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:29.092 09:39:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:29.092 09:39:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:29.092 09:39:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:29.092 09:39:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:29.092 09:39:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:29.092 09:39:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:29.092 09:39:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:29.092 09:39:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:29.092 09:39:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:29.092 09:39:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.092 09:39:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.092 09:39:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.092 09:39:51 -- paths/export.sh@5 -- # export PATH 00:16:29.092 09:39:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:29.092 09:39:51 -- nvmf/common.sh@46 -- # : 0 00:16:29.092 09:39:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:29.092 09:39:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:29.092 09:39:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:29.092 09:39:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:29.092 09:39:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:29.092 09:39:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:29.092 09:39:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:29.092 09:39:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:29.092 09:39:51 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:29.092 09:39:51 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:29.092 09:39:51 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:29.092 09:39:51 -- target/fio.sh@16 -- # nvmftestinit 00:16:29.092 09:39:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:29.092 09:39:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:29.092 09:39:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:29.092 09:39:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:29.092 09:39:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:29.092 09:39:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:29.092 09:39:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:29.092 09:39:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:29.092 09:39:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:29.092 09:39:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:29.092 09:39:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:29.092 09:39:51 -- common/autotest_common.sh@10 -- # set +x 00:16:30.999 09:39:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:30.999 09:39:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:30.999 09:39:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:30.999 09:39:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:30.999 09:39:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:30.999 09:39:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:30.999 09:39:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:30.999 09:39:53 -- nvmf/common.sh@294 -- # net_devs=() 00:16:30.999 09:39:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:30.999 09:39:53 -- nvmf/common.sh@295 -- # e810=() 00:16:30.999 09:39:53 -- nvmf/common.sh@295 -- # local -ga e810 00:16:30.999 09:39:53 -- nvmf/common.sh@296 -- # x722=() 00:16:30.999 09:39:53 -- nvmf/common.sh@296 -- # local -ga x722 00:16:30.999 09:39:53 -- nvmf/common.sh@297 -- # mlx=() 00:16:30.999 09:39:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:30.999 09:39:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:30.999 09:39:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:30.999 09:39:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:30.999 09:39:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:30.999 09:39:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:30.999 09:39:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:30.999 09:39:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:30.999 09:39:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:30.999 09:39:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:30.999 09:39:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:30.999 09:39:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:30.999 09:39:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:30.999 09:39:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:30.999 09:39:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:30.999 09:39:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:30.999 09:39:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:30.999 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:30.999 09:39:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:30.999 09:39:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:30.999 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:30.999 09:39:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:30.999 09:39:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:30.999 09:39:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:30.999 09:39:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:30.999 09:39:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:30.999 09:39:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:30.999 09:39:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:30.999 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:30.999 09:39:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:30.999 09:39:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:30.999 09:39:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:30.999 09:39:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:30.999 09:39:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:30.999 09:39:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:30.999 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:30.999 09:39:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:30.999 09:39:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:30.999 09:39:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:30.999 09:39:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:31.000 09:39:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:31.000 09:39:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:31.000 09:39:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:31.000 09:39:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:31.000 09:39:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:31.000 09:39:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:31.000 09:39:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:31.000 09:39:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:31.000 09:39:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:31.000 09:39:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:31.000 09:39:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:31.000 09:39:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:31.000 09:39:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:31.000 09:39:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:31.000 09:39:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:31.000 09:39:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:31.000 09:39:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:31.000 09:39:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:31.000 09:39:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:31.000 09:39:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:31.000 09:39:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:31.000 09:39:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:31.000 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:31.000 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:16:31.000 00:16:31.000 --- 10.0.0.2 ping statistics --- 00:16:31.000 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:31.000 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:16:31.000 09:39:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:31.000 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:31.000 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:16:31.000 00:16:31.000 --- 10.0.0.1 ping statistics --- 00:16:31.000 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:31.000 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:16:31.000 09:39:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:31.000 09:39:53 -- nvmf/common.sh@410 -- # return 0 00:16:31.000 09:39:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:31.000 09:39:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:31.000 09:39:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:31.000 09:39:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:31.000 09:39:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:31.000 09:39:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:31.000 09:39:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:31.000 09:39:53 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:31.000 09:39:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:31.000 09:39:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:31.000 09:39:53 -- common/autotest_common.sh@10 -- # set +x 00:16:31.000 09:39:53 -- nvmf/common.sh@469 -- # nvmfpid=31908 00:16:31.000 09:39:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:31.000 09:39:53 -- nvmf/common.sh@470 -- # waitforlisten 31908 00:16:31.000 09:39:53 -- common/autotest_common.sh@829 -- # '[' -z 31908 ']' 00:16:31.000 09:39:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:31.000 09:39:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:31.000 09:39:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:31.000 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:31.000 09:39:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:31.000 09:39:53 -- common/autotest_common.sh@10 -- # set +x 00:16:31.000 [2024-11-29 09:39:53.787447] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:31.000 [2024-11-29 09:39:53.787530] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:31.000 EAL: No free 2048 kB hugepages reported on node 1 00:16:31.260 [2024-11-29 09:39:53.862167] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:31.260 [2024-11-29 09:39:53.980730] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:31.260 [2024-11-29 09:39:53.980893] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:31.260 [2024-11-29 09:39:53.980914] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:31.260 [2024-11-29 09:39:53.980929] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:31.260 [2024-11-29 09:39:53.981020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:31.260 [2024-11-29 09:39:53.981074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:31.260 [2024-11-29 09:39:53.981126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:31.260 [2024-11-29 09:39:53.981129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:32.196 09:39:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:32.196 09:39:54 -- common/autotest_common.sh@862 -- # return 0 00:16:32.196 09:39:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:32.196 09:39:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:32.196 09:39:54 -- common/autotest_common.sh@10 -- # set +x 00:16:32.196 09:39:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:32.196 09:39:54 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:32.196 [2024-11-29 09:39:55.036804] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:32.455 09:39:55 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:32.713 09:39:55 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:32.713 09:39:55 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:32.971 09:39:55 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:32.972 09:39:55 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:33.230 09:39:55 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:33.230 09:39:55 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:33.488 09:39:56 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:33.488 09:39:56 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:33.746 09:39:56 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:34.005 09:39:56 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:34.005 09:39:56 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:34.262 09:39:56 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:34.262 09:39:56 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:34.521 09:39:57 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:34.521 09:39:57 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:34.779 09:39:57 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:35.037 09:39:57 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:35.037 09:39:57 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:35.294 09:39:57 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:35.294 09:39:57 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:35.552 09:39:58 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:35.810 [2024-11-29 09:39:58.461317] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:35.810 09:39:58 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:36.067 09:39:58 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:36.326 09:39:58 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:36.892 09:39:59 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:36.892 09:39:59 -- common/autotest_common.sh@1187 -- # local i=0 00:16:36.892 09:39:59 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:36.892 09:39:59 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:36.892 09:39:59 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:36.892 09:39:59 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:38.794 09:40:01 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:38.794 09:40:01 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:38.794 09:40:01 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:38.794 09:40:01 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:38.794 09:40:01 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:38.794 09:40:01 -- common/autotest_common.sh@1197 -- # return 0 00:16:38.794 09:40:01 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:38.794 [global] 00:16:38.794 thread=1 00:16:38.794 invalidate=1 00:16:38.794 rw=write 00:16:38.794 time_based=1 00:16:38.794 runtime=1 00:16:38.794 ioengine=libaio 00:16:38.794 direct=1 00:16:38.794 bs=4096 00:16:38.794 iodepth=1 00:16:38.794 norandommap=0 00:16:38.794 numjobs=1 00:16:38.794 00:16:38.794 verify_dump=1 00:16:38.794 verify_backlog=512 00:16:38.794 verify_state_save=0 00:16:38.794 do_verify=1 00:16:38.794 verify=crc32c-intel 00:16:38.794 [job0] 00:16:38.794 filename=/dev/nvme0n1 00:16:38.794 [job1] 00:16:38.794 filename=/dev/nvme0n2 00:16:38.794 [job2] 00:16:38.794 filename=/dev/nvme0n3 00:16:38.794 [job3] 00:16:38.794 filename=/dev/nvme0n4 00:16:39.052 Could not set queue depth (nvme0n1) 00:16:39.052 Could not set queue depth (nvme0n2) 00:16:39.052 Could not set queue depth (nvme0n3) 00:16:39.052 Could not set queue depth (nvme0n4) 00:16:39.052 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:39.052 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:39.052 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:39.052 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:39.052 fio-3.35 00:16:39.052 Starting 4 threads 00:16:40.432 00:16:40.432 job0: (groupid=0, jobs=1): err= 0: pid=33014: Fri Nov 29 09:40:03 2024 00:16:40.432 read: IOPS=1075, BW=4304KiB/s (4407kB/s)(4364KiB/1014msec) 00:16:40.432 slat (nsec): min=3861, max=34952, avg=7759.91, stdev=4437.60 00:16:40.432 clat (usec): min=171, max=42268, avg=638.33, stdev=4147.48 00:16:40.432 lat (usec): min=176, max=42281, avg=646.09, stdev=4149.36 00:16:40.432 clat percentiles (usec): 00:16:40.432 | 1.00th=[ 182], 5.00th=[ 186], 10.00th=[ 190], 20.00th=[ 194], 00:16:40.432 | 30.00th=[ 198], 40.00th=[ 202], 50.00th=[ 204], 60.00th=[ 210], 00:16:40.432 | 70.00th=[ 219], 80.00th=[ 245], 90.00th=[ 293], 95.00th=[ 302], 00:16:40.432 | 99.00th=[41157], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:16:40.432 | 99.99th=[42206] 00:16:40.432 write: IOPS=1514, BW=6059KiB/s (6205kB/s)(6144KiB/1014msec); 0 zone resets 00:16:40.432 slat (nsec): min=5302, max=70077, avg=12827.02, stdev=8730.22 00:16:40.432 clat (usec): min=126, max=657, avg=183.26, stdev=65.26 00:16:40.432 lat (usec): min=132, max=664, avg=196.09, stdev=70.60 00:16:40.432 clat percentiles (usec): 00:16:40.432 | 1.00th=[ 131], 5.00th=[ 133], 10.00th=[ 135], 20.00th=[ 139], 00:16:40.432 | 30.00th=[ 141], 40.00th=[ 145], 50.00th=[ 151], 60.00th=[ 165], 00:16:40.432 | 70.00th=[ 196], 80.00th=[ 233], 90.00th=[ 273], 95.00th=[ 318], 00:16:40.432 | 99.00th=[ 420], 99.50th=[ 429], 99.90th=[ 523], 99.95th=[ 660], 00:16:40.432 | 99.99th=[ 660] 00:16:40.432 bw ( KiB/s): min= 2008, max=10280, per=43.46%, avg=6144.00, stdev=5849.19, samples=2 00:16:40.432 iops : min= 502, max= 2570, avg=1536.00, stdev=1462.30, samples=2 00:16:40.432 lat (usec) : 250=83.21%, 500=16.18%, 750=0.19% 00:16:40.432 lat (msec) : 50=0.42% 00:16:40.432 cpu : usr=2.27%, sys=3.46%, ctx=2627, majf=0, minf=1 00:16:40.432 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:40.432 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.432 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.432 issued rwts: total=1091,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:40.432 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:40.432 job1: (groupid=0, jobs=1): err= 0: pid=33015: Fri Nov 29 09:40:03 2024 00:16:40.432 read: IOPS=20, BW=82.9KiB/s (84.9kB/s)(84.0KiB/1013msec) 00:16:40.432 slat (nsec): min=13017, max=35310, avg=21166.43, stdev=9901.19 00:16:40.432 clat (usec): min=40926, max=42085, avg=41557.48, stdev=504.32 00:16:40.432 lat (usec): min=40953, max=42098, avg=41578.65, stdev=504.42 00:16:40.432 clat percentiles (usec): 00:16:40.432 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:40.432 | 30.00th=[41157], 40.00th=[41157], 50.00th=[42206], 60.00th=[42206], 00:16:40.432 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:40.432 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:40.432 | 99.99th=[42206] 00:16:40.432 write: IOPS=505, BW=2022KiB/s (2070kB/s)(2048KiB/1013msec); 0 zone resets 00:16:40.432 slat (usec): min=6, max=23363, avg=62.62, stdev=1031.80 00:16:40.432 clat (usec): min=150, max=343, avg=206.42, stdev=26.94 00:16:40.432 lat (usec): min=159, max=23599, avg=269.04, stdev=1033.47 00:16:40.432 clat percentiles (usec): 00:16:40.432 | 1.00th=[ 161], 5.00th=[ 172], 10.00th=[ 180], 20.00th=[ 188], 00:16:40.432 | 30.00th=[ 192], 40.00th=[ 198], 50.00th=[ 202], 60.00th=[ 208], 00:16:40.432 | 70.00th=[ 215], 80.00th=[ 225], 90.00th=[ 243], 95.00th=[ 253], 00:16:40.432 | 99.00th=[ 289], 99.50th=[ 330], 99.90th=[ 343], 99.95th=[ 343], 00:16:40.432 | 99.99th=[ 343] 00:16:40.432 bw ( KiB/s): min= 4096, max= 4096, per=28.97%, avg=4096.00, stdev= 0.00, samples=1 00:16:40.432 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:40.432 lat (usec) : 250=90.43%, 500=5.63% 00:16:40.432 lat (msec) : 50=3.94% 00:16:40.432 cpu : usr=0.49%, sys=0.79%, ctx=536, majf=0, minf=1 00:16:40.432 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:40.432 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.432 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.432 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:40.432 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:40.432 job2: (groupid=0, jobs=1): err= 0: pid=33016: Fri Nov 29 09:40:03 2024 00:16:40.432 read: IOPS=21, BW=87.7KiB/s (89.8kB/s)(88.0KiB/1003msec) 00:16:40.432 slat (nsec): min=12964, max=34374, avg=21572.82, stdev=9746.57 00:16:40.432 clat (usec): min=330, max=42180, avg=39932.79, stdev=8852.29 00:16:40.432 lat (usec): min=347, max=42196, avg=39954.37, stdev=8853.27 00:16:40.432 clat percentiles (usec): 00:16:40.432 | 1.00th=[ 330], 5.00th=[41157], 10.00th=[41157], 20.00th=[41681], 00:16:40.432 | 30.00th=[41681], 40.00th=[41681], 50.00th=[42206], 60.00th=[42206], 00:16:40.432 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:40.432 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:40.432 | 99.99th=[42206] 00:16:40.432 write: IOPS=510, BW=2042KiB/s (2091kB/s)(2048KiB/1003msec); 0 zone resets 00:16:40.432 slat (nsec): min=7332, max=64999, avg=17806.28, stdev=8756.16 00:16:40.432 clat (usec): min=156, max=474, avg=220.31, stdev=55.54 00:16:40.432 lat (usec): min=169, max=490, avg=238.12, stdev=58.62 00:16:40.432 clat percentiles (usec): 00:16:40.432 | 1.00th=[ 163], 5.00th=[ 176], 10.00th=[ 180], 20.00th=[ 186], 00:16:40.432 | 30.00th=[ 188], 40.00th=[ 192], 50.00th=[ 198], 60.00th=[ 202], 00:16:40.432 | 70.00th=[ 212], 80.00th=[ 260], 90.00th=[ 322], 95.00th=[ 347], 00:16:40.432 | 99.00th=[ 408], 99.50th=[ 420], 99.90th=[ 474], 99.95th=[ 474], 00:16:40.432 | 99.99th=[ 474] 00:16:40.432 bw ( KiB/s): min= 4096, max= 4096, per=28.97%, avg=4096.00, stdev= 0.00, samples=1 00:16:40.432 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:40.432 lat (usec) : 250=74.34%, 500=21.72% 00:16:40.432 lat (msec) : 50=3.93% 00:16:40.432 cpu : usr=0.40%, sys=0.90%, ctx=534, majf=0, minf=2 00:16:40.432 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:40.432 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.432 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.432 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:40.432 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:40.432 job3: (groupid=0, jobs=1): err= 0: pid=33017: Fri Nov 29 09:40:03 2024 00:16:40.432 read: IOPS=1018, BW=4076KiB/s (4174kB/s)(4080KiB/1001msec) 00:16:40.432 slat (nsec): min=4323, max=66376, avg=12941.05, stdev=6872.71 00:16:40.432 clat (usec): min=189, max=44019, avg=725.38, stdev=4445.26 00:16:40.432 lat (usec): min=201, max=44036, avg=738.32, stdev=4445.50 00:16:40.432 clat percentiles (usec): 00:16:40.432 | 1.00th=[ 196], 5.00th=[ 200], 10.00th=[ 202], 20.00th=[ 210], 00:16:40.432 | 30.00th=[ 217], 40.00th=[ 225], 50.00th=[ 231], 60.00th=[ 237], 00:16:40.432 | 70.00th=[ 241], 80.00th=[ 251], 90.00th=[ 281], 95.00th=[ 383], 00:16:40.432 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[43779], 00:16:40.432 | 99.99th=[43779] 00:16:40.432 write: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec); 0 zone resets 00:16:40.432 slat (nsec): min=7858, max=72517, avg=19968.23, stdev=8302.52 00:16:40.432 clat (usec): min=141, max=498, avg=212.18, stdev=67.81 00:16:40.432 lat (usec): min=155, max=558, avg=232.15, stdev=71.87 00:16:40.432 clat percentiles (usec): 00:16:40.432 | 1.00th=[ 145], 5.00th=[ 149], 10.00th=[ 151], 20.00th=[ 155], 00:16:40.432 | 30.00th=[ 163], 40.00th=[ 172], 50.00th=[ 190], 60.00th=[ 212], 00:16:40.432 | 70.00th=[ 237], 80.00th=[ 260], 90.00th=[ 302], 95.00th=[ 363], 00:16:40.432 | 99.00th=[ 429], 99.50th=[ 449], 99.90th=[ 482], 99.95th=[ 498], 00:16:40.432 | 99.99th=[ 498] 00:16:40.432 bw ( KiB/s): min= 4096, max= 4096, per=28.97%, avg=4096.00, stdev= 0.00, samples=1 00:16:40.432 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:40.432 lat (usec) : 250=77.79%, 500=21.62% 00:16:40.432 lat (msec) : 50=0.59% 00:16:40.432 cpu : usr=2.20%, sys=3.60%, ctx=2044, majf=0, minf=1 00:16:40.432 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:40.432 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.432 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.432 issued rwts: total=1020,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:40.432 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:40.432 00:16:40.432 Run status group 0 (all jobs): 00:16:40.432 READ: bw=8497KiB/s (8701kB/s), 82.9KiB/s-4304KiB/s (84.9kB/s-4407kB/s), io=8616KiB (8823kB), run=1001-1014msec 00:16:40.432 WRITE: bw=13.8MiB/s (14.5MB/s), 2022KiB/s-6059KiB/s (2070kB/s-6205kB/s), io=14.0MiB (14.7MB), run=1001-1014msec 00:16:40.432 00:16:40.432 Disk stats (read/write): 00:16:40.432 nvme0n1: ios=1137/1536, merge=0/0, ticks=549/268, in_queue=817, util=87.27% 00:16:40.432 nvme0n2: ios=51/512, merge=0/0, ticks=1667/100, in_queue=1767, util=98.37% 00:16:40.432 nvme0n3: ios=18/512, merge=0/0, ticks=711/112, in_queue=823, util=89.02% 00:16:40.433 nvme0n4: ios=512/902, merge=0/0, ticks=616/184, in_queue=800, util=89.58% 00:16:40.433 09:40:03 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:40.433 [global] 00:16:40.433 thread=1 00:16:40.433 invalidate=1 00:16:40.433 rw=randwrite 00:16:40.433 time_based=1 00:16:40.433 runtime=1 00:16:40.433 ioengine=libaio 00:16:40.433 direct=1 00:16:40.433 bs=4096 00:16:40.433 iodepth=1 00:16:40.433 norandommap=0 00:16:40.433 numjobs=1 00:16:40.433 00:16:40.433 verify_dump=1 00:16:40.433 verify_backlog=512 00:16:40.433 verify_state_save=0 00:16:40.433 do_verify=1 00:16:40.433 verify=crc32c-intel 00:16:40.433 [job0] 00:16:40.433 filename=/dev/nvme0n1 00:16:40.433 [job1] 00:16:40.433 filename=/dev/nvme0n2 00:16:40.433 [job2] 00:16:40.433 filename=/dev/nvme0n3 00:16:40.433 [job3] 00:16:40.433 filename=/dev/nvme0n4 00:16:40.433 Could not set queue depth (nvme0n1) 00:16:40.433 Could not set queue depth (nvme0n2) 00:16:40.433 Could not set queue depth (nvme0n3) 00:16:40.433 Could not set queue depth (nvme0n4) 00:16:40.692 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:40.692 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:40.692 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:40.692 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:40.692 fio-3.35 00:16:40.692 Starting 4 threads 00:16:42.073 00:16:42.073 job0: (groupid=0, jobs=1): err= 0: pid=33246: Fri Nov 29 09:40:04 2024 00:16:42.073 read: IOPS=818, BW=3275KiB/s (3354kB/s)(3344KiB/1021msec) 00:16:42.073 slat (nsec): min=6682, max=49098, avg=10067.27, stdev=4977.41 00:16:42.073 clat (usec): min=193, max=41013, avg=905.87, stdev=5038.25 00:16:42.073 lat (usec): min=201, max=41031, avg=915.93, stdev=5039.52 00:16:42.073 clat percentiles (usec): 00:16:42.073 | 1.00th=[ 200], 5.00th=[ 210], 10.00th=[ 217], 20.00th=[ 225], 00:16:42.073 | 30.00th=[ 239], 40.00th=[ 260], 50.00th=[ 269], 60.00th=[ 281], 00:16:42.073 | 70.00th=[ 302], 80.00th=[ 318], 90.00th=[ 347], 95.00th=[ 363], 00:16:42.073 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:42.074 | 99.99th=[41157] 00:16:42.074 write: IOPS=1002, BW=4012KiB/s (4108kB/s)(4096KiB/1021msec); 0 zone resets 00:16:42.074 slat (nsec): min=7787, max=76259, avg=14520.71, stdev=9091.33 00:16:42.074 clat (usec): min=138, max=734, avg=226.97, stdev=72.07 00:16:42.074 lat (usec): min=146, max=763, avg=241.49, stdev=76.98 00:16:42.074 clat percentiles (usec): 00:16:42.074 | 1.00th=[ 147], 5.00th=[ 157], 10.00th=[ 172], 20.00th=[ 182], 00:16:42.074 | 30.00th=[ 186], 40.00th=[ 190], 50.00th=[ 198], 60.00th=[ 212], 00:16:42.074 | 70.00th=[ 243], 80.00th=[ 269], 90.00th=[ 318], 95.00th=[ 388], 00:16:42.074 | 99.00th=[ 482], 99.50th=[ 502], 99.90th=[ 611], 99.95th=[ 734], 00:16:42.074 | 99.99th=[ 734] 00:16:42.074 bw ( KiB/s): min= 8192, max= 8192, per=45.87%, avg=8192.00, stdev= 0.00, samples=1 00:16:42.074 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:42.074 lat (usec) : 250=56.29%, 500=42.63%, 750=0.38% 00:16:42.074 lat (msec) : 50=0.70% 00:16:42.074 cpu : usr=1.57%, sys=3.24%, ctx=1861, majf=0, minf=2 00:16:42.074 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:42.074 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.074 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.074 issued rwts: total=836,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:42.074 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:42.074 job1: (groupid=0, jobs=1): err= 0: pid=33252: Fri Nov 29 09:40:04 2024 00:16:42.074 read: IOPS=21, BW=85.3KiB/s (87.3kB/s)(88.0KiB/1032msec) 00:16:42.074 slat (nsec): min=14953, max=33776, avg=18058.50, stdev=6367.72 00:16:42.074 clat (usec): min=40537, max=41935, avg=41002.51, stdev=231.23 00:16:42.074 lat (usec): min=40552, max=41969, avg=41020.57, stdev=234.25 00:16:42.074 clat percentiles (usec): 00:16:42.074 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:42.074 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:42.074 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:42.074 | 99.00th=[41681], 99.50th=[41681], 99.90th=[41681], 99.95th=[41681], 00:16:42.074 | 99.99th=[41681] 00:16:42.074 write: IOPS=496, BW=1984KiB/s (2032kB/s)(2048KiB/1032msec); 0 zone resets 00:16:42.074 slat (nsec): min=6673, max=67100, avg=14822.56, stdev=7515.82 00:16:42.074 clat (usec): min=146, max=504, avg=232.60, stdev=55.47 00:16:42.074 lat (usec): min=162, max=521, avg=247.42, stdev=58.03 00:16:42.074 clat percentiles (usec): 00:16:42.074 | 1.00th=[ 167], 5.00th=[ 182], 10.00th=[ 188], 20.00th=[ 194], 00:16:42.074 | 30.00th=[ 202], 40.00th=[ 210], 50.00th=[ 217], 60.00th=[ 225], 00:16:42.074 | 70.00th=[ 231], 80.00th=[ 249], 90.00th=[ 318], 95.00th=[ 355], 00:16:42.074 | 99.00th=[ 437], 99.50th=[ 465], 99.90th=[ 506], 99.95th=[ 506], 00:16:42.074 | 99.99th=[ 506] 00:16:42.074 bw ( KiB/s): min= 4096, max= 4096, per=22.93%, avg=4096.00, stdev= 0.00, samples=1 00:16:42.074 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:42.074 lat (usec) : 250=77.34%, 500=18.35%, 750=0.19% 00:16:42.074 lat (msec) : 50=4.12% 00:16:42.074 cpu : usr=0.48%, sys=0.68%, ctx=535, majf=0, minf=1 00:16:42.074 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:42.074 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.074 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.074 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:42.074 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:42.074 job2: (groupid=0, jobs=1): err= 0: pid=33255: Fri Nov 29 09:40:04 2024 00:16:42.074 read: IOPS=516, BW=2067KiB/s (2117kB/s)(2096KiB/1014msec) 00:16:42.074 slat (nsec): min=7021, max=65221, avg=13896.77, stdev=7199.06 00:16:42.074 clat (usec): min=206, max=41247, avg=1506.74, stdev=6866.95 00:16:42.074 lat (usec): min=214, max=41255, avg=1520.63, stdev=6867.58 00:16:42.074 clat percentiles (usec): 00:16:42.074 | 1.00th=[ 212], 5.00th=[ 219], 10.00th=[ 225], 20.00th=[ 235], 00:16:42.074 | 30.00th=[ 265], 40.00th=[ 273], 50.00th=[ 281], 60.00th=[ 289], 00:16:42.074 | 70.00th=[ 297], 80.00th=[ 330], 90.00th=[ 429], 95.00th=[ 553], 00:16:42.074 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:42.074 | 99.99th=[41157] 00:16:42.074 write: IOPS=1009, BW=4039KiB/s (4136kB/s)(4096KiB/1014msec); 0 zone resets 00:16:42.074 slat (nsec): min=8010, max=69451, avg=13177.82, stdev=6795.71 00:16:42.074 clat (usec): min=151, max=487, avg=192.13, stdev=31.51 00:16:42.074 lat (usec): min=160, max=496, avg=205.30, stdev=34.38 00:16:42.074 clat percentiles (usec): 00:16:42.074 | 1.00th=[ 157], 5.00th=[ 161], 10.00th=[ 163], 20.00th=[ 167], 00:16:42.074 | 30.00th=[ 172], 40.00th=[ 176], 50.00th=[ 184], 60.00th=[ 194], 00:16:42.074 | 70.00th=[ 202], 80.00th=[ 215], 90.00th=[ 231], 95.00th=[ 249], 00:16:42.074 | 99.00th=[ 289], 99.50th=[ 302], 99.90th=[ 404], 99.95th=[ 486], 00:16:42.074 | 99.99th=[ 486] 00:16:42.074 bw ( KiB/s): min= 2736, max= 5456, per=22.93%, avg=4096.00, stdev=1923.33, samples=2 00:16:42.074 iops : min= 684, max= 1364, avg=1024.00, stdev=480.83, samples=2 00:16:42.074 lat (usec) : 250=71.96%, 500=25.58%, 750=1.42% 00:16:42.074 lat (msec) : 50=1.03% 00:16:42.074 cpu : usr=1.78%, sys=2.47%, ctx=1549, majf=0, minf=2 00:16:42.074 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:42.074 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.074 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.074 issued rwts: total=524,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:42.074 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:42.074 job3: (groupid=0, jobs=1): err= 0: pid=33256: Fri Nov 29 09:40:04 2024 00:16:42.074 read: IOPS=1932, BW=7728KiB/s (7914kB/s)(7736KiB/1001msec) 00:16:42.074 slat (nsec): min=6984, max=63569, avg=11094.77, stdev=5878.31 00:16:42.074 clat (usec): min=196, max=583, avg=275.45, stdev=69.66 00:16:42.074 lat (usec): min=204, max=592, avg=286.55, stdev=71.96 00:16:42.074 clat percentiles (usec): 00:16:42.074 | 1.00th=[ 208], 5.00th=[ 215], 10.00th=[ 219], 20.00th=[ 227], 00:16:42.074 | 30.00th=[ 233], 40.00th=[ 243], 50.00th=[ 251], 60.00th=[ 262], 00:16:42.074 | 70.00th=[ 273], 80.00th=[ 322], 90.00th=[ 375], 95.00th=[ 429], 00:16:42.074 | 99.00th=[ 529], 99.50th=[ 545], 99.90th=[ 570], 99.95th=[ 586], 00:16:42.074 | 99.99th=[ 586] 00:16:42.074 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:16:42.074 slat (nsec): min=8451, max=68156, avg=14134.36, stdev=7360.92 00:16:42.074 clat (usec): min=143, max=562, avg=196.65, stdev=50.37 00:16:42.074 lat (usec): min=152, max=576, avg=210.79, stdev=53.67 00:16:42.074 clat percentiles (usec): 00:16:42.074 | 1.00th=[ 147], 5.00th=[ 153], 10.00th=[ 157], 20.00th=[ 161], 00:16:42.074 | 30.00th=[ 167], 40.00th=[ 176], 50.00th=[ 184], 60.00th=[ 188], 00:16:42.074 | 70.00th=[ 196], 80.00th=[ 223], 90.00th=[ 265], 95.00th=[ 302], 00:16:42.074 | 99.00th=[ 388], 99.50th=[ 408], 99.90th=[ 449], 99.95th=[ 457], 00:16:42.074 | 99.99th=[ 562] 00:16:42.074 bw ( KiB/s): min= 8192, max= 8192, per=45.87%, avg=8192.00, stdev= 0.00, samples=1 00:16:42.074 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:42.074 lat (usec) : 250=68.38%, 500=30.56%, 750=1.05% 00:16:42.074 cpu : usr=4.40%, sys=6.00%, ctx=3985, majf=0, minf=1 00:16:42.074 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:42.074 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.074 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.074 issued rwts: total=1934,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:42.074 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:42.074 00:16:42.074 Run status group 0 (all jobs): 00:16:42.074 READ: bw=12.6MiB/s (13.2MB/s), 85.3KiB/s-7728KiB/s (87.3kB/s-7914kB/s), io=13.0MiB (13.6MB), run=1001-1032msec 00:16:42.074 WRITE: bw=17.4MiB/s (18.3MB/s), 1984KiB/s-8184KiB/s (2032kB/s-8380kB/s), io=18.0MiB (18.9MB), run=1001-1032msec 00:16:42.074 00:16:42.074 Disk stats (read/write): 00:16:42.074 nvme0n1: ios=881/1024, merge=0/0, ticks=576/220, in_queue=796, util=86.97% 00:16:42.074 nvme0n2: ios=37/512, merge=0/0, ticks=717/113, in_queue=830, util=86.89% 00:16:42.074 nvme0n3: ios=519/1024, merge=0/0, ticks=616/183, in_queue=799, util=88.94% 00:16:42.074 nvme0n4: ios=1567/1868, merge=0/0, ticks=884/346, in_queue=1230, util=98.63% 00:16:42.074 09:40:04 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:42.074 [global] 00:16:42.074 thread=1 00:16:42.074 invalidate=1 00:16:42.074 rw=write 00:16:42.074 time_based=1 00:16:42.074 runtime=1 00:16:42.074 ioengine=libaio 00:16:42.074 direct=1 00:16:42.074 bs=4096 00:16:42.074 iodepth=128 00:16:42.074 norandommap=0 00:16:42.074 numjobs=1 00:16:42.074 00:16:42.074 verify_dump=1 00:16:42.074 verify_backlog=512 00:16:42.074 verify_state_save=0 00:16:42.074 do_verify=1 00:16:42.074 verify=crc32c-intel 00:16:42.074 [job0] 00:16:42.074 filename=/dev/nvme0n1 00:16:42.074 [job1] 00:16:42.074 filename=/dev/nvme0n2 00:16:42.074 [job2] 00:16:42.074 filename=/dev/nvme0n3 00:16:42.074 [job3] 00:16:42.074 filename=/dev/nvme0n4 00:16:42.074 Could not set queue depth (nvme0n1) 00:16:42.074 Could not set queue depth (nvme0n2) 00:16:42.074 Could not set queue depth (nvme0n3) 00:16:42.074 Could not set queue depth (nvme0n4) 00:16:42.074 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:42.074 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:42.074 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:42.074 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:42.074 fio-3.35 00:16:42.074 Starting 4 threads 00:16:43.467 00:16:43.467 job0: (groupid=0, jobs=1): err= 0: pid=33611: Fri Nov 29 09:40:05 2024 00:16:43.467 read: IOPS=3576, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1002msec) 00:16:43.467 slat (usec): min=2, max=47309, avg=156.85, stdev=1377.44 00:16:43.467 clat (msec): min=6, max=112, avg=20.37, stdev=15.81 00:16:43.467 lat (msec): min=6, max=112, avg=20.52, stdev=15.91 00:16:43.467 clat percentiles (msec): 00:16:43.467 | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 10], 20.00th=[ 11], 00:16:43.467 | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 16], 60.00th=[ 22], 00:16:43.467 | 70.00th=[ 23], 80.00th=[ 25], 90.00th=[ 30], 95.00th=[ 64], 00:16:43.467 | 99.00th=[ 78], 99.50th=[ 112], 99.90th=[ 112], 99.95th=[ 112], 00:16:43.467 | 99.99th=[ 112] 00:16:43.467 write: IOPS=3764, BW=14.7MiB/s (15.4MB/s)(14.7MiB/1002msec); 0 zone resets 00:16:43.467 slat (usec): min=3, max=25826, avg=108.89, stdev=734.78 00:16:43.467 clat (usec): min=334, max=23673, avg=13413.96, stdev=4335.48 00:16:43.467 lat (usec): min=1793, max=28012, avg=13522.85, stdev=4355.01 00:16:43.467 clat percentiles (usec): 00:16:43.467 | 1.00th=[ 4752], 5.00th=[ 5407], 10.00th=[ 8225], 20.00th=[ 9634], 00:16:43.467 | 30.00th=[10683], 40.00th=[11207], 50.00th=[12911], 60.00th=[15401], 00:16:43.467 | 70.00th=[16712], 80.00th=[17433], 90.00th=[18744], 95.00th=[20055], 00:16:43.467 | 99.00th=[22676], 99.50th=[23462], 99.90th=[23725], 99.95th=[23725], 00:16:43.467 | 99.99th=[23725] 00:16:43.467 bw ( KiB/s): min=13408, max=15752, per=21.46%, avg=14580.00, stdev=1657.46, samples=2 00:16:43.467 iops : min= 3352, max= 3938, avg=3645.00, stdev=414.36, samples=2 00:16:43.467 lat (usec) : 500=0.01% 00:16:43.467 lat (msec) : 2=0.03%, 4=0.07%, 10=19.51%, 20=55.42%, 50=21.93% 00:16:43.467 lat (msec) : 100=2.61%, 250=0.42% 00:16:43.467 cpu : usr=3.60%, sys=5.09%, ctx=292, majf=0, minf=1 00:16:43.467 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:16:43.467 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.467 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:43.467 issued rwts: total=3584,3772,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.467 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:43.467 job1: (groupid=0, jobs=1): err= 0: pid=33612: Fri Nov 29 09:40:05 2024 00:16:43.467 read: IOPS=5849, BW=22.9MiB/s (24.0MB/s)(23.0MiB/1006msec) 00:16:43.467 slat (usec): min=2, max=9222, avg=82.50, stdev=543.15 00:16:43.467 clat (usec): min=3930, max=22794, avg=10554.21, stdev=2125.09 00:16:43.467 lat (usec): min=4753, max=22835, avg=10636.71, stdev=2174.60 00:16:43.467 clat percentiles (usec): 00:16:43.467 | 1.00th=[ 6390], 5.00th=[ 7767], 10.00th=[ 8586], 20.00th=[ 9503], 00:16:43.467 | 30.00th=[ 9765], 40.00th=[ 9896], 50.00th=[10028], 60.00th=[10290], 00:16:43.467 | 70.00th=[10421], 80.00th=[11469], 90.00th=[13698], 95.00th=[15008], 00:16:43.467 | 99.00th=[16909], 99.50th=[17695], 99.90th=[19792], 99.95th=[21365], 00:16:43.467 | 99.99th=[22676] 00:16:43.467 write: IOPS=6107, BW=23.9MiB/s (25.0MB/s)(24.0MiB/1006msec); 0 zone resets 00:16:43.467 slat (usec): min=4, max=8631, avg=74.68, stdev=412.22 00:16:43.467 clat (usec): min=888, max=19816, avg=10583.96, stdev=2162.37 00:16:43.467 lat (usec): min=900, max=19828, avg=10658.64, stdev=2189.10 00:16:43.467 clat percentiles (usec): 00:16:43.467 | 1.00th=[ 4752], 5.00th=[ 6849], 10.00th=[ 8291], 20.00th=[ 9372], 00:16:43.467 | 30.00th=[10159], 40.00th=[10421], 50.00th=[10683], 60.00th=[10814], 00:16:43.467 | 70.00th=[10945], 80.00th=[11338], 90.00th=[13173], 95.00th=[14615], 00:16:43.467 | 99.00th=[17433], 99.50th=[18482], 99.90th=[19268], 99.95th=[19268], 00:16:43.467 | 99.99th=[19792] 00:16:43.467 bw ( KiB/s): min=24568, max=24584, per=36.18%, avg=24576.00, stdev=11.31, samples=2 00:16:43.467 iops : min= 6142, max= 6146, avg=6144.00, stdev= 2.83, samples=2 00:16:43.467 lat (usec) : 1000=0.05% 00:16:43.467 lat (msec) : 4=0.12%, 10=38.06%, 20=61.74%, 50=0.02% 00:16:43.467 cpu : usr=5.67%, sys=10.45%, ctx=579, majf=0, minf=1 00:16:43.467 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:16:43.467 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.467 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:43.467 issued rwts: total=5885,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.467 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:43.467 job2: (groupid=0, jobs=1): err= 0: pid=33613: Fri Nov 29 09:40:05 2024 00:16:43.467 read: IOPS=2926, BW=11.4MiB/s (12.0MB/s)(11.5MiB/1006msec) 00:16:43.467 slat (usec): min=3, max=10274, avg=159.31, stdev=797.93 00:16:43.467 clat (usec): min=5370, max=35966, avg=19762.98, stdev=6262.75 00:16:43.467 lat (usec): min=5391, max=35972, avg=19922.29, stdev=6292.89 00:16:43.467 clat percentiles (usec): 00:16:43.467 | 1.00th=[ 6915], 5.00th=[12387], 10.00th=[13042], 20.00th=[14222], 00:16:43.467 | 30.00th=[15401], 40.00th=[17433], 50.00th=[18220], 60.00th=[20579], 00:16:43.467 | 70.00th=[22414], 80.00th=[25297], 90.00th=[29492], 95.00th=[32900], 00:16:43.467 | 99.00th=[33817], 99.50th=[35390], 99.90th=[35914], 99.95th=[35914], 00:16:43.467 | 99.99th=[35914] 00:16:43.467 write: IOPS=3053, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1006msec); 0 zone resets 00:16:43.467 slat (usec): min=3, max=40919, avg=163.22, stdev=1042.01 00:16:43.467 clat (usec): min=2509, max=50937, avg=19705.33, stdev=6967.07 00:16:43.467 lat (usec): min=2516, max=74611, avg=19868.55, stdev=7068.80 00:16:43.467 clat percentiles (usec): 00:16:43.467 | 1.00th=[ 4113], 5.00th=[ 9503], 10.00th=[12256], 20.00th=[14222], 00:16:43.467 | 30.00th=[15270], 40.00th=[17171], 50.00th=[17957], 60.00th=[20579], 00:16:43.467 | 70.00th=[23200], 80.00th=[24773], 90.00th=[30802], 95.00th=[33817], 00:16:43.467 | 99.00th=[35390], 99.50th=[36439], 99.90th=[39060], 99.95th=[39060], 00:16:43.467 | 99.99th=[51119] 00:16:43.467 bw ( KiB/s): min=12288, max=12288, per=18.09%, avg=12288.00, stdev= 0.00, samples=2 00:16:43.467 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=2 00:16:43.467 lat (msec) : 4=0.45%, 10=2.86%, 20=54.54%, 50=42.14%, 100=0.02% 00:16:43.467 cpu : usr=3.78%, sys=5.37%, ctx=380, majf=0, minf=1 00:16:43.467 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:16:43.467 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.467 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:43.467 issued rwts: total=2944,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.467 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:43.467 job3: (groupid=0, jobs=1): err= 0: pid=33614: Fri Nov 29 09:40:05 2024 00:16:43.467 read: IOPS=3724, BW=14.5MiB/s (15.3MB/s)(14.6MiB/1006msec) 00:16:43.467 slat (usec): min=2, max=10654, avg=119.93, stdev=762.84 00:16:43.467 clat (usec): min=3857, max=37239, avg=15015.59, stdev=5137.12 00:16:43.467 lat (usec): min=4054, max=37246, avg=15135.52, stdev=5187.37 00:16:43.467 clat percentiles (usec): 00:16:43.467 | 1.00th=[ 6194], 5.00th=[ 8848], 10.00th=[10421], 20.00th=[11994], 00:16:43.467 | 30.00th=[12518], 40.00th=[13042], 50.00th=[13435], 60.00th=[14353], 00:16:43.467 | 70.00th=[15926], 80.00th=[17433], 90.00th=[22676], 95.00th=[26608], 00:16:43.467 | 99.00th=[34866], 99.50th=[36439], 99.90th=[37487], 99.95th=[37487], 00:16:43.467 | 99.99th=[37487] 00:16:43.467 write: IOPS=4071, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1006msec); 0 zone resets 00:16:43.467 slat (usec): min=3, max=9500, avg=119.33, stdev=558.22 00:16:43.467 clat (usec): min=732, max=44265, avg=17426.13, stdev=8640.69 00:16:43.467 lat (usec): min=741, max=44277, avg=17545.46, stdev=8693.94 00:16:43.467 clat percentiles (usec): 00:16:43.467 | 1.00th=[ 2868], 5.00th=[ 7898], 10.00th=[10290], 20.00th=[12125], 00:16:43.467 | 30.00th=[12780], 40.00th=[13304], 50.00th=[13698], 60.00th=[14353], 00:16:43.467 | 70.00th=[19268], 80.00th=[24511], 90.00th=[32375], 95.00th=[37487], 00:16:43.467 | 99.00th=[40633], 99.50th=[42730], 99.90th=[44303], 99.95th=[44303], 00:16:43.467 | 99.99th=[44303] 00:16:43.467 bw ( KiB/s): min=16384, max=16384, per=24.12%, avg=16384.00, stdev= 0.00, samples=2 00:16:43.467 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=2 00:16:43.467 lat (usec) : 750=0.05% 00:16:43.467 lat (msec) : 2=0.42%, 4=0.85%, 10=7.04%, 20=70.04%, 50=21.60% 00:16:43.467 cpu : usr=3.98%, sys=6.57%, ctx=495, majf=0, minf=1 00:16:43.467 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:43.467 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.468 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:43.468 issued rwts: total=3747,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.468 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:43.468 00:16:43.468 Run status group 0 (all jobs): 00:16:43.468 READ: bw=62.7MiB/s (65.8MB/s), 11.4MiB/s-22.9MiB/s (12.0MB/s-24.0MB/s), io=63.1MiB (66.2MB), run=1002-1006msec 00:16:43.468 WRITE: bw=66.3MiB/s (69.6MB/s), 11.9MiB/s-23.9MiB/s (12.5MB/s-25.0MB/s), io=66.7MiB (70.0MB), run=1002-1006msec 00:16:43.468 00:16:43.468 Disk stats (read/write): 00:16:43.468 nvme0n1: ios=2612/2987, merge=0/0, ticks=21646/15432, in_queue=37078, util=90.68% 00:16:43.468 nvme0n2: ios=5025/5120, merge=0/0, ticks=28140/26491, in_queue=54631, util=97.16% 00:16:43.468 nvme0n3: ios=2620/2599, merge=0/0, ticks=15855/12998, in_queue=28853, util=95.63% 00:16:43.468 nvme0n4: ios=3506/3584, merge=0/0, ticks=30441/35714, in_queue=66155, util=95.50% 00:16:43.468 09:40:05 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:43.468 [global] 00:16:43.468 thread=1 00:16:43.468 invalidate=1 00:16:43.468 rw=randwrite 00:16:43.468 time_based=1 00:16:43.468 runtime=1 00:16:43.468 ioengine=libaio 00:16:43.468 direct=1 00:16:43.468 bs=4096 00:16:43.468 iodepth=128 00:16:43.468 norandommap=0 00:16:43.468 numjobs=1 00:16:43.468 00:16:43.468 verify_dump=1 00:16:43.468 verify_backlog=512 00:16:43.468 verify_state_save=0 00:16:43.468 do_verify=1 00:16:43.468 verify=crc32c-intel 00:16:43.468 [job0] 00:16:43.468 filename=/dev/nvme0n1 00:16:43.468 [job1] 00:16:43.468 filename=/dev/nvme0n2 00:16:43.468 [job2] 00:16:43.468 filename=/dev/nvme0n3 00:16:43.468 [job3] 00:16:43.468 filename=/dev/nvme0n4 00:16:43.468 Could not set queue depth (nvme0n1) 00:16:43.468 Could not set queue depth (nvme0n2) 00:16:43.468 Could not set queue depth (nvme0n3) 00:16:43.468 Could not set queue depth (nvme0n4) 00:16:43.468 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:43.468 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:43.468 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:43.468 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:43.468 fio-3.35 00:16:43.468 Starting 4 threads 00:16:44.845 00:16:44.845 job0: (groupid=0, jobs=1): err= 0: pid=33842: Fri Nov 29 09:40:07 2024 00:16:44.845 read: IOPS=5099, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1004msec) 00:16:44.845 slat (usec): min=2, max=8808, avg=90.38, stdev=607.91 00:16:44.845 clat (usec): min=3738, max=28094, avg=11845.60, stdev=4377.44 00:16:44.845 lat (usec): min=3750, max=31841, avg=11935.98, stdev=4411.68 00:16:44.845 clat percentiles (usec): 00:16:44.845 | 1.00th=[ 6063], 5.00th=[ 7504], 10.00th=[ 7898], 20.00th=[ 9110], 00:16:44.845 | 30.00th=[ 9503], 40.00th=[ 9634], 50.00th=[ 9896], 60.00th=[10552], 00:16:44.845 | 70.00th=[11994], 80.00th=[15664], 90.00th=[19006], 95.00th=[20841], 00:16:44.845 | 99.00th=[25297], 99.50th=[26608], 99.90th=[28181], 99.95th=[28181], 00:16:44.845 | 99.99th=[28181] 00:16:44.845 write: IOPS=5420, BW=21.2MiB/s (22.2MB/s)(21.3MiB/1004msec); 0 zone resets 00:16:44.845 slat (usec): min=3, max=8843, avg=85.70, stdev=490.42 00:16:44.845 clat (usec): min=238, max=36742, avg=12264.52, stdev=7091.71 00:16:44.845 lat (usec): min=358, max=36750, avg=12350.22, stdev=7143.34 00:16:44.845 clat percentiles (usec): 00:16:44.845 | 1.00th=[ 1614], 5.00th=[ 3720], 10.00th=[ 5407], 20.00th=[ 8291], 00:16:44.845 | 30.00th=[ 9503], 40.00th=[10159], 50.00th=[10552], 60.00th=[10814], 00:16:44.845 | 70.00th=[11600], 80.00th=[14353], 90.00th=[23462], 95.00th=[31065], 00:16:44.845 | 99.00th=[32375], 99.50th=[32637], 99.90th=[36963], 99.95th=[36963], 00:16:44.845 | 99.99th=[36963] 00:16:44.845 bw ( KiB/s): min=14728, max=27784, per=32.74%, avg=21256.00, stdev=9231.99, samples=2 00:16:44.845 iops : min= 3682, max= 6946, avg=5314.00, stdev=2308.00, samples=2 00:16:44.845 lat (usec) : 250=0.01%, 500=0.02%, 750=0.03%, 1000=0.11% 00:16:44.845 lat (msec) : 2=0.67%, 4=2.11%, 10=41.14%, 20=45.81%, 50=10.10% 00:16:44.845 cpu : usr=4.09%, sys=5.58%, ctx=501, majf=0, minf=1 00:16:44.845 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:44.845 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:44.845 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:44.845 issued rwts: total=5120,5442,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:44.845 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:44.845 job1: (groupid=0, jobs=1): err= 0: pid=33843: Fri Nov 29 09:40:07 2024 00:16:44.845 read: IOPS=3070, BW=12.0MiB/s (12.6MB/s)(12.1MiB/1008msec) 00:16:44.845 slat (usec): min=2, max=9155, avg=137.21, stdev=786.41 00:16:44.845 clat (usec): min=3955, max=36946, avg=16204.75, stdev=4797.33 00:16:44.845 lat (usec): min=7170, max=36963, avg=16341.96, stdev=4867.71 00:16:44.845 clat percentiles (usec): 00:16:44.845 | 1.00th=[ 8848], 5.00th=[10290], 10.00th=[10683], 20.00th=[11863], 00:16:44.845 | 30.00th=[13304], 40.00th=[14353], 50.00th=[15533], 60.00th=[17171], 00:16:44.845 | 70.00th=[17957], 80.00th=[20055], 90.00th=[22676], 95.00th=[23725], 00:16:44.845 | 99.00th=[31065], 99.50th=[35390], 99.90th=[36963], 99.95th=[36963], 00:16:44.845 | 99.99th=[36963] 00:16:44.845 write: IOPS=3555, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1008msec); 0 zone resets 00:16:44.845 slat (usec): min=3, max=9874, avg=152.63, stdev=721.91 00:16:44.845 clat (usec): min=8678, max=46707, avg=21447.80, stdev=7473.28 00:16:44.845 lat (usec): min=8687, max=46746, avg=21600.44, stdev=7528.94 00:16:44.845 clat percentiles (usec): 00:16:44.845 | 1.00th=[10421], 5.00th=[13173], 10.00th=[13698], 20.00th=[15008], 00:16:44.845 | 30.00th=[16581], 40.00th=[18744], 50.00th=[20317], 60.00th=[21627], 00:16:44.845 | 70.00th=[22152], 80.00th=[25035], 90.00th=[34341], 95.00th=[37487], 00:16:44.845 | 99.00th=[43254], 99.50th=[43254], 99.90th=[46924], 99.95th=[46924], 00:16:44.845 | 99.99th=[46924] 00:16:44.845 bw ( KiB/s): min=13440, max=14392, per=21.43%, avg=13916.00, stdev=673.17, samples=2 00:16:44.845 iops : min= 3360, max= 3598, avg=3479.00, stdev=168.29, samples=2 00:16:44.845 lat (msec) : 4=0.01%, 10=1.29%, 20=61.09%, 50=37.61% 00:16:44.845 cpu : usr=3.97%, sys=6.16%, ctx=377, majf=0, minf=1 00:16:44.845 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:44.845 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:44.845 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:44.845 issued rwts: total=3095,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:44.845 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:44.845 job2: (groupid=0, jobs=1): err= 0: pid=33844: Fri Nov 29 09:40:07 2024 00:16:44.845 read: IOPS=2662, BW=10.4MiB/s (10.9MB/s)(10.5MiB/1006msec) 00:16:44.845 slat (usec): min=2, max=9311, avg=158.94, stdev=855.90 00:16:44.845 clat (usec): min=2442, max=34523, avg=19218.06, stdev=4609.54 00:16:44.845 lat (usec): min=6283, max=34562, avg=19377.00, stdev=4662.46 00:16:44.845 clat percentiles (usec): 00:16:44.845 | 1.00th=[ 6783], 5.00th=[13304], 10.00th=[14484], 20.00th=[15139], 00:16:44.845 | 30.00th=[16450], 40.00th=[17695], 50.00th=[18744], 60.00th=[20055], 00:16:44.845 | 70.00th=[21103], 80.00th=[22676], 90.00th=[25560], 95.00th=[28181], 00:16:44.845 | 99.00th=[32113], 99.50th=[32113], 99.90th=[32637], 99.95th=[33162], 00:16:44.845 | 99.99th=[34341] 00:16:44.845 write: IOPS=3053, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1006msec); 0 zone resets 00:16:44.845 slat (usec): min=2, max=11034, avg=179.62, stdev=751.82 00:16:44.845 clat (usec): min=10044, max=55836, avg=24607.31, stdev=7655.95 00:16:44.845 lat (usec): min=10051, max=55860, avg=24786.93, stdev=7688.51 00:16:44.845 clat percentiles (usec): 00:16:44.845 | 1.00th=[15008], 5.00th=[15139], 10.00th=[16057], 20.00th=[19530], 00:16:44.845 | 30.00th=[21103], 40.00th=[21890], 50.00th=[22414], 60.00th=[23462], 00:16:44.845 | 70.00th=[26608], 80.00th=[29492], 90.00th=[34341], 95.00th=[41681], 00:16:44.845 | 99.00th=[52691], 99.50th=[53216], 99.90th=[55837], 99.95th=[55837], 00:16:44.845 | 99.99th=[55837] 00:16:44.845 bw ( KiB/s): min=11320, max=13176, per=18.86%, avg=12248.00, stdev=1312.39, samples=2 00:16:44.845 iops : min= 2830, max= 3294, avg=3062.00, stdev=328.10, samples=2 00:16:44.845 lat (msec) : 4=0.02%, 10=0.96%, 20=40.45%, 50=57.65%, 100=0.92% 00:16:44.845 cpu : usr=3.38%, sys=5.07%, ctx=406, majf=0, minf=1 00:16:44.845 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:16:44.845 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:44.845 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:44.845 issued rwts: total=2678,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:44.845 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:44.845 job3: (groupid=0, jobs=1): err= 0: pid=33845: Fri Nov 29 09:40:07 2024 00:16:44.845 read: IOPS=4075, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1005msec) 00:16:44.845 slat (usec): min=2, max=14695, avg=127.11, stdev=657.98 00:16:44.845 clat (usec): min=9641, max=48378, avg=16345.92, stdev=5633.53 00:16:44.845 lat (usec): min=10217, max=48383, avg=16473.03, stdev=5645.05 00:16:44.845 clat percentiles (usec): 00:16:44.845 | 1.00th=[10683], 5.00th=[11469], 10.00th=[11994], 20.00th=[12911], 00:16:44.845 | 30.00th=[13304], 40.00th=[13566], 50.00th=[14091], 60.00th=[15795], 00:16:44.845 | 70.00th=[17957], 80.00th=[19268], 90.00th=[20579], 95.00th=[23462], 00:16:44.845 | 99.00th=[42206], 99.50th=[46924], 99.90th=[48497], 99.95th=[48497], 00:16:44.845 | 99.99th=[48497] 00:16:44.845 write: IOPS=4241, BW=16.6MiB/s (17.4MB/s)(16.7MiB/1005msec); 0 zone resets 00:16:44.845 slat (usec): min=3, max=7273, avg=105.57, stdev=556.01 00:16:44.845 clat (usec): min=895, max=23242, avg=14194.64, stdev=3195.37 00:16:44.845 lat (usec): min=899, max=23249, avg=14300.21, stdev=3164.58 00:16:44.845 clat percentiles (usec): 00:16:44.845 | 1.00th=[ 4015], 5.00th=[ 8356], 10.00th=[12387], 20.00th=[12780], 00:16:44.845 | 30.00th=[12911], 40.00th=[13173], 50.00th=[13566], 60.00th=[14484], 00:16:44.845 | 70.00th=[15795], 80.00th=[16188], 90.00th=[17957], 95.00th=[19268], 00:16:44.845 | 99.00th=[23200], 99.50th=[23200], 99.90th=[23200], 99.95th=[23200], 00:16:44.845 | 99.99th=[23200] 00:16:44.845 bw ( KiB/s): min=15384, max=17696, per=25.48%, avg=16540.00, stdev=1634.83, samples=2 00:16:44.845 iops : min= 3846, max= 4424, avg=4135.00, stdev=408.71, samples=2 00:16:44.845 lat (usec) : 1000=0.10% 00:16:44.845 lat (msec) : 2=0.11%, 4=0.30%, 10=2.75%, 20=89.07%, 50=7.68% 00:16:44.845 cpu : usr=3.29%, sys=5.48%, ctx=382, majf=0, minf=2 00:16:44.845 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:44.845 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:44.845 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:44.845 issued rwts: total=4096,4263,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:44.845 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:44.845 00:16:44.845 Run status group 0 (all jobs): 00:16:44.845 READ: bw=58.1MiB/s (60.9MB/s), 10.4MiB/s-19.9MiB/s (10.9MB/s-20.9MB/s), io=58.6MiB (61.4MB), run=1004-1008msec 00:16:44.845 WRITE: bw=63.4MiB/s (66.5MB/s), 11.9MiB/s-21.2MiB/s (12.5MB/s-22.2MB/s), io=63.9MiB (67.0MB), run=1004-1008msec 00:16:44.845 00:16:44.845 Disk stats (read/write): 00:16:44.845 nvme0n1: ios=4451/4608, merge=0/0, ticks=35136/36795, in_queue=71931, util=98.10% 00:16:44.845 nvme0n2: ios=2588/3071, merge=0/0, ticks=21680/30331, in_queue=52011, util=91.27% 00:16:44.845 nvme0n3: ios=2293/2560, merge=0/0, ticks=22215/30447, in_queue=52662, util=90.53% 00:16:44.845 nvme0n4: ios=3560/3584, merge=0/0, ticks=16111/15398, in_queue=31509, util=95.50% 00:16:44.845 09:40:07 -- target/fio.sh@55 -- # sync 00:16:44.845 09:40:07 -- target/fio.sh@59 -- # fio_pid=33993 00:16:44.845 09:40:07 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:44.845 09:40:07 -- target/fio.sh@61 -- # sleep 3 00:16:44.845 [global] 00:16:44.845 thread=1 00:16:44.845 invalidate=1 00:16:44.845 rw=read 00:16:44.845 time_based=1 00:16:44.845 runtime=10 00:16:44.845 ioengine=libaio 00:16:44.845 direct=1 00:16:44.845 bs=4096 00:16:44.845 iodepth=1 00:16:44.845 norandommap=1 00:16:44.845 numjobs=1 00:16:44.845 00:16:44.845 [job0] 00:16:44.845 filename=/dev/nvme0n1 00:16:44.845 [job1] 00:16:44.845 filename=/dev/nvme0n2 00:16:44.845 [job2] 00:16:44.845 filename=/dev/nvme0n3 00:16:44.845 [job3] 00:16:44.845 filename=/dev/nvme0n4 00:16:44.845 Could not set queue depth (nvme0n1) 00:16:44.845 Could not set queue depth (nvme0n2) 00:16:44.845 Could not set queue depth (nvme0n3) 00:16:44.845 Could not set queue depth (nvme0n4) 00:16:44.846 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:44.846 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:44.846 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:44.846 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:44.846 fio-3.35 00:16:44.846 Starting 4 threads 00:16:48.131 09:40:10 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:48.131 09:40:10 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:48.131 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=7417856, buflen=4096 00:16:48.131 fio: pid=34084, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:48.131 09:40:10 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:48.131 09:40:10 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:48.131 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=18714624, buflen=4096 00:16:48.131 fio: pid=34083, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:48.390 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=38166528, buflen=4096 00:16:48.390 fio: pid=34081, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:48.647 09:40:11 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:48.647 09:40:11 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:48.906 09:40:11 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:48.906 09:40:11 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:48.906 fio: io_u error on file /dev/nvme0n2: Input/output error: read offset=7065600, buflen=4096 00:16:48.906 fio: pid=34082, err=5/file:io_u.c:1889, func=io_u error, error=Input/output error 00:16:48.906 00:16:48.906 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=34081: Fri Nov 29 09:40:11 2024 00:16:48.906 read: IOPS=2732, BW=10.7MiB/s (11.2MB/s)(36.4MiB/3411msec) 00:16:48.906 slat (usec): min=5, max=29721, avg=16.96, stdev=388.96 00:16:48.906 clat (usec): min=190, max=42009, avg=343.91, stdev=1911.40 00:16:48.906 lat (usec): min=196, max=42028, avg=359.06, stdev=1943.06 00:16:48.906 clat percentiles (usec): 00:16:48.906 | 1.00th=[ 198], 5.00th=[ 204], 10.00th=[ 208], 20.00th=[ 217], 00:16:48.906 | 30.00th=[ 223], 40.00th=[ 231], 50.00th=[ 243], 60.00th=[ 260], 00:16:48.906 | 70.00th=[ 269], 80.00th=[ 277], 90.00th=[ 293], 95.00th=[ 330], 00:16:48.906 | 99.00th=[ 529], 99.50th=[ 553], 99.90th=[41681], 99.95th=[42206], 00:16:48.906 | 99.99th=[42206] 00:16:48.906 bw ( KiB/s): min= 104, max=16128, per=54.97%, avg=10324.00, stdev=6188.17, samples=6 00:16:48.906 iops : min= 26, max= 4032, avg=2581.00, stdev=1547.04, samples=6 00:16:48.906 lat (usec) : 250=55.11%, 500=43.46%, 750=1.11%, 1000=0.02% 00:16:48.906 lat (msec) : 2=0.04%, 4=0.01%, 10=0.02%, 50=0.21% 00:16:48.906 cpu : usr=1.67%, sys=4.37%, ctx=9326, majf=0, minf=1 00:16:48.906 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:48.906 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.906 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.906 issued rwts: total=9319,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.906 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:48.906 job1: (groupid=0, jobs=1): err= 5 (file:io_u.c:1889, func=io_u error, error=Input/output error): pid=34082: Fri Nov 29 09:40:11 2024 00:16:48.906 read: IOPS=465, BW=1859KiB/s (1904kB/s)(6900KiB/3711msec) 00:16:48.906 slat (usec): min=5, max=15256, avg=41.74, stdev=579.10 00:16:48.906 clat (usec): min=189, max=42076, avg=2106.43, stdev=8447.95 00:16:48.906 lat (usec): min=195, max=52970, avg=2144.11, stdev=8523.55 00:16:48.906 clat percentiles (usec): 00:16:48.906 | 1.00th=[ 206], 5.00th=[ 219], 10.00th=[ 225], 20.00th=[ 233], 00:16:48.906 | 30.00th=[ 239], 40.00th=[ 251], 50.00th=[ 281], 60.00th=[ 314], 00:16:48.906 | 70.00th=[ 343], 80.00th=[ 371], 90.00th=[ 408], 95.00th=[ 519], 00:16:48.906 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:48.906 | 99.99th=[42206] 00:16:48.906 bw ( KiB/s): min= 88, max= 6680, per=9.62%, avg=1807.86, stdev=2943.50, samples=7 00:16:48.906 iops : min= 22, max= 1670, avg=451.86, stdev=735.72, samples=7 00:16:48.906 lat (usec) : 250=39.51%, 500=54.92%, 750=1.04% 00:16:48.906 lat (msec) : 2=0.06%, 50=4.40% 00:16:48.906 cpu : usr=0.32%, sys=0.92%, ctx=1732, majf=0, minf=2 00:16:48.906 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:48.906 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.906 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.906 issued rwts: total=1726,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.906 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:48.906 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=34083: Fri Nov 29 09:40:11 2024 00:16:48.906 read: IOPS=1454, BW=5815KiB/s (5954kB/s)(17.8MiB/3143msec) 00:16:48.906 slat (usec): min=6, max=2928, avg=14.91, stdev=43.48 00:16:48.906 clat (usec): min=214, max=42048, avg=664.16, stdev=3979.25 00:16:48.906 lat (usec): min=222, max=43991, avg=679.07, stdev=3986.30 00:16:48.906 clat percentiles (usec): 00:16:48.906 | 1.00th=[ 225], 5.00th=[ 233], 10.00th=[ 239], 20.00th=[ 249], 00:16:48.906 | 30.00th=[ 260], 40.00th=[ 265], 50.00th=[ 269], 60.00th=[ 273], 00:16:48.906 | 70.00th=[ 281], 80.00th=[ 289], 90.00th=[ 318], 95.00th=[ 355], 00:16:48.906 | 99.00th=[ 1037], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:16:48.906 | 99.99th=[42206] 00:16:48.906 bw ( KiB/s): min= 96, max=13728, per=32.42%, avg=6088.00, stdev=5910.81, samples=6 00:16:48.906 iops : min= 24, max= 3432, avg=1522.00, stdev=1477.70, samples=6 00:16:48.906 lat (usec) : 250=20.72%, 500=77.94%, 750=0.28%, 1000=0.02% 00:16:48.906 lat (msec) : 2=0.04%, 10=0.02%, 50=0.94% 00:16:48.906 cpu : usr=1.59%, sys=2.80%, ctx=4572, majf=0, minf=2 00:16:48.906 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:48.906 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.906 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.906 issued rwts: total=4570,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.906 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:48.906 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=34084: Fri Nov 29 09:40:11 2024 00:16:48.906 read: IOPS=622, BW=2490KiB/s (2550kB/s)(7244KiB/2909msec) 00:16:48.906 slat (nsec): min=4960, max=70022, avg=14355.99, stdev=8695.14 00:16:48.906 clat (usec): min=202, max=46341, avg=1563.02, stdev=7049.89 00:16:48.906 lat (usec): min=209, max=46354, avg=1577.36, stdev=7050.79 00:16:48.906 clat percentiles (usec): 00:16:48.906 | 1.00th=[ 219], 5.00th=[ 235], 10.00th=[ 243], 20.00th=[ 253], 00:16:48.906 | 30.00th=[ 265], 40.00th=[ 281], 50.00th=[ 302], 60.00th=[ 322], 00:16:48.906 | 70.00th=[ 371], 80.00th=[ 404], 90.00th=[ 506], 95.00th=[ 578], 00:16:48.906 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[46400], 00:16:48.906 | 99.99th=[46400] 00:16:48.906 bw ( KiB/s): min= 96, max=10872, per=15.35%, avg=2883.20, stdev=4665.44, samples=5 00:16:48.906 iops : min= 24, max= 2718, avg=720.80, stdev=1166.36, samples=5 00:16:48.906 lat (usec) : 250=17.72%, 500=71.41%, 750=7.67%, 1000=0.17% 00:16:48.906 lat (msec) : 50=2.98% 00:16:48.906 cpu : usr=0.65%, sys=1.07%, ctx=1812, majf=0, minf=1 00:16:48.906 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:48.906 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.906 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.906 issued rwts: total=1812,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.906 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:48.906 00:16:48.906 Run status group 0 (all jobs): 00:16:48.906 READ: bw=18.3MiB/s (19.2MB/s), 1859KiB/s-10.7MiB/s (1904kB/s-11.2MB/s), io=68.1MiB (71.4MB), run=2909-3711msec 00:16:48.906 00:16:48.906 Disk stats (read/write): 00:16:48.906 nvme0n1: ios=9295/0, merge=0/0, ticks=3546/0, in_queue=3546, util=98.20% 00:16:48.906 nvme0n2: ios=1762/0, merge=0/0, ticks=4532/0, in_queue=4532, util=98.34% 00:16:48.906 nvme0n3: ios=4618/0, merge=0/0, ticks=3112/0, in_queue=3112, util=99.35% 00:16:48.906 nvme0n4: ios=1810/0, merge=0/0, ticks=2769/0, in_queue=2769, util=96.75% 00:16:49.163 09:40:11 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:49.163 09:40:11 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:49.420 09:40:12 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:49.420 09:40:12 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:49.678 09:40:12 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:49.678 09:40:12 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:49.936 09:40:12 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:49.936 09:40:12 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:50.194 09:40:12 -- target/fio.sh@69 -- # fio_status=0 00:16:50.194 09:40:12 -- target/fio.sh@70 -- # wait 33993 00:16:50.194 09:40:12 -- target/fio.sh@70 -- # fio_status=4 00:16:50.194 09:40:12 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:50.194 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:50.194 09:40:12 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:50.194 09:40:12 -- common/autotest_common.sh@1208 -- # local i=0 00:16:50.194 09:40:12 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:50.194 09:40:12 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:50.194 09:40:12 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:50.194 09:40:12 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:50.194 09:40:12 -- common/autotest_common.sh@1220 -- # return 0 00:16:50.194 09:40:12 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:50.194 09:40:12 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:50.194 nvmf hotplug test: fio failed as expected 00:16:50.194 09:40:12 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:50.452 09:40:13 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:50.452 09:40:13 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:50.452 09:40:13 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:50.452 09:40:13 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:50.452 09:40:13 -- target/fio.sh@91 -- # nvmftestfini 00:16:50.452 09:40:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:50.452 09:40:13 -- nvmf/common.sh@116 -- # sync 00:16:50.452 09:40:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:50.452 09:40:13 -- nvmf/common.sh@119 -- # set +e 00:16:50.452 09:40:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:50.452 09:40:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:50.452 rmmod nvme_tcp 00:16:50.452 rmmod nvme_fabrics 00:16:50.452 rmmod nvme_keyring 00:16:50.452 09:40:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:50.452 09:40:13 -- nvmf/common.sh@123 -- # set -e 00:16:50.452 09:40:13 -- nvmf/common.sh@124 -- # return 0 00:16:50.452 09:40:13 -- nvmf/common.sh@477 -- # '[' -n 31908 ']' 00:16:50.452 09:40:13 -- nvmf/common.sh@478 -- # killprocess 31908 00:16:50.452 09:40:13 -- common/autotest_common.sh@936 -- # '[' -z 31908 ']' 00:16:50.452 09:40:13 -- common/autotest_common.sh@940 -- # kill -0 31908 00:16:50.452 09:40:13 -- common/autotest_common.sh@941 -- # uname 00:16:50.452 09:40:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:50.452 09:40:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 31908 00:16:50.711 09:40:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:50.711 09:40:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:50.711 09:40:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 31908' 00:16:50.711 killing process with pid 31908 00:16:50.711 09:40:13 -- common/autotest_common.sh@955 -- # kill 31908 00:16:50.711 09:40:13 -- common/autotest_common.sh@960 -- # wait 31908 00:16:50.971 09:40:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:50.971 09:40:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:50.971 09:40:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:50.971 09:40:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:50.971 09:40:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:50.971 09:40:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:50.971 09:40:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:50.971 09:40:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:52.880 09:40:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:52.880 00:16:52.880 real 0m24.105s 00:16:52.880 user 1m25.123s 00:16:52.880 sys 0m6.536s 00:16:52.880 09:40:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:52.880 09:40:15 -- common/autotest_common.sh@10 -- # set +x 00:16:52.880 ************************************ 00:16:52.880 END TEST nvmf_fio_target 00:16:52.880 ************************************ 00:16:52.880 09:40:15 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:52.880 09:40:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:52.880 09:40:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:52.880 09:40:15 -- common/autotest_common.sh@10 -- # set +x 00:16:52.880 ************************************ 00:16:52.880 START TEST nvmf_bdevio 00:16:52.880 ************************************ 00:16:52.880 09:40:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:52.880 * Looking for test storage... 00:16:52.880 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:52.880 09:40:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:52.880 09:40:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:52.880 09:40:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:53.140 09:40:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:53.140 09:40:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:53.140 09:40:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:53.140 09:40:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:53.140 09:40:15 -- scripts/common.sh@335 -- # IFS=.-: 00:16:53.140 09:40:15 -- scripts/common.sh@335 -- # read -ra ver1 00:16:53.140 09:40:15 -- scripts/common.sh@336 -- # IFS=.-: 00:16:53.140 09:40:15 -- scripts/common.sh@336 -- # read -ra ver2 00:16:53.140 09:40:15 -- scripts/common.sh@337 -- # local 'op=<' 00:16:53.140 09:40:15 -- scripts/common.sh@339 -- # ver1_l=2 00:16:53.140 09:40:15 -- scripts/common.sh@340 -- # ver2_l=1 00:16:53.140 09:40:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:53.140 09:40:15 -- scripts/common.sh@343 -- # case "$op" in 00:16:53.140 09:40:15 -- scripts/common.sh@344 -- # : 1 00:16:53.140 09:40:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:53.140 09:40:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:53.140 09:40:15 -- scripts/common.sh@364 -- # decimal 1 00:16:53.140 09:40:15 -- scripts/common.sh@352 -- # local d=1 00:16:53.140 09:40:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:53.140 09:40:15 -- scripts/common.sh@354 -- # echo 1 00:16:53.140 09:40:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:53.140 09:40:15 -- scripts/common.sh@365 -- # decimal 2 00:16:53.140 09:40:15 -- scripts/common.sh@352 -- # local d=2 00:16:53.140 09:40:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:53.140 09:40:15 -- scripts/common.sh@354 -- # echo 2 00:16:53.140 09:40:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:53.140 09:40:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:53.140 09:40:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:53.140 09:40:15 -- scripts/common.sh@367 -- # return 0 00:16:53.140 09:40:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:53.140 09:40:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:53.140 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:53.140 --rc genhtml_branch_coverage=1 00:16:53.140 --rc genhtml_function_coverage=1 00:16:53.140 --rc genhtml_legend=1 00:16:53.140 --rc geninfo_all_blocks=1 00:16:53.140 --rc geninfo_unexecuted_blocks=1 00:16:53.140 00:16:53.140 ' 00:16:53.140 09:40:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:53.140 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:53.140 --rc genhtml_branch_coverage=1 00:16:53.141 --rc genhtml_function_coverage=1 00:16:53.141 --rc genhtml_legend=1 00:16:53.141 --rc geninfo_all_blocks=1 00:16:53.141 --rc geninfo_unexecuted_blocks=1 00:16:53.141 00:16:53.141 ' 00:16:53.141 09:40:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:53.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:53.141 --rc genhtml_branch_coverage=1 00:16:53.141 --rc genhtml_function_coverage=1 00:16:53.141 --rc genhtml_legend=1 00:16:53.141 --rc geninfo_all_blocks=1 00:16:53.141 --rc geninfo_unexecuted_blocks=1 00:16:53.141 00:16:53.141 ' 00:16:53.141 09:40:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:53.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:53.141 --rc genhtml_branch_coverage=1 00:16:53.141 --rc genhtml_function_coverage=1 00:16:53.141 --rc genhtml_legend=1 00:16:53.141 --rc geninfo_all_blocks=1 00:16:53.141 --rc geninfo_unexecuted_blocks=1 00:16:53.141 00:16:53.141 ' 00:16:53.141 09:40:15 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:53.141 09:40:15 -- nvmf/common.sh@7 -- # uname -s 00:16:53.141 09:40:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:53.141 09:40:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:53.141 09:40:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:53.141 09:40:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:53.141 09:40:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:53.141 09:40:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:53.141 09:40:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:53.141 09:40:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:53.141 09:40:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:53.141 09:40:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:53.141 09:40:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:53.141 09:40:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:53.141 09:40:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:53.141 09:40:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:53.141 09:40:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:53.141 09:40:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:53.141 09:40:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:53.141 09:40:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:53.141 09:40:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:53.141 09:40:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:53.141 09:40:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:53.141 09:40:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:53.141 09:40:15 -- paths/export.sh@5 -- # export PATH 00:16:53.141 09:40:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:53.141 09:40:15 -- nvmf/common.sh@46 -- # : 0 00:16:53.141 09:40:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:53.141 09:40:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:53.141 09:40:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:53.141 09:40:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:53.141 09:40:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:53.141 09:40:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:53.141 09:40:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:53.141 09:40:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:53.141 09:40:15 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:53.141 09:40:15 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:53.141 09:40:15 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:53.141 09:40:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:53.141 09:40:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:53.141 09:40:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:53.141 09:40:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:53.141 09:40:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:53.141 09:40:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:53.141 09:40:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:53.141 09:40:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:53.141 09:40:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:53.141 09:40:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:53.141 09:40:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:53.141 09:40:15 -- common/autotest_common.sh@10 -- # set +x 00:16:55.054 09:40:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:55.054 09:40:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:55.054 09:40:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:55.054 09:40:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:55.054 09:40:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:55.054 09:40:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:55.054 09:40:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:55.054 09:40:17 -- nvmf/common.sh@294 -- # net_devs=() 00:16:55.054 09:40:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:55.054 09:40:17 -- nvmf/common.sh@295 -- # e810=() 00:16:55.054 09:40:17 -- nvmf/common.sh@295 -- # local -ga e810 00:16:55.054 09:40:17 -- nvmf/common.sh@296 -- # x722=() 00:16:55.054 09:40:17 -- nvmf/common.sh@296 -- # local -ga x722 00:16:55.054 09:40:17 -- nvmf/common.sh@297 -- # mlx=() 00:16:55.054 09:40:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:55.054 09:40:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:55.054 09:40:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:55.054 09:40:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:55.054 09:40:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:55.054 09:40:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:55.054 09:40:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:55.054 09:40:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:55.054 09:40:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:55.054 09:40:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:55.054 09:40:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:55.054 09:40:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:55.054 09:40:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:55.054 09:40:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:55.054 09:40:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:55.054 09:40:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:55.054 09:40:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:55.054 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:55.054 09:40:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:55.054 09:40:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:55.054 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:55.054 09:40:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:55.054 09:40:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:55.054 09:40:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:55.054 09:40:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:55.054 09:40:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:55.054 09:40:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:55.054 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:55.054 09:40:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:55.054 09:40:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:55.054 09:40:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:55.054 09:40:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:55.054 09:40:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:55.054 09:40:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:55.054 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:55.054 09:40:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:55.054 09:40:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:55.054 09:40:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:55.054 09:40:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:55.054 09:40:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:55.054 09:40:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:55.054 09:40:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:55.054 09:40:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:55.054 09:40:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:55.054 09:40:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:55.054 09:40:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:55.054 09:40:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:55.054 09:40:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:55.054 09:40:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:55.054 09:40:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:55.054 09:40:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:55.054 09:40:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:55.054 09:40:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:55.313 09:40:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:55.313 09:40:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:55.313 09:40:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:55.313 09:40:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:55.313 09:40:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:55.313 09:40:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:55.313 09:40:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:55.313 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:55.313 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.175 ms 00:16:55.313 00:16:55.313 --- 10.0.0.2 ping statistics --- 00:16:55.313 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:55.313 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:16:55.313 09:40:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:55.313 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:55.313 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:16:55.313 00:16:55.313 --- 10.0.0.1 ping statistics --- 00:16:55.313 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:55.313 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:16:55.313 09:40:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:55.313 09:40:17 -- nvmf/common.sh@410 -- # return 0 00:16:55.313 09:40:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:55.313 09:40:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:55.313 09:40:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:55.313 09:40:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:55.313 09:40:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:55.313 09:40:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:55.313 09:40:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:55.313 09:40:18 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:55.314 09:40:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:55.314 09:40:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:55.314 09:40:18 -- common/autotest_common.sh@10 -- # set +x 00:16:55.314 09:40:18 -- nvmf/common.sh@469 -- # nvmfpid=36740 00:16:55.314 09:40:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:55.314 09:40:18 -- nvmf/common.sh@470 -- # waitforlisten 36740 00:16:55.314 09:40:18 -- common/autotest_common.sh@829 -- # '[' -z 36740 ']' 00:16:55.314 09:40:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:55.314 09:40:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:55.314 09:40:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:55.314 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:55.314 09:40:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:55.314 09:40:18 -- common/autotest_common.sh@10 -- # set +x 00:16:55.314 [2024-11-29 09:40:18.044173] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:55.314 [2024-11-29 09:40:18.044257] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:55.314 EAL: No free 2048 kB hugepages reported on node 1 00:16:55.314 [2024-11-29 09:40:18.113680] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:55.574 [2024-11-29 09:40:18.237044] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:55.574 [2024-11-29 09:40:18.237225] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:55.574 [2024-11-29 09:40:18.237245] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:55.574 [2024-11-29 09:40:18.237260] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:55.574 [2024-11-29 09:40:18.237358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:55.574 [2024-11-29 09:40:18.237435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:55.574 [2024-11-29 09:40:18.237502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:55.574 [2024-11-29 09:40:18.237506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:56.510 09:40:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:56.510 09:40:19 -- common/autotest_common.sh@862 -- # return 0 00:16:56.510 09:40:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:56.510 09:40:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:56.510 09:40:19 -- common/autotest_common.sh@10 -- # set +x 00:16:56.510 09:40:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:56.510 09:40:19 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:56.510 09:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:56.510 09:40:19 -- common/autotest_common.sh@10 -- # set +x 00:16:56.510 [2024-11-29 09:40:19.134211] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:56.510 09:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:56.510 09:40:19 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:56.510 09:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:56.510 09:40:19 -- common/autotest_common.sh@10 -- # set +x 00:16:56.510 Malloc0 00:16:56.510 09:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:56.510 09:40:19 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:56.510 09:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:56.510 09:40:19 -- common/autotest_common.sh@10 -- # set +x 00:16:56.510 09:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:56.510 09:40:19 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:56.510 09:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:56.510 09:40:19 -- common/autotest_common.sh@10 -- # set +x 00:16:56.511 09:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:56.511 09:40:19 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:56.511 09:40:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:56.511 09:40:19 -- common/autotest_common.sh@10 -- # set +x 00:16:56.511 [2024-11-29 09:40:19.185547] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:56.511 09:40:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:56.511 09:40:19 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:16:56.511 09:40:19 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:56.511 09:40:19 -- nvmf/common.sh@520 -- # config=() 00:16:56.511 09:40:19 -- nvmf/common.sh@520 -- # local subsystem config 00:16:56.511 09:40:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:56.511 09:40:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:56.511 { 00:16:56.511 "params": { 00:16:56.511 "name": "Nvme$subsystem", 00:16:56.511 "trtype": "$TEST_TRANSPORT", 00:16:56.511 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:56.511 "adrfam": "ipv4", 00:16:56.511 "trsvcid": "$NVMF_PORT", 00:16:56.511 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:56.511 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:56.511 "hdgst": ${hdgst:-false}, 00:16:56.511 "ddgst": ${ddgst:-false} 00:16:56.511 }, 00:16:56.511 "method": "bdev_nvme_attach_controller" 00:16:56.511 } 00:16:56.511 EOF 00:16:56.511 )") 00:16:56.511 09:40:19 -- nvmf/common.sh@542 -- # cat 00:16:56.511 09:40:19 -- nvmf/common.sh@544 -- # jq . 00:16:56.511 09:40:19 -- nvmf/common.sh@545 -- # IFS=, 00:16:56.511 09:40:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:56.511 "params": { 00:16:56.511 "name": "Nvme1", 00:16:56.511 "trtype": "tcp", 00:16:56.511 "traddr": "10.0.0.2", 00:16:56.511 "adrfam": "ipv4", 00:16:56.511 "trsvcid": "4420", 00:16:56.511 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:56.511 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:56.511 "hdgst": false, 00:16:56.511 "ddgst": false 00:16:56.511 }, 00:16:56.511 "method": "bdev_nvme_attach_controller" 00:16:56.511 }' 00:16:56.511 [2024-11-29 09:40:19.226290] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:56.511 [2024-11-29 09:40:19.226377] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid36901 ] 00:16:56.511 EAL: No free 2048 kB hugepages reported on node 1 00:16:56.511 [2024-11-29 09:40:19.292161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:56.769 [2024-11-29 09:40:19.404140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:56.769 [2024-11-29 09:40:19.404190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:56.769 [2024-11-29 09:40:19.404193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:57.029 [2024-11-29 09:40:19.738464] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:57.029 [2024-11-29 09:40:19.738529] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:57.029 I/O targets: 00:16:57.029 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:57.029 00:16:57.029 00:16:57.029 CUnit - A unit testing framework for C - Version 2.1-3 00:16:57.029 http://cunit.sourceforge.net/ 00:16:57.029 00:16:57.029 00:16:57.029 Suite: bdevio tests on: Nvme1n1 00:16:57.029 Test: blockdev write read block ...passed 00:16:57.029 Test: blockdev write zeroes read block ...passed 00:16:57.029 Test: blockdev write zeroes read no split ...passed 00:16:57.029 Test: blockdev write zeroes read split ...passed 00:16:57.029 Test: blockdev write zeroes read split partial ...passed 00:16:57.029 Test: blockdev reset ...[2024-11-29 09:40:19.854360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:57.029 [2024-11-29 09:40:19.854475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfd6f20 (9): Bad file descriptor 00:16:57.029 [2024-11-29 09:40:19.867567] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:57.029 passed 00:16:57.029 Test: blockdev write read 8 blocks ...passed 00:16:57.029 Test: blockdev write read size > 128k ...passed 00:16:57.029 Test: blockdev write read invalid size ...passed 00:16:57.289 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:57.289 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:57.289 Test: blockdev write read max offset ...passed 00:16:57.289 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:57.289 Test: blockdev writev readv 8 blocks ...passed 00:16:57.289 Test: blockdev writev readv 30 x 1block ...passed 00:16:57.289 Test: blockdev writev readv block ...passed 00:16:57.289 Test: blockdev writev readv size > 128k ...passed 00:16:57.289 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:57.289 Test: blockdev comparev and writev ...[2024-11-29 09:40:20.082791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:57.289 [2024-11-29 09:40:20.082843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:57.289 [2024-11-29 09:40:20.082868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:57.289 [2024-11-29 09:40:20.082887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:57.289 [2024-11-29 09:40:20.083228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:57.289 [2024-11-29 09:40:20.083252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:57.289 [2024-11-29 09:40:20.083275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:57.289 [2024-11-29 09:40:20.083301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:57.290 [2024-11-29 09:40:20.083649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:57.290 [2024-11-29 09:40:20.083675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:57.290 [2024-11-29 09:40:20.083697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:57.290 [2024-11-29 09:40:20.083714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:57.290 [2024-11-29 09:40:20.084056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:57.290 [2024-11-29 09:40:20.084081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:57.290 [2024-11-29 09:40:20.084102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:57.290 [2024-11-29 09:40:20.084119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:57.290 passed 00:16:57.548 Test: blockdev nvme passthru rw ...passed 00:16:57.548 Test: blockdev nvme passthru vendor specific ...[2024-11-29 09:40:20.166661] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:57.548 [2024-11-29 09:40:20.166691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:57.548 [2024-11-29 09:40:20.166841] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:57.548 [2024-11-29 09:40:20.166864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:57.548 [2024-11-29 09:40:20.167010] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:57.548 [2024-11-29 09:40:20.167033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:57.548 [2024-11-29 09:40:20.167179] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:57.548 [2024-11-29 09:40:20.167202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:57.548 passed 00:16:57.548 Test: blockdev nvme admin passthru ...passed 00:16:57.549 Test: blockdev copy ...passed 00:16:57.549 00:16:57.549 Run Summary: Type Total Ran Passed Failed Inactive 00:16:57.549 suites 1 1 n/a 0 0 00:16:57.549 tests 23 23 23 0 0 00:16:57.549 asserts 152 152 152 0 n/a 00:16:57.549 00:16:57.549 Elapsed time = 0.977 seconds 00:16:57.807 09:40:20 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:57.807 09:40:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:57.807 09:40:20 -- common/autotest_common.sh@10 -- # set +x 00:16:57.807 09:40:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:57.807 09:40:20 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:57.807 09:40:20 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:57.807 09:40:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:57.807 09:40:20 -- nvmf/common.sh@116 -- # sync 00:16:57.807 09:40:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:57.807 09:40:20 -- nvmf/common.sh@119 -- # set +e 00:16:57.807 09:40:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:57.807 09:40:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:57.807 rmmod nvme_tcp 00:16:57.807 rmmod nvme_fabrics 00:16:57.807 rmmod nvme_keyring 00:16:57.807 09:40:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:57.807 09:40:20 -- nvmf/common.sh@123 -- # set -e 00:16:57.807 09:40:20 -- nvmf/common.sh@124 -- # return 0 00:16:57.807 09:40:20 -- nvmf/common.sh@477 -- # '[' -n 36740 ']' 00:16:57.807 09:40:20 -- nvmf/common.sh@478 -- # killprocess 36740 00:16:57.807 09:40:20 -- common/autotest_common.sh@936 -- # '[' -z 36740 ']' 00:16:57.807 09:40:20 -- common/autotest_common.sh@940 -- # kill -0 36740 00:16:57.807 09:40:20 -- common/autotest_common.sh@941 -- # uname 00:16:57.807 09:40:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:57.807 09:40:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 36740 00:16:57.807 09:40:20 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:57.807 09:40:20 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:57.807 09:40:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 36740' 00:16:57.807 killing process with pid 36740 00:16:57.807 09:40:20 -- common/autotest_common.sh@955 -- # kill 36740 00:16:57.807 09:40:20 -- common/autotest_common.sh@960 -- # wait 36740 00:16:58.065 09:40:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:58.065 09:40:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:58.065 09:40:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:58.065 09:40:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:58.065 09:40:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:58.065 09:40:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:58.065 09:40:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:58.065 09:40:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:00.604 09:40:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:00.604 00:17:00.604 real 0m7.246s 00:17:00.604 user 0m13.850s 00:17:00.604 sys 0m2.105s 00:17:00.604 09:40:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:00.604 09:40:22 -- common/autotest_common.sh@10 -- # set +x 00:17:00.604 ************************************ 00:17:00.604 END TEST nvmf_bdevio 00:17:00.604 ************************************ 00:17:00.604 09:40:22 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:17:00.604 09:40:22 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:00.604 09:40:22 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:17:00.604 09:40:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:00.604 09:40:22 -- common/autotest_common.sh@10 -- # set +x 00:17:00.604 ************************************ 00:17:00.604 START TEST nvmf_bdevio_no_huge 00:17:00.604 ************************************ 00:17:00.604 09:40:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:00.604 * Looking for test storage... 00:17:00.604 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:00.604 09:40:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:00.604 09:40:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:00.604 09:40:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:00.604 09:40:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:00.604 09:40:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:00.604 09:40:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:00.604 09:40:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:00.604 09:40:23 -- scripts/common.sh@335 -- # IFS=.-: 00:17:00.604 09:40:23 -- scripts/common.sh@335 -- # read -ra ver1 00:17:00.604 09:40:23 -- scripts/common.sh@336 -- # IFS=.-: 00:17:00.604 09:40:23 -- scripts/common.sh@336 -- # read -ra ver2 00:17:00.604 09:40:23 -- scripts/common.sh@337 -- # local 'op=<' 00:17:00.604 09:40:23 -- scripts/common.sh@339 -- # ver1_l=2 00:17:00.604 09:40:23 -- scripts/common.sh@340 -- # ver2_l=1 00:17:00.604 09:40:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:00.604 09:40:23 -- scripts/common.sh@343 -- # case "$op" in 00:17:00.604 09:40:23 -- scripts/common.sh@344 -- # : 1 00:17:00.604 09:40:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:00.604 09:40:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:00.604 09:40:23 -- scripts/common.sh@364 -- # decimal 1 00:17:00.605 09:40:23 -- scripts/common.sh@352 -- # local d=1 00:17:00.605 09:40:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:00.605 09:40:23 -- scripts/common.sh@354 -- # echo 1 00:17:00.605 09:40:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:00.605 09:40:23 -- scripts/common.sh@365 -- # decimal 2 00:17:00.605 09:40:23 -- scripts/common.sh@352 -- # local d=2 00:17:00.605 09:40:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:00.605 09:40:23 -- scripts/common.sh@354 -- # echo 2 00:17:00.605 09:40:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:00.605 09:40:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:00.605 09:40:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:00.605 09:40:23 -- scripts/common.sh@367 -- # return 0 00:17:00.605 09:40:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:00.605 09:40:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:00.605 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:00.605 --rc genhtml_branch_coverage=1 00:17:00.605 --rc genhtml_function_coverage=1 00:17:00.605 --rc genhtml_legend=1 00:17:00.605 --rc geninfo_all_blocks=1 00:17:00.605 --rc geninfo_unexecuted_blocks=1 00:17:00.605 00:17:00.605 ' 00:17:00.605 09:40:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:00.605 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:00.605 --rc genhtml_branch_coverage=1 00:17:00.605 --rc genhtml_function_coverage=1 00:17:00.605 --rc genhtml_legend=1 00:17:00.605 --rc geninfo_all_blocks=1 00:17:00.605 --rc geninfo_unexecuted_blocks=1 00:17:00.605 00:17:00.605 ' 00:17:00.605 09:40:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:00.605 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:00.605 --rc genhtml_branch_coverage=1 00:17:00.605 --rc genhtml_function_coverage=1 00:17:00.605 --rc genhtml_legend=1 00:17:00.605 --rc geninfo_all_blocks=1 00:17:00.605 --rc geninfo_unexecuted_blocks=1 00:17:00.605 00:17:00.605 ' 00:17:00.605 09:40:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:00.605 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:00.605 --rc genhtml_branch_coverage=1 00:17:00.605 --rc genhtml_function_coverage=1 00:17:00.605 --rc genhtml_legend=1 00:17:00.605 --rc geninfo_all_blocks=1 00:17:00.605 --rc geninfo_unexecuted_blocks=1 00:17:00.605 00:17:00.605 ' 00:17:00.605 09:40:23 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:00.605 09:40:23 -- nvmf/common.sh@7 -- # uname -s 00:17:00.605 09:40:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:00.605 09:40:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:00.605 09:40:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:00.605 09:40:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:00.605 09:40:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:00.605 09:40:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:00.605 09:40:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:00.605 09:40:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:00.605 09:40:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:00.605 09:40:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:00.605 09:40:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:00.605 09:40:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:00.605 09:40:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:00.605 09:40:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:00.605 09:40:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:00.605 09:40:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:00.605 09:40:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:00.605 09:40:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:00.605 09:40:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:00.605 09:40:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:00.605 09:40:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:00.605 09:40:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:00.605 09:40:23 -- paths/export.sh@5 -- # export PATH 00:17:00.605 09:40:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:00.605 09:40:23 -- nvmf/common.sh@46 -- # : 0 00:17:00.605 09:40:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:00.605 09:40:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:00.605 09:40:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:00.605 09:40:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:00.605 09:40:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:00.605 09:40:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:00.605 09:40:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:00.605 09:40:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:00.605 09:40:23 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:00.605 09:40:23 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:00.605 09:40:23 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:00.605 09:40:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:00.605 09:40:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:00.605 09:40:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:00.605 09:40:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:00.605 09:40:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:00.605 09:40:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:00.605 09:40:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:00.605 09:40:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:00.605 09:40:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:00.605 09:40:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:00.605 09:40:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:00.605 09:40:23 -- common/autotest_common.sh@10 -- # set +x 00:17:02.509 09:40:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:02.509 09:40:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:02.509 09:40:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:02.509 09:40:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:02.509 09:40:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:02.509 09:40:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:02.509 09:40:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:02.509 09:40:25 -- nvmf/common.sh@294 -- # net_devs=() 00:17:02.509 09:40:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:02.509 09:40:25 -- nvmf/common.sh@295 -- # e810=() 00:17:02.509 09:40:25 -- nvmf/common.sh@295 -- # local -ga e810 00:17:02.509 09:40:25 -- nvmf/common.sh@296 -- # x722=() 00:17:02.509 09:40:25 -- nvmf/common.sh@296 -- # local -ga x722 00:17:02.509 09:40:25 -- nvmf/common.sh@297 -- # mlx=() 00:17:02.509 09:40:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:02.509 09:40:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:02.509 09:40:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:02.509 09:40:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:02.509 09:40:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:02.509 09:40:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:02.509 09:40:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:02.509 09:40:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:02.509 09:40:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:02.509 09:40:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:02.509 09:40:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:02.509 09:40:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:02.509 09:40:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:02.509 09:40:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:02.509 09:40:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:02.509 09:40:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:02.509 09:40:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:02.509 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:02.509 09:40:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:02.509 09:40:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:02.509 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:02.509 09:40:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:02.509 09:40:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:02.509 09:40:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:02.509 09:40:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:02.509 09:40:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:02.509 09:40:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:02.509 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:02.509 09:40:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:02.509 09:40:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:02.509 09:40:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:02.509 09:40:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:02.509 09:40:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:02.509 09:40:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:02.509 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:02.509 09:40:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:02.509 09:40:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:02.509 09:40:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:02.509 09:40:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:02.509 09:40:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:02.509 09:40:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:02.509 09:40:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:02.509 09:40:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:02.509 09:40:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:02.509 09:40:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:02.509 09:40:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:02.509 09:40:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:02.509 09:40:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:02.509 09:40:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:02.509 09:40:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:02.509 09:40:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:02.509 09:40:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:02.509 09:40:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:02.509 09:40:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:02.509 09:40:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:02.509 09:40:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:02.509 09:40:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:02.509 09:40:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:02.509 09:40:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:02.509 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:02.509 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:17:02.509 00:17:02.509 --- 10.0.0.2 ping statistics --- 00:17:02.509 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:02.509 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:17:02.509 09:40:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:02.509 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:02.509 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:17:02.509 00:17:02.509 --- 10.0.0.1 ping statistics --- 00:17:02.509 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:02.509 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:17:02.509 09:40:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:02.509 09:40:25 -- nvmf/common.sh@410 -- # return 0 00:17:02.509 09:40:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:02.509 09:40:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:02.509 09:40:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:02.509 09:40:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:02.509 09:40:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:02.509 09:40:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:02.509 09:40:25 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:02.509 09:40:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:02.509 09:40:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:02.509 09:40:25 -- common/autotest_common.sh@10 -- # set +x 00:17:02.509 09:40:25 -- nvmf/common.sh@469 -- # nvmfpid=39113 00:17:02.509 09:40:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:02.509 09:40:25 -- nvmf/common.sh@470 -- # waitforlisten 39113 00:17:02.509 09:40:25 -- common/autotest_common.sh@829 -- # '[' -z 39113 ']' 00:17:02.509 09:40:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:02.509 09:40:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:02.509 09:40:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:02.509 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:02.509 09:40:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:02.509 09:40:25 -- common/autotest_common.sh@10 -- # set +x 00:17:02.509 [2024-11-29 09:40:25.326787] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:02.509 [2024-11-29 09:40:25.326860] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:02.767 [2024-11-29 09:40:25.400612] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:02.767 [2024-11-29 09:40:25.520609] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:02.767 [2024-11-29 09:40:25.520787] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:02.767 [2024-11-29 09:40:25.520806] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:02.767 [2024-11-29 09:40:25.520820] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:02.767 [2024-11-29 09:40:25.520926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:02.767 [2024-11-29 09:40:25.520985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:02.767 [2024-11-29 09:40:25.521037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:02.767 [2024-11-29 09:40:25.521040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:03.786 09:40:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:03.786 09:40:26 -- common/autotest_common.sh@862 -- # return 0 00:17:03.786 09:40:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:03.786 09:40:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:03.786 09:40:26 -- common/autotest_common.sh@10 -- # set +x 00:17:03.786 09:40:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:03.786 09:40:26 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:03.786 09:40:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.786 09:40:26 -- common/autotest_common.sh@10 -- # set +x 00:17:03.786 [2024-11-29 09:40:26.387512] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:03.786 09:40:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.786 09:40:26 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:03.786 09:40:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.786 09:40:26 -- common/autotest_common.sh@10 -- # set +x 00:17:03.786 Malloc0 00:17:03.786 09:40:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.786 09:40:26 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:03.786 09:40:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.786 09:40:26 -- common/autotest_common.sh@10 -- # set +x 00:17:03.786 09:40:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.786 09:40:26 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:03.786 09:40:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.786 09:40:26 -- common/autotest_common.sh@10 -- # set +x 00:17:03.786 09:40:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.786 09:40:26 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:03.786 09:40:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.786 09:40:26 -- common/autotest_common.sh@10 -- # set +x 00:17:03.786 [2024-11-29 09:40:26.425541] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:03.786 09:40:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.786 09:40:26 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:03.786 09:40:26 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:03.786 09:40:26 -- nvmf/common.sh@520 -- # config=() 00:17:03.786 09:40:26 -- nvmf/common.sh@520 -- # local subsystem config 00:17:03.786 09:40:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:03.786 09:40:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:03.786 { 00:17:03.786 "params": { 00:17:03.786 "name": "Nvme$subsystem", 00:17:03.786 "trtype": "$TEST_TRANSPORT", 00:17:03.786 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:03.786 "adrfam": "ipv4", 00:17:03.786 "trsvcid": "$NVMF_PORT", 00:17:03.786 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:03.786 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:03.786 "hdgst": ${hdgst:-false}, 00:17:03.786 "ddgst": ${ddgst:-false} 00:17:03.786 }, 00:17:03.786 "method": "bdev_nvme_attach_controller" 00:17:03.786 } 00:17:03.786 EOF 00:17:03.786 )") 00:17:03.786 09:40:26 -- nvmf/common.sh@542 -- # cat 00:17:03.786 09:40:26 -- nvmf/common.sh@544 -- # jq . 00:17:03.786 09:40:26 -- nvmf/common.sh@545 -- # IFS=, 00:17:03.786 09:40:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:03.786 "params": { 00:17:03.786 "name": "Nvme1", 00:17:03.786 "trtype": "tcp", 00:17:03.786 "traddr": "10.0.0.2", 00:17:03.786 "adrfam": "ipv4", 00:17:03.786 "trsvcid": "4420", 00:17:03.786 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:03.786 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:03.786 "hdgst": false, 00:17:03.786 "ddgst": false 00:17:03.786 }, 00:17:03.786 "method": "bdev_nvme_attach_controller" 00:17:03.786 }' 00:17:03.786 [2024-11-29 09:40:26.468868] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:03.786 [2024-11-29 09:40:26.468949] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid39278 ] 00:17:03.786 [2024-11-29 09:40:26.531661] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:04.045 [2024-11-29 09:40:26.647152] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:04.045 [2024-11-29 09:40:26.647204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:04.045 [2024-11-29 09:40:26.647208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:04.045 [2024-11-29 09:40:26.841845] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:04.045 [2024-11-29 09:40:26.841900] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:04.045 I/O targets: 00:17:04.045 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:04.045 00:17:04.045 00:17:04.045 CUnit - A unit testing framework for C - Version 2.1-3 00:17:04.045 http://cunit.sourceforge.net/ 00:17:04.045 00:17:04.045 00:17:04.045 Suite: bdevio tests on: Nvme1n1 00:17:04.303 Test: blockdev write read block ...passed 00:17:04.303 Test: blockdev write zeroes read block ...passed 00:17:04.303 Test: blockdev write zeroes read no split ...passed 00:17:04.303 Test: blockdev write zeroes read split ...passed 00:17:04.303 Test: blockdev write zeroes read split partial ...passed 00:17:04.303 Test: blockdev reset ...[2024-11-29 09:40:27.002130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:04.303 [2024-11-29 09:40:27.002236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xfbe7d0 (9): Bad file descriptor 00:17:04.303 [2024-11-29 09:40:27.140132] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:04.303 passed 00:17:04.303 Test: blockdev write read 8 blocks ...passed 00:17:04.303 Test: blockdev write read size > 128k ...passed 00:17:04.303 Test: blockdev write read invalid size ...passed 00:17:04.563 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:04.563 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:04.563 Test: blockdev write read max offset ...passed 00:17:04.563 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:04.563 Test: blockdev writev readv 8 blocks ...passed 00:17:04.563 Test: blockdev writev readv 30 x 1block ...passed 00:17:04.563 Test: blockdev writev readv block ...passed 00:17:04.563 Test: blockdev writev readv size > 128k ...passed 00:17:04.563 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:04.563 Test: blockdev comparev and writev ...[2024-11-29 09:40:27.351860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:04.563 [2024-11-29 09:40:27.351898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:04.563 [2024-11-29 09:40:27.351922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:04.563 [2024-11-29 09:40:27.351939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:04.563 [2024-11-29 09:40:27.352278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:04.563 [2024-11-29 09:40:27.352303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:04.563 [2024-11-29 09:40:27.352325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:04.563 [2024-11-29 09:40:27.352341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:04.563 [2024-11-29 09:40:27.352697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:04.563 [2024-11-29 09:40:27.352722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:04.563 [2024-11-29 09:40:27.352744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:04.563 [2024-11-29 09:40:27.352760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:04.563 [2024-11-29 09:40:27.353098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:04.563 [2024-11-29 09:40:27.353122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:04.563 [2024-11-29 09:40:27.353143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:04.563 [2024-11-29 09:40:27.353159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:04.563 passed 00:17:04.823 Test: blockdev nvme passthru rw ...passed 00:17:04.823 Test: blockdev nvme passthru vendor specific ...[2024-11-29 09:40:27.435662] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:04.823 [2024-11-29 09:40:27.435689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:04.823 [2024-11-29 09:40:27.435836] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:04.823 [2024-11-29 09:40:27.435859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:04.823 [2024-11-29 09:40:27.436005] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:04.823 [2024-11-29 09:40:27.436029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:04.823 [2024-11-29 09:40:27.436177] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:04.823 [2024-11-29 09:40:27.436201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:04.823 passed 00:17:04.823 Test: blockdev nvme admin passthru ...passed 00:17:04.823 Test: blockdev copy ...passed 00:17:04.824 00:17:04.824 Run Summary: Type Total Ran Passed Failed Inactive 00:17:04.824 suites 1 1 n/a 0 0 00:17:04.824 tests 23 23 23 0 0 00:17:04.824 asserts 152 152 152 0 n/a 00:17:04.824 00:17:04.824 Elapsed time = 1.302 seconds 00:17:05.083 09:40:27 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:05.083 09:40:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.083 09:40:27 -- common/autotest_common.sh@10 -- # set +x 00:17:05.083 09:40:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.083 09:40:27 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:05.083 09:40:27 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:05.083 09:40:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:05.083 09:40:27 -- nvmf/common.sh@116 -- # sync 00:17:05.083 09:40:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:05.083 09:40:27 -- nvmf/common.sh@119 -- # set +e 00:17:05.083 09:40:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:05.083 09:40:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:05.083 rmmod nvme_tcp 00:17:05.083 rmmod nvme_fabrics 00:17:05.344 rmmod nvme_keyring 00:17:05.344 09:40:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:05.344 09:40:27 -- nvmf/common.sh@123 -- # set -e 00:17:05.344 09:40:27 -- nvmf/common.sh@124 -- # return 0 00:17:05.344 09:40:27 -- nvmf/common.sh@477 -- # '[' -n 39113 ']' 00:17:05.344 09:40:27 -- nvmf/common.sh@478 -- # killprocess 39113 00:17:05.344 09:40:27 -- common/autotest_common.sh@936 -- # '[' -z 39113 ']' 00:17:05.344 09:40:27 -- common/autotest_common.sh@940 -- # kill -0 39113 00:17:05.344 09:40:27 -- common/autotest_common.sh@941 -- # uname 00:17:05.344 09:40:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:05.344 09:40:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 39113 00:17:05.344 09:40:27 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:05.344 09:40:27 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:05.344 09:40:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 39113' 00:17:05.344 killing process with pid 39113 00:17:05.344 09:40:27 -- common/autotest_common.sh@955 -- # kill 39113 00:17:05.344 09:40:27 -- common/autotest_common.sh@960 -- # wait 39113 00:17:05.603 09:40:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:05.603 09:40:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:05.603 09:40:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:05.603 09:40:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:05.603 09:40:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:05.603 09:40:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:05.603 09:40:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:05.603 09:40:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:08.140 09:40:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:08.140 00:17:08.140 real 0m7.545s 00:17:08.140 user 0m14.531s 00:17:08.140 sys 0m2.641s 00:17:08.140 09:40:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:08.140 09:40:30 -- common/autotest_common.sh@10 -- # set +x 00:17:08.140 ************************************ 00:17:08.140 END TEST nvmf_bdevio_no_huge 00:17:08.140 ************************************ 00:17:08.140 09:40:30 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:08.140 09:40:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:08.140 09:40:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:08.140 09:40:30 -- common/autotest_common.sh@10 -- # set +x 00:17:08.140 ************************************ 00:17:08.140 START TEST nvmf_tls 00:17:08.140 ************************************ 00:17:08.140 09:40:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:08.140 * Looking for test storage... 00:17:08.140 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:08.140 09:40:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:08.140 09:40:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:08.140 09:40:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:08.140 09:40:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:08.140 09:40:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:08.140 09:40:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:08.140 09:40:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:08.140 09:40:30 -- scripts/common.sh@335 -- # IFS=.-: 00:17:08.140 09:40:30 -- scripts/common.sh@335 -- # read -ra ver1 00:17:08.140 09:40:30 -- scripts/common.sh@336 -- # IFS=.-: 00:17:08.140 09:40:30 -- scripts/common.sh@336 -- # read -ra ver2 00:17:08.140 09:40:30 -- scripts/common.sh@337 -- # local 'op=<' 00:17:08.140 09:40:30 -- scripts/common.sh@339 -- # ver1_l=2 00:17:08.140 09:40:30 -- scripts/common.sh@340 -- # ver2_l=1 00:17:08.140 09:40:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:08.140 09:40:30 -- scripts/common.sh@343 -- # case "$op" in 00:17:08.140 09:40:30 -- scripts/common.sh@344 -- # : 1 00:17:08.140 09:40:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:08.140 09:40:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:08.140 09:40:30 -- scripts/common.sh@364 -- # decimal 1 00:17:08.140 09:40:30 -- scripts/common.sh@352 -- # local d=1 00:17:08.140 09:40:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:08.140 09:40:30 -- scripts/common.sh@354 -- # echo 1 00:17:08.140 09:40:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:08.140 09:40:30 -- scripts/common.sh@365 -- # decimal 2 00:17:08.140 09:40:30 -- scripts/common.sh@352 -- # local d=2 00:17:08.140 09:40:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:08.140 09:40:30 -- scripts/common.sh@354 -- # echo 2 00:17:08.140 09:40:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:08.141 09:40:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:08.141 09:40:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:08.141 09:40:30 -- scripts/common.sh@367 -- # return 0 00:17:08.141 09:40:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:08.141 09:40:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:08.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:08.141 --rc genhtml_branch_coverage=1 00:17:08.141 --rc genhtml_function_coverage=1 00:17:08.141 --rc genhtml_legend=1 00:17:08.141 --rc geninfo_all_blocks=1 00:17:08.141 --rc geninfo_unexecuted_blocks=1 00:17:08.141 00:17:08.141 ' 00:17:08.141 09:40:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:08.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:08.141 --rc genhtml_branch_coverage=1 00:17:08.141 --rc genhtml_function_coverage=1 00:17:08.141 --rc genhtml_legend=1 00:17:08.141 --rc geninfo_all_blocks=1 00:17:08.141 --rc geninfo_unexecuted_blocks=1 00:17:08.141 00:17:08.141 ' 00:17:08.141 09:40:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:08.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:08.141 --rc genhtml_branch_coverage=1 00:17:08.141 --rc genhtml_function_coverage=1 00:17:08.141 --rc genhtml_legend=1 00:17:08.141 --rc geninfo_all_blocks=1 00:17:08.141 --rc geninfo_unexecuted_blocks=1 00:17:08.141 00:17:08.141 ' 00:17:08.141 09:40:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:08.141 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:08.141 --rc genhtml_branch_coverage=1 00:17:08.141 --rc genhtml_function_coverage=1 00:17:08.141 --rc genhtml_legend=1 00:17:08.141 --rc geninfo_all_blocks=1 00:17:08.141 --rc geninfo_unexecuted_blocks=1 00:17:08.141 00:17:08.141 ' 00:17:08.141 09:40:30 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:08.141 09:40:30 -- nvmf/common.sh@7 -- # uname -s 00:17:08.141 09:40:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:08.141 09:40:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:08.141 09:40:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:08.141 09:40:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:08.141 09:40:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:08.141 09:40:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:08.141 09:40:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:08.141 09:40:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:08.141 09:40:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:08.141 09:40:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:08.141 09:40:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:08.141 09:40:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:08.141 09:40:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:08.141 09:40:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:08.141 09:40:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:08.141 09:40:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:08.141 09:40:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:08.141 09:40:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:08.141 09:40:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:08.141 09:40:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.141 09:40:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.141 09:40:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.141 09:40:30 -- paths/export.sh@5 -- # export PATH 00:17:08.141 09:40:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.141 09:40:30 -- nvmf/common.sh@46 -- # : 0 00:17:08.141 09:40:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:08.141 09:40:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:08.141 09:40:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:08.141 09:40:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:08.141 09:40:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:08.141 09:40:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:08.141 09:40:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:08.141 09:40:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:08.141 09:40:30 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:08.141 09:40:30 -- target/tls.sh@71 -- # nvmftestinit 00:17:08.141 09:40:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:08.141 09:40:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:08.141 09:40:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:08.141 09:40:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:08.141 09:40:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:08.141 09:40:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:08.141 09:40:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:08.141 09:40:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:08.141 09:40:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:08.141 09:40:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:08.141 09:40:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:08.141 09:40:30 -- common/autotest_common.sh@10 -- # set +x 00:17:10.044 09:40:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:10.044 09:40:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:10.044 09:40:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:10.044 09:40:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:10.044 09:40:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:10.044 09:40:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:10.044 09:40:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:10.044 09:40:32 -- nvmf/common.sh@294 -- # net_devs=() 00:17:10.044 09:40:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:10.044 09:40:32 -- nvmf/common.sh@295 -- # e810=() 00:17:10.044 09:40:32 -- nvmf/common.sh@295 -- # local -ga e810 00:17:10.044 09:40:32 -- nvmf/common.sh@296 -- # x722=() 00:17:10.044 09:40:32 -- nvmf/common.sh@296 -- # local -ga x722 00:17:10.044 09:40:32 -- nvmf/common.sh@297 -- # mlx=() 00:17:10.044 09:40:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:10.044 09:40:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:10.044 09:40:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:10.044 09:40:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:10.044 09:40:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:10.044 09:40:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:10.044 09:40:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:10.044 09:40:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:10.044 09:40:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:10.044 09:40:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:10.044 09:40:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:10.044 09:40:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:10.044 09:40:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:10.044 09:40:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:10.044 09:40:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:10.044 09:40:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:10.044 09:40:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:10.044 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:10.044 09:40:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:10.044 09:40:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:10.044 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:10.044 09:40:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:10.044 09:40:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:10.044 09:40:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:10.044 09:40:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:10.044 09:40:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:10.044 09:40:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:10.044 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:10.044 09:40:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:10.044 09:40:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:10.044 09:40:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:10.044 09:40:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:10.044 09:40:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:10.044 09:40:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:10.044 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:10.044 09:40:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:10.044 09:40:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:10.044 09:40:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:10.044 09:40:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:10.044 09:40:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:10.044 09:40:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:10.044 09:40:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:10.044 09:40:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:10.044 09:40:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:10.044 09:40:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:10.044 09:40:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:10.044 09:40:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:10.044 09:40:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:10.044 09:40:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:10.044 09:40:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:10.044 09:40:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:10.044 09:40:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:10.044 09:40:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:10.044 09:40:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:10.044 09:40:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:10.044 09:40:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:10.044 09:40:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:10.044 09:40:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:10.044 09:40:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:10.044 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:10.044 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.175 ms 00:17:10.044 00:17:10.044 --- 10.0.0.2 ping statistics --- 00:17:10.044 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:10.044 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:17:10.044 09:40:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:10.044 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:10.044 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:17:10.044 00:17:10.044 --- 10.0.0.1 ping statistics --- 00:17:10.044 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:10.044 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:17:10.044 09:40:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:10.044 09:40:32 -- nvmf/common.sh@410 -- # return 0 00:17:10.044 09:40:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:10.044 09:40:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:10.044 09:40:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:10.044 09:40:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:10.044 09:40:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:10.044 09:40:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:10.044 09:40:32 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:10.044 09:40:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:10.044 09:40:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:10.044 09:40:32 -- common/autotest_common.sh@10 -- # set +x 00:17:10.044 09:40:32 -- nvmf/common.sh@469 -- # nvmfpid=41374 00:17:10.044 09:40:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:10.044 09:40:32 -- nvmf/common.sh@470 -- # waitforlisten 41374 00:17:10.044 09:40:32 -- common/autotest_common.sh@829 -- # '[' -z 41374 ']' 00:17:10.044 09:40:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:10.044 09:40:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:10.044 09:40:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:10.044 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:10.044 09:40:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:10.044 09:40:32 -- common/autotest_common.sh@10 -- # set +x 00:17:10.044 [2024-11-29 09:40:32.830996] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:10.045 [2024-11-29 09:40:32.831082] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:10.045 EAL: No free 2048 kB hugepages reported on node 1 00:17:10.303 [2024-11-29 09:40:32.902279] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:10.303 [2024-11-29 09:40:33.017734] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:10.303 [2024-11-29 09:40:33.017919] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:10.303 [2024-11-29 09:40:33.017939] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:10.303 [2024-11-29 09:40:33.017953] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:10.303 [2024-11-29 09:40:33.017992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:10.303 09:40:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:10.303 09:40:33 -- common/autotest_common.sh@862 -- # return 0 00:17:10.303 09:40:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:10.303 09:40:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:10.303 09:40:33 -- common/autotest_common.sh@10 -- # set +x 00:17:10.303 09:40:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:10.303 09:40:33 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:10.303 09:40:33 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:10.561 true 00:17:10.561 09:40:33 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:10.561 09:40:33 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:10.821 09:40:33 -- target/tls.sh@82 -- # version=0 00:17:10.821 09:40:33 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:10.821 09:40:33 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:11.081 09:40:33 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:11.081 09:40:33 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:11.341 09:40:34 -- target/tls.sh@90 -- # version=13 00:17:11.341 09:40:34 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:11.341 09:40:34 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:11.600 09:40:34 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:11.600 09:40:34 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:11.859 09:40:34 -- target/tls.sh@98 -- # version=7 00:17:11.859 09:40:34 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:11.859 09:40:34 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:11.859 09:40:34 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:12.118 09:40:34 -- target/tls.sh@105 -- # ktls=false 00:17:12.118 09:40:34 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:12.118 09:40:34 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:12.382 09:40:35 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:12.382 09:40:35 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:12.645 09:40:35 -- target/tls.sh@113 -- # ktls=true 00:17:12.645 09:40:35 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:12.645 09:40:35 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:12.903 09:40:35 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:12.903 09:40:35 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:13.161 09:40:35 -- target/tls.sh@121 -- # ktls=false 00:17:13.161 09:40:35 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:13.161 09:40:35 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:13.161 09:40:35 -- target/tls.sh@49 -- # local key hash crc 00:17:13.161 09:40:35 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:13.161 09:40:35 -- target/tls.sh@51 -- # hash=01 00:17:13.161 09:40:35 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:13.161 09:40:35 -- target/tls.sh@52 -- # gzip -1 -c 00:17:13.161 09:40:35 -- target/tls.sh@52 -- # tail -c8 00:17:13.161 09:40:35 -- target/tls.sh@52 -- # head -c 4 00:17:13.161 09:40:35 -- target/tls.sh@52 -- # crc='p$H�' 00:17:13.161 09:40:35 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:13.161 09:40:35 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:13.161 09:40:35 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:13.161 09:40:35 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:13.161 09:40:35 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:13.161 09:40:35 -- target/tls.sh@49 -- # local key hash crc 00:17:13.161 09:40:35 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:13.161 09:40:35 -- target/tls.sh@51 -- # hash=01 00:17:13.162 09:40:35 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:13.162 09:40:35 -- target/tls.sh@52 -- # gzip -1 -c 00:17:13.162 09:40:35 -- target/tls.sh@52 -- # tail -c8 00:17:13.162 09:40:35 -- target/tls.sh@52 -- # head -c 4 00:17:13.162 09:40:35 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:13.162 09:40:35 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:13.162 09:40:35 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:13.162 09:40:35 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:13.162 09:40:35 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:13.162 09:40:35 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.162 09:40:35 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:13.162 09:40:35 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:13.162 09:40:35 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:13.162 09:40:35 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.162 09:40:35 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:13.162 09:40:35 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:13.420 09:40:36 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:13.985 09:40:36 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.985 09:40:36 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.986 09:40:36 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:13.986 [2024-11-29 09:40:36.769060] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:13.986 09:40:36 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:14.243 09:40:37 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:14.501 [2024-11-29 09:40:37.262391] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:14.501 [2024-11-29 09:40:37.262643] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:14.501 09:40:37 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:14.758 malloc0 00:17:14.758 09:40:37 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:15.016 09:40:37 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:15.275 09:40:38 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:15.275 EAL: No free 2048 kB hugepages reported on node 1 00:17:27.501 Initializing NVMe Controllers 00:17:27.501 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:27.501 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:27.501 Initialization complete. Launching workers. 00:17:27.501 ======================================================== 00:17:27.501 Latency(us) 00:17:27.501 Device Information : IOPS MiB/s Average min max 00:17:27.501 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7680.94 30.00 8335.04 1206.27 9006.94 00:17:27.501 ======================================================== 00:17:27.501 Total : 7680.94 30.00 8335.04 1206.27 9006.94 00:17:27.501 00:17:27.501 09:40:48 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:27.501 09:40:48 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:27.501 09:40:48 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:27.501 09:40:48 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:27.501 09:40:48 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:27.501 09:40:48 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:27.501 09:40:48 -- target/tls.sh@28 -- # bdevperf_pid=43330 00:17:27.501 09:40:48 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:27.501 09:40:48 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:27.501 09:40:48 -- target/tls.sh@31 -- # waitforlisten 43330 /var/tmp/bdevperf.sock 00:17:27.501 09:40:48 -- common/autotest_common.sh@829 -- # '[' -z 43330 ']' 00:17:27.501 09:40:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:27.501 09:40:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:27.501 09:40:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:27.501 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:27.501 09:40:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:27.501 09:40:48 -- common/autotest_common.sh@10 -- # set +x 00:17:27.501 [2024-11-29 09:40:48.201070] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:27.501 [2024-11-29 09:40:48.201162] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid43330 ] 00:17:27.501 EAL: No free 2048 kB hugepages reported on node 1 00:17:27.501 [2024-11-29 09:40:48.260222] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:27.501 [2024-11-29 09:40:48.363362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:27.501 09:40:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:27.501 09:40:49 -- common/autotest_common.sh@862 -- # return 0 00:17:27.501 09:40:49 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:27.501 [2024-11-29 09:40:49.384553] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:27.501 TLSTESTn1 00:17:27.501 09:40:49 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:27.501 Running I/O for 10 seconds... 00:17:37.488 00:17:37.488 Latency(us) 00:17:37.488 [2024-11-29T08:41:00.331Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:37.488 [2024-11-29T08:41:00.331Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:37.488 Verification LBA range: start 0x0 length 0x2000 00:17:37.488 TLSTESTn1 : 10.02 4607.47 18.00 0.00 0.00 27740.11 5582.70 46409.20 00:17:37.488 [2024-11-29T08:41:00.331Z] =================================================================================================================== 00:17:37.488 [2024-11-29T08:41:00.331Z] Total : 4607.47 18.00 0.00 0.00 27740.11 5582.70 46409.20 00:17:37.488 0 00:17:37.488 09:40:59 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:37.488 09:40:59 -- target/tls.sh@45 -- # killprocess 43330 00:17:37.488 09:40:59 -- common/autotest_common.sh@936 -- # '[' -z 43330 ']' 00:17:37.488 09:40:59 -- common/autotest_common.sh@940 -- # kill -0 43330 00:17:37.488 09:40:59 -- common/autotest_common.sh@941 -- # uname 00:17:37.488 09:40:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:37.488 09:40:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 43330 00:17:37.488 09:40:59 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:37.488 09:40:59 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:37.488 09:40:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 43330' 00:17:37.488 killing process with pid 43330 00:17:37.488 09:40:59 -- common/autotest_common.sh@955 -- # kill 43330 00:17:37.488 Received shutdown signal, test time was about 10.000000 seconds 00:17:37.488 00:17:37.488 Latency(us) 00:17:37.488 [2024-11-29T08:41:00.331Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:37.488 [2024-11-29T08:41:00.331Z] =================================================================================================================== 00:17:37.488 [2024-11-29T08:41:00.331Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:37.488 09:40:59 -- common/autotest_common.sh@960 -- # wait 43330 00:17:37.488 09:40:59 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:37.488 09:40:59 -- common/autotest_common.sh@650 -- # local es=0 00:17:37.488 09:40:59 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:37.488 09:40:59 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:37.488 09:40:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:37.488 09:40:59 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:37.488 09:40:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:37.488 09:40:59 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:37.488 09:40:59 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:37.488 09:40:59 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:37.488 09:40:59 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:37.488 09:40:59 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:37.488 09:40:59 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:37.488 09:40:59 -- target/tls.sh@28 -- # bdevperf_pid=44699 00:17:37.489 09:40:59 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:37.489 09:40:59 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:37.489 09:40:59 -- target/tls.sh@31 -- # waitforlisten 44699 /var/tmp/bdevperf.sock 00:17:37.489 09:40:59 -- common/autotest_common.sh@829 -- # '[' -z 44699 ']' 00:17:37.489 09:40:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:37.489 09:40:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:37.489 09:40:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:37.489 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:37.489 09:40:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:37.489 09:40:59 -- common/autotest_common.sh@10 -- # set +x 00:17:37.489 [2024-11-29 09:40:59.945563] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:37.489 [2024-11-29 09:40:59.945643] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid44699 ] 00:17:37.489 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.489 [2024-11-29 09:41:00.004929] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:37.489 [2024-11-29 09:41:00.121652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:38.426 09:41:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:38.426 09:41:00 -- common/autotest_common.sh@862 -- # return 0 00:17:38.426 09:41:00 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:38.426 [2024-11-29 09:41:01.197280] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:38.426 [2024-11-29 09:41:01.204914] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:38.426 [2024-11-29 09:41:01.205326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x190f1f0 (107): Transport endpoint is not connected 00:17:38.426 [2024-11-29 09:41:01.206314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x190f1f0 (9): Bad file descriptor 00:17:38.426 [2024-11-29 09:41:01.207313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:38.426 [2024-11-29 09:41:01.207334] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:38.426 [2024-11-29 09:41:01.207349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:38.426 request: 00:17:38.426 { 00:17:38.426 "name": "TLSTEST", 00:17:38.426 "trtype": "tcp", 00:17:38.426 "traddr": "10.0.0.2", 00:17:38.426 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:38.426 "adrfam": "ipv4", 00:17:38.426 "trsvcid": "4420", 00:17:38.426 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:38.426 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:38.426 "method": "bdev_nvme_attach_controller", 00:17:38.426 "req_id": 1 00:17:38.426 } 00:17:38.426 Got JSON-RPC error response 00:17:38.426 response: 00:17:38.426 { 00:17:38.426 "code": -32602, 00:17:38.426 "message": "Invalid parameters" 00:17:38.426 } 00:17:38.426 09:41:01 -- target/tls.sh@36 -- # killprocess 44699 00:17:38.426 09:41:01 -- common/autotest_common.sh@936 -- # '[' -z 44699 ']' 00:17:38.426 09:41:01 -- common/autotest_common.sh@940 -- # kill -0 44699 00:17:38.426 09:41:01 -- common/autotest_common.sh@941 -- # uname 00:17:38.426 09:41:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:38.426 09:41:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 44699 00:17:38.426 09:41:01 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:38.426 09:41:01 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:38.426 09:41:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 44699' 00:17:38.426 killing process with pid 44699 00:17:38.426 09:41:01 -- common/autotest_common.sh@955 -- # kill 44699 00:17:38.426 Received shutdown signal, test time was about 10.000000 seconds 00:17:38.426 00:17:38.426 Latency(us) 00:17:38.426 [2024-11-29T08:41:01.269Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:38.426 [2024-11-29T08:41:01.269Z] =================================================================================================================== 00:17:38.426 [2024-11-29T08:41:01.269Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:38.426 09:41:01 -- common/autotest_common.sh@960 -- # wait 44699 00:17:38.684 09:41:01 -- target/tls.sh@37 -- # return 1 00:17:38.684 09:41:01 -- common/autotest_common.sh@653 -- # es=1 00:17:38.684 09:41:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:38.684 09:41:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:38.944 09:41:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:38.944 09:41:01 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.944 09:41:01 -- common/autotest_common.sh@650 -- # local es=0 00:17:38.944 09:41:01 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.944 09:41:01 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:38.944 09:41:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:38.944 09:41:01 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:38.944 09:41:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:38.944 09:41:01 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.944 09:41:01 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:38.944 09:41:01 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:38.944 09:41:01 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:38.944 09:41:01 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:38.944 09:41:01 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:38.944 09:41:01 -- target/tls.sh@28 -- # bdevperf_pid=44973 00:17:38.944 09:41:01 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:38.944 09:41:01 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:38.944 09:41:01 -- target/tls.sh@31 -- # waitforlisten 44973 /var/tmp/bdevperf.sock 00:17:38.944 09:41:01 -- common/autotest_common.sh@829 -- # '[' -z 44973 ']' 00:17:38.944 09:41:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:38.944 09:41:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:38.944 09:41:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:38.945 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:38.945 09:41:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:38.945 09:41:01 -- common/autotest_common.sh@10 -- # set +x 00:17:38.945 [2024-11-29 09:41:01.568624] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:38.945 [2024-11-29 09:41:01.568715] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid44973 ] 00:17:38.945 EAL: No free 2048 kB hugepages reported on node 1 00:17:38.945 [2024-11-29 09:41:01.625853] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:38.945 [2024-11-29 09:41:01.727612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:39.880 09:41:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:39.880 09:41:02 -- common/autotest_common.sh@862 -- # return 0 00:17:39.880 09:41:02 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:40.137 [2024-11-29 09:41:02.797097] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:40.137 [2024-11-29 09:41:02.808934] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:40.137 [2024-11-29 09:41:02.808968] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:40.137 [2024-11-29 09:41:02.809022] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:40.137 [2024-11-29 09:41:02.809066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc101f0 (107): Transport endpoint is not connected 00:17:40.137 [2024-11-29 09:41:02.810031] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc101f0 (9): Bad file descriptor 00:17:40.137 [2024-11-29 09:41:02.811030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:40.137 [2024-11-29 09:41:02.811051] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:40.137 [2024-11-29 09:41:02.811065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:40.137 request: 00:17:40.137 { 00:17:40.137 "name": "TLSTEST", 00:17:40.137 "trtype": "tcp", 00:17:40.137 "traddr": "10.0.0.2", 00:17:40.137 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:40.137 "adrfam": "ipv4", 00:17:40.137 "trsvcid": "4420", 00:17:40.137 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:40.137 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:40.137 "method": "bdev_nvme_attach_controller", 00:17:40.137 "req_id": 1 00:17:40.137 } 00:17:40.137 Got JSON-RPC error response 00:17:40.137 response: 00:17:40.137 { 00:17:40.137 "code": -32602, 00:17:40.137 "message": "Invalid parameters" 00:17:40.137 } 00:17:40.137 09:41:02 -- target/tls.sh@36 -- # killprocess 44973 00:17:40.137 09:41:02 -- common/autotest_common.sh@936 -- # '[' -z 44973 ']' 00:17:40.137 09:41:02 -- common/autotest_common.sh@940 -- # kill -0 44973 00:17:40.137 09:41:02 -- common/autotest_common.sh@941 -- # uname 00:17:40.137 09:41:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:40.137 09:41:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 44973 00:17:40.137 09:41:02 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:40.137 09:41:02 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:40.137 09:41:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 44973' 00:17:40.137 killing process with pid 44973 00:17:40.137 09:41:02 -- common/autotest_common.sh@955 -- # kill 44973 00:17:40.137 Received shutdown signal, test time was about 10.000000 seconds 00:17:40.137 00:17:40.137 Latency(us) 00:17:40.137 [2024-11-29T08:41:02.980Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:40.137 [2024-11-29T08:41:02.980Z] =================================================================================================================== 00:17:40.137 [2024-11-29T08:41:02.980Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:40.137 09:41:02 -- common/autotest_common.sh@960 -- # wait 44973 00:17:40.396 09:41:03 -- target/tls.sh@37 -- # return 1 00:17:40.396 09:41:03 -- common/autotest_common.sh@653 -- # es=1 00:17:40.396 09:41:03 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:40.396 09:41:03 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:40.396 09:41:03 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:40.396 09:41:03 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:40.396 09:41:03 -- common/autotest_common.sh@650 -- # local es=0 00:17:40.396 09:41:03 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:40.396 09:41:03 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:40.396 09:41:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:40.396 09:41:03 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:40.396 09:41:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:40.396 09:41:03 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:40.396 09:41:03 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:40.396 09:41:03 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:40.396 09:41:03 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:40.396 09:41:03 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:40.396 09:41:03 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:40.396 09:41:03 -- target/tls.sh@28 -- # bdevperf_pid=45127 00:17:40.396 09:41:03 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:40.396 09:41:03 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:40.396 09:41:03 -- target/tls.sh@31 -- # waitforlisten 45127 /var/tmp/bdevperf.sock 00:17:40.396 09:41:03 -- common/autotest_common.sh@829 -- # '[' -z 45127 ']' 00:17:40.396 09:41:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:40.396 09:41:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:40.396 09:41:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:40.396 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:40.396 09:41:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:40.396 09:41:03 -- common/autotest_common.sh@10 -- # set +x 00:17:40.396 [2024-11-29 09:41:03.177262] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:40.396 [2024-11-29 09:41:03.177358] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid45127 ] 00:17:40.396 EAL: No free 2048 kB hugepages reported on node 1 00:17:40.396 [2024-11-29 09:41:03.236123] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:40.654 [2024-11-29 09:41:03.338911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:41.590 09:41:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:41.590 09:41:04 -- common/autotest_common.sh@862 -- # return 0 00:17:41.590 09:41:04 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:41.590 [2024-11-29 09:41:04.427232] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:41.849 [2024-11-29 09:41:04.433192] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:41.849 [2024-11-29 09:41:04.433240] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:41.849 [2024-11-29 09:41:04.433304] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:41.850 [2024-11-29 09:41:04.434247] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x214b1f0 (107): Transport endpoint is not connected 00:17:41.850 [2024-11-29 09:41:04.435239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x214b1f0 (9): Bad file descriptor 00:17:41.850 [2024-11-29 09:41:04.436238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:41.850 [2024-11-29 09:41:04.436259] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:41.850 [2024-11-29 09:41:04.436274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:41.850 request: 00:17:41.850 { 00:17:41.850 "name": "TLSTEST", 00:17:41.850 "trtype": "tcp", 00:17:41.850 "traddr": "10.0.0.2", 00:17:41.850 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:41.850 "adrfam": "ipv4", 00:17:41.850 "trsvcid": "4420", 00:17:41.850 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:41.850 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:41.850 "method": "bdev_nvme_attach_controller", 00:17:41.850 "req_id": 1 00:17:41.850 } 00:17:41.850 Got JSON-RPC error response 00:17:41.850 response: 00:17:41.850 { 00:17:41.850 "code": -32602, 00:17:41.850 "message": "Invalid parameters" 00:17:41.850 } 00:17:41.850 09:41:04 -- target/tls.sh@36 -- # killprocess 45127 00:17:41.850 09:41:04 -- common/autotest_common.sh@936 -- # '[' -z 45127 ']' 00:17:41.850 09:41:04 -- common/autotest_common.sh@940 -- # kill -0 45127 00:17:41.850 09:41:04 -- common/autotest_common.sh@941 -- # uname 00:17:41.850 09:41:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:41.850 09:41:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 45127 00:17:41.850 09:41:04 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:41.850 09:41:04 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:41.850 09:41:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 45127' 00:17:41.850 killing process with pid 45127 00:17:41.850 09:41:04 -- common/autotest_common.sh@955 -- # kill 45127 00:17:41.850 Received shutdown signal, test time was about 10.000000 seconds 00:17:41.850 00:17:41.850 Latency(us) 00:17:41.850 [2024-11-29T08:41:04.693Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:41.850 [2024-11-29T08:41:04.693Z] =================================================================================================================== 00:17:41.850 [2024-11-29T08:41:04.693Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:41.850 09:41:04 -- common/autotest_common.sh@960 -- # wait 45127 00:17:42.108 09:41:04 -- target/tls.sh@37 -- # return 1 00:17:42.108 09:41:04 -- common/autotest_common.sh@653 -- # es=1 00:17:42.108 09:41:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:42.108 09:41:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:42.108 09:41:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:42.108 09:41:04 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:42.108 09:41:04 -- common/autotest_common.sh@650 -- # local es=0 00:17:42.108 09:41:04 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:42.108 09:41:04 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:42.108 09:41:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:42.108 09:41:04 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:42.108 09:41:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:42.108 09:41:04 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:42.108 09:41:04 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:42.108 09:41:04 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:42.108 09:41:04 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:42.108 09:41:04 -- target/tls.sh@23 -- # psk= 00:17:42.108 09:41:04 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:42.108 09:41:04 -- target/tls.sh@28 -- # bdevperf_pid=45397 00:17:42.108 09:41:04 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:42.108 09:41:04 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:42.108 09:41:04 -- target/tls.sh@31 -- # waitforlisten 45397 /var/tmp/bdevperf.sock 00:17:42.108 09:41:04 -- common/autotest_common.sh@829 -- # '[' -z 45397 ']' 00:17:42.108 09:41:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:42.108 09:41:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:42.108 09:41:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:42.108 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:42.108 09:41:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:42.108 09:41:04 -- common/autotest_common.sh@10 -- # set +x 00:17:42.108 [2024-11-29 09:41:04.798772] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:42.108 [2024-11-29 09:41:04.798864] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid45397 ] 00:17:42.108 EAL: No free 2048 kB hugepages reported on node 1 00:17:42.108 [2024-11-29 09:41:04.856647] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:42.368 [2024-11-29 09:41:04.958933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:43.304 09:41:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:43.304 09:41:05 -- common/autotest_common.sh@862 -- # return 0 00:17:43.304 09:41:05 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:43.304 [2024-11-29 09:41:06.057617] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:43.304 [2024-11-29 09:41:06.059530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x204b050 (9): Bad file descriptor 00:17:43.304 [2024-11-29 09:41:06.060526] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:43.304 [2024-11-29 09:41:06.060549] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:43.304 [2024-11-29 09:41:06.060564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:43.304 request: 00:17:43.304 { 00:17:43.304 "name": "TLSTEST", 00:17:43.304 "trtype": "tcp", 00:17:43.304 "traddr": "10.0.0.2", 00:17:43.304 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:43.304 "adrfam": "ipv4", 00:17:43.304 "trsvcid": "4420", 00:17:43.304 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:43.304 "method": "bdev_nvme_attach_controller", 00:17:43.304 "req_id": 1 00:17:43.304 } 00:17:43.304 Got JSON-RPC error response 00:17:43.304 response: 00:17:43.304 { 00:17:43.304 "code": -32602, 00:17:43.304 "message": "Invalid parameters" 00:17:43.304 } 00:17:43.304 09:41:06 -- target/tls.sh@36 -- # killprocess 45397 00:17:43.304 09:41:06 -- common/autotest_common.sh@936 -- # '[' -z 45397 ']' 00:17:43.304 09:41:06 -- common/autotest_common.sh@940 -- # kill -0 45397 00:17:43.304 09:41:06 -- common/autotest_common.sh@941 -- # uname 00:17:43.304 09:41:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:43.304 09:41:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 45397 00:17:43.304 09:41:06 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:43.304 09:41:06 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:43.304 09:41:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 45397' 00:17:43.304 killing process with pid 45397 00:17:43.304 09:41:06 -- common/autotest_common.sh@955 -- # kill 45397 00:17:43.304 Received shutdown signal, test time was about 10.000000 seconds 00:17:43.304 00:17:43.304 Latency(us) 00:17:43.304 [2024-11-29T08:41:06.147Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:43.304 [2024-11-29T08:41:06.147Z] =================================================================================================================== 00:17:43.304 [2024-11-29T08:41:06.147Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:43.304 09:41:06 -- common/autotest_common.sh@960 -- # wait 45397 00:17:43.564 09:41:06 -- target/tls.sh@37 -- # return 1 00:17:43.564 09:41:06 -- common/autotest_common.sh@653 -- # es=1 00:17:43.564 09:41:06 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:43.564 09:41:06 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:43.564 09:41:06 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:43.564 09:41:06 -- target/tls.sh@167 -- # killprocess 41374 00:17:43.564 09:41:06 -- common/autotest_common.sh@936 -- # '[' -z 41374 ']' 00:17:43.564 09:41:06 -- common/autotest_common.sh@940 -- # kill -0 41374 00:17:43.564 09:41:06 -- common/autotest_common.sh@941 -- # uname 00:17:43.564 09:41:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:43.564 09:41:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 41374 00:17:43.564 09:41:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:43.565 09:41:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:43.565 09:41:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 41374' 00:17:43.565 killing process with pid 41374 00:17:43.565 09:41:06 -- common/autotest_common.sh@955 -- # kill 41374 00:17:43.565 09:41:06 -- common/autotest_common.sh@960 -- # wait 41374 00:17:44.134 09:41:06 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:44.134 09:41:06 -- target/tls.sh@49 -- # local key hash crc 00:17:44.134 09:41:06 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:44.134 09:41:06 -- target/tls.sh@51 -- # hash=02 00:17:44.134 09:41:06 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:44.134 09:41:06 -- target/tls.sh@52 -- # gzip -1 -c 00:17:44.134 09:41:06 -- target/tls.sh@52 -- # tail -c8 00:17:44.134 09:41:06 -- target/tls.sh@52 -- # head -c 4 00:17:44.134 09:41:06 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:44.134 09:41:06 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:44.134 09:41:06 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:44.134 09:41:06 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:44.134 09:41:06 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:44.134 09:41:06 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:44.134 09:41:06 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:44.135 09:41:06 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:44.135 09:41:06 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:44.135 09:41:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:44.135 09:41:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:44.135 09:41:06 -- common/autotest_common.sh@10 -- # set +x 00:17:44.135 09:41:06 -- nvmf/common.sh@469 -- # nvmfpid=45571 00:17:44.135 09:41:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:44.135 09:41:06 -- nvmf/common.sh@470 -- # waitforlisten 45571 00:17:44.135 09:41:06 -- common/autotest_common.sh@829 -- # '[' -z 45571 ']' 00:17:44.135 09:41:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:44.135 09:41:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:44.135 09:41:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:44.135 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:44.135 09:41:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:44.135 09:41:06 -- common/autotest_common.sh@10 -- # set +x 00:17:44.135 [2024-11-29 09:41:06.749219] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:44.135 [2024-11-29 09:41:06.749317] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:44.135 EAL: No free 2048 kB hugepages reported on node 1 00:17:44.135 [2024-11-29 09:41:06.817146] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:44.135 [2024-11-29 09:41:06.929685] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:44.135 [2024-11-29 09:41:06.929873] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:44.135 [2024-11-29 09:41:06.929903] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:44.135 [2024-11-29 09:41:06.929919] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:44.135 [2024-11-29 09:41:06.929962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:45.073 09:41:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:45.073 09:41:07 -- common/autotest_common.sh@862 -- # return 0 00:17:45.073 09:41:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:45.073 09:41:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:45.073 09:41:07 -- common/autotest_common.sh@10 -- # set +x 00:17:45.073 09:41:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:45.073 09:41:07 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:45.073 09:41:07 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:45.073 09:41:07 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:45.331 [2024-11-29 09:41:07.965032] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:45.331 09:41:07 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:45.591 09:41:08 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:45.852 [2024-11-29 09:41:08.474430] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:45.852 [2024-11-29 09:41:08.474710] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:45.852 09:41:08 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:46.112 malloc0 00:17:46.112 09:41:08 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:46.370 09:41:08 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:46.629 09:41:09 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:46.629 09:41:09 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:46.629 09:41:09 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:46.629 09:41:09 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:46.630 09:41:09 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:46.630 09:41:09 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:46.630 09:41:09 -- target/tls.sh@28 -- # bdevperf_pid=45994 00:17:46.630 09:41:09 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:46.630 09:41:09 -- target/tls.sh@31 -- # waitforlisten 45994 /var/tmp/bdevperf.sock 00:17:46.630 09:41:09 -- common/autotest_common.sh@829 -- # '[' -z 45994 ']' 00:17:46.630 09:41:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:46.630 09:41:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:46.630 09:41:09 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:46.630 09:41:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:46.630 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:46.630 09:41:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:46.630 09:41:09 -- common/autotest_common.sh@10 -- # set +x 00:17:46.630 [2024-11-29 09:41:09.341915] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:46.630 [2024-11-29 09:41:09.342008] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid45994 ] 00:17:46.630 EAL: No free 2048 kB hugepages reported on node 1 00:17:46.630 [2024-11-29 09:41:09.400620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:46.890 [2024-11-29 09:41:09.504973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:47.828 09:41:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:47.828 09:41:10 -- common/autotest_common.sh@862 -- # return 0 00:17:47.828 09:41:10 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:47.828 [2024-11-29 09:41:10.590662] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:47.828 TLSTESTn1 00:17:48.088 09:41:10 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:48.088 Running I/O for 10 seconds... 00:17:58.147 00:17:58.147 Latency(us) 00:17:58.147 [2024-11-29T08:41:20.990Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.147 [2024-11-29T08:41:20.990Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:58.147 Verification LBA range: start 0x0 length 0x2000 00:17:58.147 TLSTESTn1 : 10.02 4337.84 16.94 0.00 0.00 29464.99 4636.07 69128.34 00:17:58.147 [2024-11-29T08:41:20.990Z] =================================================================================================================== 00:17:58.147 [2024-11-29T08:41:20.990Z] Total : 4337.84 16.94 0.00 0.00 29464.99 4636.07 69128.34 00:17:58.147 0 00:17:58.147 09:41:20 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:58.147 09:41:20 -- target/tls.sh@45 -- # killprocess 45994 00:17:58.147 09:41:20 -- common/autotest_common.sh@936 -- # '[' -z 45994 ']' 00:17:58.147 09:41:20 -- common/autotest_common.sh@940 -- # kill -0 45994 00:17:58.147 09:41:20 -- common/autotest_common.sh@941 -- # uname 00:17:58.147 09:41:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:58.147 09:41:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 45994 00:17:58.147 09:41:20 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:58.147 09:41:20 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:58.147 09:41:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 45994' 00:17:58.147 killing process with pid 45994 00:17:58.147 09:41:20 -- common/autotest_common.sh@955 -- # kill 45994 00:17:58.147 Received shutdown signal, test time was about 10.000000 seconds 00:17:58.147 00:17:58.147 Latency(us) 00:17:58.147 [2024-11-29T08:41:20.990Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.147 [2024-11-29T08:41:20.990Z] =================================================================================================================== 00:17:58.147 [2024-11-29T08:41:20.990Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:58.147 09:41:20 -- common/autotest_common.sh@960 -- # wait 45994 00:17:58.406 09:41:21 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.406 09:41:21 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.406 09:41:21 -- common/autotest_common.sh@650 -- # local es=0 00:17:58.406 09:41:21 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.406 09:41:21 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:58.406 09:41:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:58.406 09:41:21 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:58.406 09:41:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:58.406 09:41:21 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.406 09:41:21 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:58.406 09:41:21 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:58.406 09:41:21 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:58.406 09:41:21 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:58.406 09:41:21 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:58.406 09:41:21 -- target/tls.sh@28 -- # bdevperf_pid=47361 00:17:58.406 09:41:21 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:58.406 09:41:21 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:58.406 09:41:21 -- target/tls.sh@31 -- # waitforlisten 47361 /var/tmp/bdevperf.sock 00:17:58.406 09:41:21 -- common/autotest_common.sh@829 -- # '[' -z 47361 ']' 00:17:58.406 09:41:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:58.406 09:41:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:58.406 09:41:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:58.406 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:58.406 09:41:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:58.406 09:41:21 -- common/autotest_common.sh@10 -- # set +x 00:17:58.406 [2024-11-29 09:41:21.205588] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:58.406 [2024-11-29 09:41:21.205678] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid47361 ] 00:17:58.406 EAL: No free 2048 kB hugepages reported on node 1 00:17:58.664 [2024-11-29 09:41:21.264955] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:58.664 [2024-11-29 09:41:21.366004] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:59.597 09:41:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:59.597 09:41:22 -- common/autotest_common.sh@862 -- # return 0 00:17:59.597 09:41:22 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.855 [2024-11-29 09:41:22.493630] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:59.855 [2024-11-29 09:41:22.493686] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:59.855 request: 00:17:59.855 { 00:17:59.855 "name": "TLSTEST", 00:17:59.855 "trtype": "tcp", 00:17:59.855 "traddr": "10.0.0.2", 00:17:59.855 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:59.855 "adrfam": "ipv4", 00:17:59.855 "trsvcid": "4420", 00:17:59.855 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:59.855 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:59.855 "method": "bdev_nvme_attach_controller", 00:17:59.855 "req_id": 1 00:17:59.855 } 00:17:59.855 Got JSON-RPC error response 00:17:59.855 response: 00:17:59.855 { 00:17:59.855 "code": -22, 00:17:59.855 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:59.855 } 00:17:59.855 09:41:22 -- target/tls.sh@36 -- # killprocess 47361 00:17:59.855 09:41:22 -- common/autotest_common.sh@936 -- # '[' -z 47361 ']' 00:17:59.855 09:41:22 -- common/autotest_common.sh@940 -- # kill -0 47361 00:17:59.855 09:41:22 -- common/autotest_common.sh@941 -- # uname 00:17:59.855 09:41:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:59.855 09:41:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 47361 00:17:59.855 09:41:22 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:59.855 09:41:22 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:59.855 09:41:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 47361' 00:17:59.856 killing process with pid 47361 00:17:59.856 09:41:22 -- common/autotest_common.sh@955 -- # kill 47361 00:17:59.856 Received shutdown signal, test time was about 10.000000 seconds 00:17:59.856 00:17:59.856 Latency(us) 00:17:59.856 [2024-11-29T08:41:22.699Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:59.856 [2024-11-29T08:41:22.699Z] =================================================================================================================== 00:17:59.856 [2024-11-29T08:41:22.699Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:59.856 09:41:22 -- common/autotest_common.sh@960 -- # wait 47361 00:18:00.115 09:41:22 -- target/tls.sh@37 -- # return 1 00:18:00.115 09:41:22 -- common/autotest_common.sh@653 -- # es=1 00:18:00.115 09:41:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:00.115 09:41:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:00.115 09:41:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:00.115 09:41:22 -- target/tls.sh@183 -- # killprocess 45571 00:18:00.115 09:41:22 -- common/autotest_common.sh@936 -- # '[' -z 45571 ']' 00:18:00.115 09:41:22 -- common/autotest_common.sh@940 -- # kill -0 45571 00:18:00.115 09:41:22 -- common/autotest_common.sh@941 -- # uname 00:18:00.115 09:41:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:00.115 09:41:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 45571 00:18:00.115 09:41:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:00.115 09:41:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:00.115 09:41:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 45571' 00:18:00.115 killing process with pid 45571 00:18:00.115 09:41:22 -- common/autotest_common.sh@955 -- # kill 45571 00:18:00.115 09:41:22 -- common/autotest_common.sh@960 -- # wait 45571 00:18:00.373 09:41:23 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:18:00.373 09:41:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:00.373 09:41:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:00.373 09:41:23 -- common/autotest_common.sh@10 -- # set +x 00:18:00.373 09:41:23 -- nvmf/common.sh@469 -- # nvmfpid=47649 00:18:00.373 09:41:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:00.373 09:41:23 -- nvmf/common.sh@470 -- # waitforlisten 47649 00:18:00.373 09:41:23 -- common/autotest_common.sh@829 -- # '[' -z 47649 ']' 00:18:00.373 09:41:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:00.373 09:41:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:00.373 09:41:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:00.373 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:00.373 09:41:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:00.373 09:41:23 -- common/autotest_common.sh@10 -- # set +x 00:18:00.373 [2024-11-29 09:41:23.179867] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:00.373 [2024-11-29 09:41:23.179954] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:00.373 EAL: No free 2048 kB hugepages reported on node 1 00:18:00.631 [2024-11-29 09:41:23.242040] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:00.631 [2024-11-29 09:41:23.345135] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:00.631 [2024-11-29 09:41:23.345285] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:00.631 [2024-11-29 09:41:23.345302] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:00.631 [2024-11-29 09:41:23.345314] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:00.631 [2024-11-29 09:41:23.345341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:01.568 09:41:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:01.568 09:41:24 -- common/autotest_common.sh@862 -- # return 0 00:18:01.568 09:41:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:01.568 09:41:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:01.568 09:41:24 -- common/autotest_common.sh@10 -- # set +x 00:18:01.568 09:41:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:01.568 09:41:24 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.568 09:41:24 -- common/autotest_common.sh@650 -- # local es=0 00:18:01.568 09:41:24 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.568 09:41:24 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:18:01.568 09:41:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:01.568 09:41:24 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:18:01.568 09:41:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:01.568 09:41:24 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.568 09:41:24 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.568 09:41:24 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:01.826 [2024-11-29 09:41:24.503746] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:01.826 09:41:24 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:02.083 09:41:24 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:02.359 [2024-11-29 09:41:25.029205] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:02.359 [2024-11-29 09:41:25.029505] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:02.359 09:41:25 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:02.620 malloc0 00:18:02.620 09:41:25 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:02.878 09:41:25 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:03.137 [2024-11-29 09:41:25.835071] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:03.137 [2024-11-29 09:41:25.835121] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:03.137 [2024-11-29 09:41:25.835147] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:03.137 request: 00:18:03.137 { 00:18:03.138 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:03.138 "host": "nqn.2016-06.io.spdk:host1", 00:18:03.138 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:03.138 "method": "nvmf_subsystem_add_host", 00:18:03.138 "req_id": 1 00:18:03.138 } 00:18:03.138 Got JSON-RPC error response 00:18:03.138 response: 00:18:03.138 { 00:18:03.138 "code": -32603, 00:18:03.138 "message": "Internal error" 00:18:03.138 } 00:18:03.138 09:41:25 -- common/autotest_common.sh@653 -- # es=1 00:18:03.138 09:41:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:03.138 09:41:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:03.138 09:41:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:03.138 09:41:25 -- target/tls.sh@189 -- # killprocess 47649 00:18:03.138 09:41:25 -- common/autotest_common.sh@936 -- # '[' -z 47649 ']' 00:18:03.138 09:41:25 -- common/autotest_common.sh@940 -- # kill -0 47649 00:18:03.138 09:41:25 -- common/autotest_common.sh@941 -- # uname 00:18:03.138 09:41:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:03.138 09:41:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 47649 00:18:03.138 09:41:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:03.138 09:41:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:03.138 09:41:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 47649' 00:18:03.138 killing process with pid 47649 00:18:03.138 09:41:25 -- common/autotest_common.sh@955 -- # kill 47649 00:18:03.138 09:41:25 -- common/autotest_common.sh@960 -- # wait 47649 00:18:03.397 09:41:26 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:03.397 09:41:26 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:03.397 09:41:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:03.397 09:41:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:03.397 09:41:26 -- common/autotest_common.sh@10 -- # set +x 00:18:03.397 09:41:26 -- nvmf/common.sh@469 -- # nvmfpid=48036 00:18:03.397 09:41:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:03.397 09:41:26 -- nvmf/common.sh@470 -- # waitforlisten 48036 00:18:03.397 09:41:26 -- common/autotest_common.sh@829 -- # '[' -z 48036 ']' 00:18:03.397 09:41:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:03.397 09:41:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:03.397 09:41:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:03.397 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:03.397 09:41:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:03.397 09:41:26 -- common/autotest_common.sh@10 -- # set +x 00:18:03.397 [2024-11-29 09:41:26.238628] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:03.397 [2024-11-29 09:41:26.238734] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:03.655 EAL: No free 2048 kB hugepages reported on node 1 00:18:03.655 [2024-11-29 09:41:26.301532] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:03.655 [2024-11-29 09:41:26.405028] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:03.655 [2024-11-29 09:41:26.405177] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:03.655 [2024-11-29 09:41:26.405194] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:03.655 [2024-11-29 09:41:26.405206] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:03.655 [2024-11-29 09:41:26.405232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:04.591 09:41:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:04.591 09:41:27 -- common/autotest_common.sh@862 -- # return 0 00:18:04.591 09:41:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:04.591 09:41:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:04.591 09:41:27 -- common/autotest_common.sh@10 -- # set +x 00:18:04.591 09:41:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:04.591 09:41:27 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:04.591 09:41:27 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:04.591 09:41:27 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:04.850 [2024-11-29 09:41:27.555945] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:04.850 09:41:27 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:05.108 09:41:27 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:05.366 [2024-11-29 09:41:28.053238] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:05.367 [2024-11-29 09:41:28.053491] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:05.367 09:41:28 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:05.625 malloc0 00:18:05.625 09:41:28 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:05.884 09:41:28 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:06.145 09:41:28 -- target/tls.sh@197 -- # bdevperf_pid=48388 00:18:06.145 09:41:28 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:06.145 09:41:28 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:06.145 09:41:28 -- target/tls.sh@200 -- # waitforlisten 48388 /var/tmp/bdevperf.sock 00:18:06.145 09:41:28 -- common/autotest_common.sh@829 -- # '[' -z 48388 ']' 00:18:06.145 09:41:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:06.145 09:41:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:06.145 09:41:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:06.145 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:06.145 09:41:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:06.145 09:41:28 -- common/autotest_common.sh@10 -- # set +x 00:18:06.145 [2024-11-29 09:41:28.879815] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:06.145 [2024-11-29 09:41:28.879901] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid48388 ] 00:18:06.145 EAL: No free 2048 kB hugepages reported on node 1 00:18:06.145 [2024-11-29 09:41:28.944452] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:06.432 [2024-11-29 09:41:29.055497] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:07.365 09:41:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:07.366 09:41:29 -- common/autotest_common.sh@862 -- # return 0 00:18:07.366 09:41:29 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:07.366 [2024-11-29 09:41:30.080428] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:07.366 TLSTESTn1 00:18:07.366 09:41:30 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:07.934 09:41:30 -- target/tls.sh@205 -- # tgtconf='{ 00:18:07.934 "subsystems": [ 00:18:07.934 { 00:18:07.934 "subsystem": "iobuf", 00:18:07.934 "config": [ 00:18:07.934 { 00:18:07.934 "method": "iobuf_set_options", 00:18:07.934 "params": { 00:18:07.934 "small_pool_count": 8192, 00:18:07.934 "large_pool_count": 1024, 00:18:07.934 "small_bufsize": 8192, 00:18:07.934 "large_bufsize": 135168 00:18:07.934 } 00:18:07.934 } 00:18:07.934 ] 00:18:07.934 }, 00:18:07.934 { 00:18:07.934 "subsystem": "sock", 00:18:07.934 "config": [ 00:18:07.934 { 00:18:07.934 "method": "sock_impl_set_options", 00:18:07.934 "params": { 00:18:07.934 "impl_name": "posix", 00:18:07.934 "recv_buf_size": 2097152, 00:18:07.934 "send_buf_size": 2097152, 00:18:07.934 "enable_recv_pipe": true, 00:18:07.934 "enable_quickack": false, 00:18:07.934 "enable_placement_id": 0, 00:18:07.934 "enable_zerocopy_send_server": true, 00:18:07.934 "enable_zerocopy_send_client": false, 00:18:07.934 "zerocopy_threshold": 0, 00:18:07.934 "tls_version": 0, 00:18:07.934 "enable_ktls": false 00:18:07.934 } 00:18:07.934 }, 00:18:07.934 { 00:18:07.934 "method": "sock_impl_set_options", 00:18:07.934 "params": { 00:18:07.934 "impl_name": "ssl", 00:18:07.934 "recv_buf_size": 4096, 00:18:07.934 "send_buf_size": 4096, 00:18:07.934 "enable_recv_pipe": true, 00:18:07.934 "enable_quickack": false, 00:18:07.934 "enable_placement_id": 0, 00:18:07.934 "enable_zerocopy_send_server": true, 00:18:07.934 "enable_zerocopy_send_client": false, 00:18:07.934 "zerocopy_threshold": 0, 00:18:07.934 "tls_version": 0, 00:18:07.934 "enable_ktls": false 00:18:07.934 } 00:18:07.934 } 00:18:07.934 ] 00:18:07.934 }, 00:18:07.934 { 00:18:07.934 "subsystem": "vmd", 00:18:07.934 "config": [] 00:18:07.934 }, 00:18:07.934 { 00:18:07.934 "subsystem": "accel", 00:18:07.934 "config": [ 00:18:07.934 { 00:18:07.934 "method": "accel_set_options", 00:18:07.934 "params": { 00:18:07.934 "small_cache_size": 128, 00:18:07.934 "large_cache_size": 16, 00:18:07.934 "task_count": 2048, 00:18:07.934 "sequence_count": 2048, 00:18:07.934 "buf_count": 2048 00:18:07.934 } 00:18:07.934 } 00:18:07.934 ] 00:18:07.934 }, 00:18:07.934 { 00:18:07.934 "subsystem": "bdev", 00:18:07.934 "config": [ 00:18:07.934 { 00:18:07.934 "method": "bdev_set_options", 00:18:07.934 "params": { 00:18:07.934 "bdev_io_pool_size": 65535, 00:18:07.934 "bdev_io_cache_size": 256, 00:18:07.934 "bdev_auto_examine": true, 00:18:07.934 "iobuf_small_cache_size": 128, 00:18:07.934 "iobuf_large_cache_size": 16 00:18:07.934 } 00:18:07.934 }, 00:18:07.934 { 00:18:07.934 "method": "bdev_raid_set_options", 00:18:07.934 "params": { 00:18:07.934 "process_window_size_kb": 1024 00:18:07.934 } 00:18:07.934 }, 00:18:07.934 { 00:18:07.934 "method": "bdev_iscsi_set_options", 00:18:07.934 "params": { 00:18:07.934 "timeout_sec": 30 00:18:07.934 } 00:18:07.934 }, 00:18:07.934 { 00:18:07.934 "method": "bdev_nvme_set_options", 00:18:07.934 "params": { 00:18:07.934 "action_on_timeout": "none", 00:18:07.934 "timeout_us": 0, 00:18:07.934 "timeout_admin_us": 0, 00:18:07.934 "keep_alive_timeout_ms": 10000, 00:18:07.934 "transport_retry_count": 4, 00:18:07.934 "arbitration_burst": 0, 00:18:07.935 "low_priority_weight": 0, 00:18:07.935 "medium_priority_weight": 0, 00:18:07.935 "high_priority_weight": 0, 00:18:07.935 "nvme_adminq_poll_period_us": 10000, 00:18:07.935 "nvme_ioq_poll_period_us": 0, 00:18:07.935 "io_queue_requests": 0, 00:18:07.935 "delay_cmd_submit": true, 00:18:07.935 "bdev_retry_count": 3, 00:18:07.935 "transport_ack_timeout": 0, 00:18:07.935 "ctrlr_loss_timeout_sec": 0, 00:18:07.935 "reconnect_delay_sec": 0, 00:18:07.935 "fast_io_fail_timeout_sec": 0, 00:18:07.935 "generate_uuids": false, 00:18:07.935 "transport_tos": 0, 00:18:07.935 "io_path_stat": false, 00:18:07.935 "allow_accel_sequence": false 00:18:07.935 } 00:18:07.935 }, 00:18:07.935 { 00:18:07.935 "method": "bdev_nvme_set_hotplug", 00:18:07.935 "params": { 00:18:07.935 "period_us": 100000, 00:18:07.935 "enable": false 00:18:07.935 } 00:18:07.935 }, 00:18:07.935 { 00:18:07.935 "method": "bdev_malloc_create", 00:18:07.935 "params": { 00:18:07.935 "name": "malloc0", 00:18:07.935 "num_blocks": 8192, 00:18:07.935 "block_size": 4096, 00:18:07.935 "physical_block_size": 4096, 00:18:07.935 "uuid": "d73a1a53-8575-45e0-bea3-3f91aca69af8", 00:18:07.935 "optimal_io_boundary": 0 00:18:07.935 } 00:18:07.935 }, 00:18:07.935 { 00:18:07.935 "method": "bdev_wait_for_examine" 00:18:07.935 } 00:18:07.935 ] 00:18:07.935 }, 00:18:07.935 { 00:18:07.935 "subsystem": "nbd", 00:18:07.935 "config": [] 00:18:07.935 }, 00:18:07.935 { 00:18:07.935 "subsystem": "scheduler", 00:18:07.935 "config": [ 00:18:07.935 { 00:18:07.935 "method": "framework_set_scheduler", 00:18:07.935 "params": { 00:18:07.935 "name": "static" 00:18:07.935 } 00:18:07.935 } 00:18:07.935 ] 00:18:07.935 }, 00:18:07.935 { 00:18:07.935 "subsystem": "nvmf", 00:18:07.935 "config": [ 00:18:07.935 { 00:18:07.935 "method": "nvmf_set_config", 00:18:07.935 "params": { 00:18:07.935 "discovery_filter": "match_any", 00:18:07.935 "admin_cmd_passthru": { 00:18:07.935 "identify_ctrlr": false 00:18:07.935 } 00:18:07.935 } 00:18:07.935 }, 00:18:07.935 { 00:18:07.935 "method": "nvmf_set_max_subsystems", 00:18:07.935 "params": { 00:18:07.935 "max_subsystems": 1024 00:18:07.935 } 00:18:07.935 }, 00:18:07.935 { 00:18:07.935 "method": "nvmf_set_crdt", 00:18:07.935 "params": { 00:18:07.935 "crdt1": 0, 00:18:07.935 "crdt2": 0, 00:18:07.935 "crdt3": 0 00:18:07.935 } 00:18:07.935 }, 00:18:07.935 { 00:18:07.935 "method": "nvmf_create_transport", 00:18:07.935 "params": { 00:18:07.935 "trtype": "TCP", 00:18:07.935 "max_queue_depth": 128, 00:18:07.935 "max_io_qpairs_per_ctrlr": 127, 00:18:07.935 "in_capsule_data_size": 4096, 00:18:07.935 "max_io_size": 131072, 00:18:07.935 "io_unit_size": 131072, 00:18:07.935 "max_aq_depth": 128, 00:18:07.935 "num_shared_buffers": 511, 00:18:07.935 "buf_cache_size": 4294967295, 00:18:07.935 "dif_insert_or_strip": false, 00:18:07.935 "zcopy": false, 00:18:07.935 "c2h_success": false, 00:18:07.935 "sock_priority": 0, 00:18:07.935 "abort_timeout_sec": 1 00:18:07.935 } 00:18:07.935 }, 00:18:07.935 { 00:18:07.935 "method": "nvmf_create_subsystem", 00:18:07.935 "params": { 00:18:07.935 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.935 "allow_any_host": false, 00:18:07.935 "serial_number": "SPDK00000000000001", 00:18:07.935 "model_number": "SPDK bdev Controller", 00:18:07.935 "max_namespaces": 10, 00:18:07.935 "min_cntlid": 1, 00:18:07.935 "max_cntlid": 65519, 00:18:07.935 "ana_reporting": false 00:18:07.935 } 00:18:07.935 }, 00:18:07.935 { 00:18:07.935 "method": "nvmf_subsystem_add_host", 00:18:07.935 "params": { 00:18:07.935 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.935 "host": "nqn.2016-06.io.spdk:host1", 00:18:07.935 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:07.935 } 00:18:07.935 }, 00:18:07.935 { 00:18:07.935 "method": "nvmf_subsystem_add_ns", 00:18:07.935 "params": { 00:18:07.935 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.935 "namespace": { 00:18:07.935 "nsid": 1, 00:18:07.935 "bdev_name": "malloc0", 00:18:07.935 "nguid": "D73A1A53857545E0BEA33F91ACA69AF8", 00:18:07.935 "uuid": "d73a1a53-8575-45e0-bea3-3f91aca69af8" 00:18:07.935 } 00:18:07.935 } 00:18:07.935 }, 00:18:07.935 { 00:18:07.935 "method": "nvmf_subsystem_add_listener", 00:18:07.935 "params": { 00:18:07.935 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.935 "listen_address": { 00:18:07.935 "trtype": "TCP", 00:18:07.935 "adrfam": "IPv4", 00:18:07.935 "traddr": "10.0.0.2", 00:18:07.935 "trsvcid": "4420" 00:18:07.935 }, 00:18:07.935 "secure_channel": true 00:18:07.935 } 00:18:07.935 } 00:18:07.935 ] 00:18:07.935 } 00:18:07.935 ] 00:18:07.935 }' 00:18:07.935 09:41:30 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:08.194 09:41:30 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:08.194 "subsystems": [ 00:18:08.194 { 00:18:08.194 "subsystem": "iobuf", 00:18:08.194 "config": [ 00:18:08.194 { 00:18:08.194 "method": "iobuf_set_options", 00:18:08.194 "params": { 00:18:08.194 "small_pool_count": 8192, 00:18:08.194 "large_pool_count": 1024, 00:18:08.194 "small_bufsize": 8192, 00:18:08.194 "large_bufsize": 135168 00:18:08.194 } 00:18:08.194 } 00:18:08.194 ] 00:18:08.194 }, 00:18:08.194 { 00:18:08.194 "subsystem": "sock", 00:18:08.194 "config": [ 00:18:08.194 { 00:18:08.194 "method": "sock_impl_set_options", 00:18:08.194 "params": { 00:18:08.194 "impl_name": "posix", 00:18:08.194 "recv_buf_size": 2097152, 00:18:08.194 "send_buf_size": 2097152, 00:18:08.194 "enable_recv_pipe": true, 00:18:08.194 "enable_quickack": false, 00:18:08.194 "enable_placement_id": 0, 00:18:08.194 "enable_zerocopy_send_server": true, 00:18:08.194 "enable_zerocopy_send_client": false, 00:18:08.194 "zerocopy_threshold": 0, 00:18:08.194 "tls_version": 0, 00:18:08.194 "enable_ktls": false 00:18:08.194 } 00:18:08.194 }, 00:18:08.194 { 00:18:08.194 "method": "sock_impl_set_options", 00:18:08.194 "params": { 00:18:08.194 "impl_name": "ssl", 00:18:08.194 "recv_buf_size": 4096, 00:18:08.194 "send_buf_size": 4096, 00:18:08.194 "enable_recv_pipe": true, 00:18:08.194 "enable_quickack": false, 00:18:08.194 "enable_placement_id": 0, 00:18:08.194 "enable_zerocopy_send_server": true, 00:18:08.194 "enable_zerocopy_send_client": false, 00:18:08.194 "zerocopy_threshold": 0, 00:18:08.194 "tls_version": 0, 00:18:08.194 "enable_ktls": false 00:18:08.194 } 00:18:08.194 } 00:18:08.194 ] 00:18:08.194 }, 00:18:08.194 { 00:18:08.194 "subsystem": "vmd", 00:18:08.194 "config": [] 00:18:08.194 }, 00:18:08.194 { 00:18:08.194 "subsystem": "accel", 00:18:08.194 "config": [ 00:18:08.194 { 00:18:08.194 "method": "accel_set_options", 00:18:08.194 "params": { 00:18:08.194 "small_cache_size": 128, 00:18:08.194 "large_cache_size": 16, 00:18:08.194 "task_count": 2048, 00:18:08.194 "sequence_count": 2048, 00:18:08.194 "buf_count": 2048 00:18:08.194 } 00:18:08.194 } 00:18:08.194 ] 00:18:08.194 }, 00:18:08.194 { 00:18:08.194 "subsystem": "bdev", 00:18:08.194 "config": [ 00:18:08.194 { 00:18:08.194 "method": "bdev_set_options", 00:18:08.194 "params": { 00:18:08.194 "bdev_io_pool_size": 65535, 00:18:08.194 "bdev_io_cache_size": 256, 00:18:08.194 "bdev_auto_examine": true, 00:18:08.194 "iobuf_small_cache_size": 128, 00:18:08.194 "iobuf_large_cache_size": 16 00:18:08.194 } 00:18:08.194 }, 00:18:08.194 { 00:18:08.194 "method": "bdev_raid_set_options", 00:18:08.194 "params": { 00:18:08.194 "process_window_size_kb": 1024 00:18:08.194 } 00:18:08.194 }, 00:18:08.194 { 00:18:08.194 "method": "bdev_iscsi_set_options", 00:18:08.194 "params": { 00:18:08.194 "timeout_sec": 30 00:18:08.194 } 00:18:08.194 }, 00:18:08.194 { 00:18:08.194 "method": "bdev_nvme_set_options", 00:18:08.194 "params": { 00:18:08.194 "action_on_timeout": "none", 00:18:08.194 "timeout_us": 0, 00:18:08.194 "timeout_admin_us": 0, 00:18:08.194 "keep_alive_timeout_ms": 10000, 00:18:08.194 "transport_retry_count": 4, 00:18:08.194 "arbitration_burst": 0, 00:18:08.194 "low_priority_weight": 0, 00:18:08.194 "medium_priority_weight": 0, 00:18:08.194 "high_priority_weight": 0, 00:18:08.194 "nvme_adminq_poll_period_us": 10000, 00:18:08.194 "nvme_ioq_poll_period_us": 0, 00:18:08.194 "io_queue_requests": 512, 00:18:08.194 "delay_cmd_submit": true, 00:18:08.194 "bdev_retry_count": 3, 00:18:08.194 "transport_ack_timeout": 0, 00:18:08.194 "ctrlr_loss_timeout_sec": 0, 00:18:08.195 "reconnect_delay_sec": 0, 00:18:08.195 "fast_io_fail_timeout_sec": 0, 00:18:08.195 "generate_uuids": false, 00:18:08.195 "transport_tos": 0, 00:18:08.195 "io_path_stat": false, 00:18:08.195 "allow_accel_sequence": false 00:18:08.195 } 00:18:08.195 }, 00:18:08.195 { 00:18:08.195 "method": "bdev_nvme_attach_controller", 00:18:08.195 "params": { 00:18:08.195 "name": "TLSTEST", 00:18:08.195 "trtype": "TCP", 00:18:08.195 "adrfam": "IPv4", 00:18:08.195 "traddr": "10.0.0.2", 00:18:08.195 "trsvcid": "4420", 00:18:08.195 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:08.195 "prchk_reftag": false, 00:18:08.195 "prchk_guard": false, 00:18:08.195 "ctrlr_loss_timeout_sec": 0, 00:18:08.195 "reconnect_delay_sec": 0, 00:18:08.195 "fast_io_fail_timeout_sec": 0, 00:18:08.195 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:08.195 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:08.195 "hdgst": false, 00:18:08.195 "ddgst": false 00:18:08.195 } 00:18:08.195 }, 00:18:08.195 { 00:18:08.195 "method": "bdev_nvme_set_hotplug", 00:18:08.195 "params": { 00:18:08.195 "period_us": 100000, 00:18:08.195 "enable": false 00:18:08.195 } 00:18:08.195 }, 00:18:08.195 { 00:18:08.195 "method": "bdev_wait_for_examine" 00:18:08.195 } 00:18:08.195 ] 00:18:08.195 }, 00:18:08.195 { 00:18:08.195 "subsystem": "nbd", 00:18:08.195 "config": [] 00:18:08.195 } 00:18:08.195 ] 00:18:08.195 }' 00:18:08.195 09:41:30 -- target/tls.sh@208 -- # killprocess 48388 00:18:08.195 09:41:30 -- common/autotest_common.sh@936 -- # '[' -z 48388 ']' 00:18:08.195 09:41:30 -- common/autotest_common.sh@940 -- # kill -0 48388 00:18:08.195 09:41:30 -- common/autotest_common.sh@941 -- # uname 00:18:08.195 09:41:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:08.195 09:41:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 48388 00:18:08.195 09:41:30 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:08.195 09:41:30 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:08.195 09:41:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 48388' 00:18:08.195 killing process with pid 48388 00:18:08.195 09:41:30 -- common/autotest_common.sh@955 -- # kill 48388 00:18:08.195 Received shutdown signal, test time was about 10.000000 seconds 00:18:08.195 00:18:08.195 Latency(us) 00:18:08.195 [2024-11-29T08:41:31.038Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:08.195 [2024-11-29T08:41:31.038Z] =================================================================================================================== 00:18:08.195 [2024-11-29T08:41:31.038Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:08.195 09:41:30 -- common/autotest_common.sh@960 -- # wait 48388 00:18:08.453 09:41:31 -- target/tls.sh@209 -- # killprocess 48036 00:18:08.453 09:41:31 -- common/autotest_common.sh@936 -- # '[' -z 48036 ']' 00:18:08.453 09:41:31 -- common/autotest_common.sh@940 -- # kill -0 48036 00:18:08.453 09:41:31 -- common/autotest_common.sh@941 -- # uname 00:18:08.453 09:41:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:08.453 09:41:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 48036 00:18:08.453 09:41:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:08.453 09:41:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:08.453 09:41:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 48036' 00:18:08.453 killing process with pid 48036 00:18:08.453 09:41:31 -- common/autotest_common.sh@955 -- # kill 48036 00:18:08.453 09:41:31 -- common/autotest_common.sh@960 -- # wait 48036 00:18:08.710 09:41:31 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:08.710 09:41:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:08.710 09:41:31 -- target/tls.sh@212 -- # echo '{ 00:18:08.710 "subsystems": [ 00:18:08.710 { 00:18:08.710 "subsystem": "iobuf", 00:18:08.710 "config": [ 00:18:08.710 { 00:18:08.710 "method": "iobuf_set_options", 00:18:08.710 "params": { 00:18:08.710 "small_pool_count": 8192, 00:18:08.710 "large_pool_count": 1024, 00:18:08.710 "small_bufsize": 8192, 00:18:08.710 "large_bufsize": 135168 00:18:08.711 } 00:18:08.711 } 00:18:08.711 ] 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "subsystem": "sock", 00:18:08.711 "config": [ 00:18:08.711 { 00:18:08.711 "method": "sock_impl_set_options", 00:18:08.711 "params": { 00:18:08.711 "impl_name": "posix", 00:18:08.711 "recv_buf_size": 2097152, 00:18:08.711 "send_buf_size": 2097152, 00:18:08.711 "enable_recv_pipe": true, 00:18:08.711 "enable_quickack": false, 00:18:08.711 "enable_placement_id": 0, 00:18:08.711 "enable_zerocopy_send_server": true, 00:18:08.711 "enable_zerocopy_send_client": false, 00:18:08.711 "zerocopy_threshold": 0, 00:18:08.711 "tls_version": 0, 00:18:08.711 "enable_ktls": false 00:18:08.711 } 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "method": "sock_impl_set_options", 00:18:08.711 "params": { 00:18:08.711 "impl_name": "ssl", 00:18:08.711 "recv_buf_size": 4096, 00:18:08.711 "send_buf_size": 4096, 00:18:08.711 "enable_recv_pipe": true, 00:18:08.711 "enable_quickack": false, 00:18:08.711 "enable_placement_id": 0, 00:18:08.711 "enable_zerocopy_send_server": true, 00:18:08.711 "enable_zerocopy_send_client": false, 00:18:08.711 "zerocopy_threshold": 0, 00:18:08.711 "tls_version": 0, 00:18:08.711 "enable_ktls": false 00:18:08.711 } 00:18:08.711 } 00:18:08.711 ] 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "subsystem": "vmd", 00:18:08.711 "config": [] 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "subsystem": "accel", 00:18:08.711 "config": [ 00:18:08.711 { 00:18:08.711 "method": "accel_set_options", 00:18:08.711 "params": { 00:18:08.711 "small_cache_size": 128, 00:18:08.711 "large_cache_size": 16, 00:18:08.711 "task_count": 2048, 00:18:08.711 "sequence_count": 2048, 00:18:08.711 "buf_count": 2048 00:18:08.711 } 00:18:08.711 } 00:18:08.711 ] 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "subsystem": "bdev", 00:18:08.711 "config": [ 00:18:08.711 { 00:18:08.711 "method": "bdev_set_options", 00:18:08.711 "params": { 00:18:08.711 "bdev_io_pool_size": 65535, 00:18:08.711 "bdev_io_cache_size": 256, 00:18:08.711 "bdev_auto_examine": true, 00:18:08.711 "iobuf_small_cache_size": 128, 00:18:08.711 "iobuf_large_cache_size": 16 00:18:08.711 } 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "method": "bdev_raid_set_options", 00:18:08.711 "params": { 00:18:08.711 "process_window_size_kb": 1024 00:18:08.711 } 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "method": "bdev_iscsi_set_options", 00:18:08.711 "params": { 00:18:08.711 "timeout_sec": 30 00:18:08.711 } 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "method": "bdev_nvme_set_options", 00:18:08.711 "params": { 00:18:08.711 "action_on_timeout": "none", 00:18:08.711 "timeout_us": 0, 00:18:08.711 "timeout_admin_us": 0, 00:18:08.711 "keep_alive_timeout_ms": 10000, 00:18:08.711 "transport_retry_count": 4, 00:18:08.711 "arbitration_burst": 0, 00:18:08.711 "low_priority_weight": 0, 00:18:08.711 "medium_priority_weight": 0, 00:18:08.711 "high_priority_weight": 0, 00:18:08.711 "nvme_adminq_poll_period_us": 10000, 00:18:08.711 "nvme_ioq_poll_period_us": 0, 00:18:08.711 "io_queue_requests": 0, 00:18:08.711 "delay_cmd_submit": true, 00:18:08.711 "bdev_retry_count": 3, 00:18:08.711 "transport_ack_timeout": 0, 00:18:08.711 "ctrlr_loss_timeout_sec": 0, 00:18:08.711 "reconnect_delay_sec": 0, 00:18:08.711 "fast_io_fail_timeout_sec": 0, 00:18:08.711 "generate_uuids": false, 00:18:08.711 "transport_tos": 0, 00:18:08.711 "io_path_stat": false, 00:18:08.711 "allow_accel_sequence": false 00:18:08.711 } 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "method": "bdev_nvme_set_hotplug", 00:18:08.711 "params": { 00:18:08.711 "period_us": 100000, 00:18:08.711 "enable": false 00:18:08.711 } 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "method": "bdev_malloc_create", 00:18:08.711 "params": { 00:18:08.711 "name": "malloc0", 00:18:08.711 "num_blocks": 8192, 00:18:08.711 "block_size": 4096, 00:18:08.711 "physical_block_size": 4096, 00:18:08.711 "uuid": "d73a1a53-8575-45e0-bea3-3f91aca69af8", 00:18:08.711 "optimal_io_boundary": 0 00:18:08.711 } 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "method": "bdev_wait_for_examine" 00:18:08.711 } 00:18:08.711 ] 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "subsystem": "nbd", 00:18:08.711 "config": [] 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "subsystem": "scheduler", 00:18:08.711 "config": [ 00:18:08.711 { 00:18:08.711 "method": "framework_set_scheduler", 00:18:08.711 "params": { 00:18:08.711 "name": "static" 00:18:08.711 } 00:18:08.711 } 00:18:08.711 ] 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "subsystem": "nvmf", 00:18:08.711 "config": [ 00:18:08.711 { 00:18:08.711 "method": "nvmf_set_config", 00:18:08.711 "params": { 00:18:08.711 "discovery_filter": "match_any", 00:18:08.711 "admin_cmd_passthru": { 00:18:08.711 "identify_ctrlr": false 00:18:08.711 } 00:18:08.711 } 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "method": "nvmf_set_max_subsystems", 00:18:08.711 "params": { 00:18:08.711 "max_subsystems": 1024 00:18:08.711 } 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "method": "nvmf_set_crdt", 00:18:08.711 "params": { 00:18:08.711 "crdt1": 0, 00:18:08.711 "crdt2": 0, 00:18:08.711 "crdt3": 0 00:18:08.711 } 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "method": "nvmf_create_transport", 00:18:08.711 "params": { 00:18:08.711 "trtype": "TCP", 00:18:08.711 "max_queue_depth": 128, 00:18:08.711 "max_io_qpairs_per_ctrlr": 127, 00:18:08.711 "in_capsule_data_size": 4096, 00:18:08.711 "max_io_size": 131072, 00:18:08.711 "io_unit_size": 131072, 00:18:08.711 "max_aq_depth": 128, 00:18:08.711 "num_shared_buffers": 511, 00:18:08.711 "buf_cache_size": 4294967295, 00:18:08.711 "dif_insert_or_strip": false, 00:18:08.711 "zcopy": false, 00:18:08.711 "c2h_success": false, 00:18:08.711 "sock_priority": 0, 00:18:08.711 "abort_timeout_sec": 1 00:18:08.711 } 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "method": "nvmf_create_subsystem", 00:18:08.711 "params": { 00:18:08.711 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:08.711 "allow_any_host": false, 00:18:08.711 "serial_number": "SPDK00000000000001", 00:18:08.711 "model_number": "SPDK bdev Controller", 00:18:08.711 "max_namespaces": 10, 00:18:08.711 "min_cntlid": 1, 00:18:08.711 "max_cntlid": 65519, 00:18:08.711 "ana_reporting": false 00:18:08.711 } 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "method": "nvmf_subsystem_add_host", 00:18:08.711 "params": { 00:18:08.711 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:08.711 "host": "nqn.2016-06.io.spdk:host1", 00:18:08.711 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:08.711 } 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "method": "nvmf_subsystem_add_ns", 00:18:08.711 "params": { 00:18:08.711 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:08.711 "namespace": { 00:18:08.711 "nsid": 1, 00:18:08.711 "bdev_name": "malloc0", 00:18:08.711 "nguid": "D73A1A53857545E0BEA33F91ACA69AF8", 00:18:08.711 "uuid": "d73a1a53-8575-45e0-bea3-3f91aca69af8" 00:18:08.711 } 00:18:08.711 } 00:18:08.711 }, 00:18:08.711 { 00:18:08.711 "method": "nvmf_subsystem_add_listener", 00:18:08.711 "params": { 00:18:08.711 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:08.711 "listen_address": { 00:18:08.711 "trtype": "TCP", 00:18:08.711 "adrfam": "IPv4", 00:18:08.711 "traddr": "10.0.0.2", 00:18:08.711 "trsvcid": "4420" 00:18:08.711 }, 00:18:08.711 "secure_channel": true 00:18:08.712 } 00:18:08.712 } 00:18:08.712 ] 00:18:08.712 } 00:18:08.712 ] 00:18:08.712 }' 00:18:08.712 09:41:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:08.712 09:41:31 -- common/autotest_common.sh@10 -- # set +x 00:18:08.712 09:41:31 -- nvmf/common.sh@469 -- # nvmfpid=48679 00:18:08.712 09:41:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:08.712 09:41:31 -- nvmf/common.sh@470 -- # waitforlisten 48679 00:18:08.712 09:41:31 -- common/autotest_common.sh@829 -- # '[' -z 48679 ']' 00:18:08.712 09:41:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:08.712 09:41:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:08.712 09:41:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:08.712 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:08.712 09:41:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:08.712 09:41:31 -- common/autotest_common.sh@10 -- # set +x 00:18:08.712 [2024-11-29 09:41:31.437012] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:08.712 [2024-11-29 09:41:31.437094] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:08.712 EAL: No free 2048 kB hugepages reported on node 1 00:18:08.712 [2024-11-29 09:41:31.505568] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:08.970 [2024-11-29 09:41:31.617325] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:08.970 [2024-11-29 09:41:31.617511] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:08.970 [2024-11-29 09:41:31.617534] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:08.970 [2024-11-29 09:41:31.617549] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:08.970 [2024-11-29 09:41:31.617587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:09.229 [2024-11-29 09:41:31.852086] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:09.229 [2024-11-29 09:41:31.884101] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:09.229 [2024-11-29 09:41:31.884370] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:09.796 09:41:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:09.796 09:41:32 -- common/autotest_common.sh@862 -- # return 0 00:18:09.796 09:41:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:09.796 09:41:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:09.796 09:41:32 -- common/autotest_common.sh@10 -- # set +x 00:18:09.796 09:41:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:09.796 09:41:32 -- target/tls.sh@216 -- # bdevperf_pid=48836 00:18:09.796 09:41:32 -- target/tls.sh@217 -- # waitforlisten 48836 /var/tmp/bdevperf.sock 00:18:09.796 09:41:32 -- common/autotest_common.sh@829 -- # '[' -z 48836 ']' 00:18:09.796 09:41:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:09.796 09:41:32 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:09.796 09:41:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:09.796 09:41:32 -- target/tls.sh@213 -- # echo '{ 00:18:09.796 "subsystems": [ 00:18:09.796 { 00:18:09.796 "subsystem": "iobuf", 00:18:09.796 "config": [ 00:18:09.796 { 00:18:09.796 "method": "iobuf_set_options", 00:18:09.796 "params": { 00:18:09.796 "small_pool_count": 8192, 00:18:09.796 "large_pool_count": 1024, 00:18:09.796 "small_bufsize": 8192, 00:18:09.796 "large_bufsize": 135168 00:18:09.796 } 00:18:09.796 } 00:18:09.796 ] 00:18:09.796 }, 00:18:09.796 { 00:18:09.796 "subsystem": "sock", 00:18:09.796 "config": [ 00:18:09.796 { 00:18:09.796 "method": "sock_impl_set_options", 00:18:09.796 "params": { 00:18:09.796 "impl_name": "posix", 00:18:09.796 "recv_buf_size": 2097152, 00:18:09.796 "send_buf_size": 2097152, 00:18:09.796 "enable_recv_pipe": true, 00:18:09.796 "enable_quickack": false, 00:18:09.796 "enable_placement_id": 0, 00:18:09.796 "enable_zerocopy_send_server": true, 00:18:09.796 "enable_zerocopy_send_client": false, 00:18:09.796 "zerocopy_threshold": 0, 00:18:09.796 "tls_version": 0, 00:18:09.796 "enable_ktls": false 00:18:09.796 } 00:18:09.796 }, 00:18:09.796 { 00:18:09.796 "method": "sock_impl_set_options", 00:18:09.796 "params": { 00:18:09.796 "impl_name": "ssl", 00:18:09.796 "recv_buf_size": 4096, 00:18:09.796 "send_buf_size": 4096, 00:18:09.796 "enable_recv_pipe": true, 00:18:09.796 "enable_quickack": false, 00:18:09.796 "enable_placement_id": 0, 00:18:09.796 "enable_zerocopy_send_server": true, 00:18:09.796 "enable_zerocopy_send_client": false, 00:18:09.796 "zerocopy_threshold": 0, 00:18:09.796 "tls_version": 0, 00:18:09.796 "enable_ktls": false 00:18:09.796 } 00:18:09.796 } 00:18:09.796 ] 00:18:09.796 }, 00:18:09.796 { 00:18:09.796 "subsystem": "vmd", 00:18:09.796 "config": [] 00:18:09.796 }, 00:18:09.796 { 00:18:09.796 "subsystem": "accel", 00:18:09.796 "config": [ 00:18:09.796 { 00:18:09.796 "method": "accel_set_options", 00:18:09.796 "params": { 00:18:09.796 "small_cache_size": 128, 00:18:09.796 "large_cache_size": 16, 00:18:09.796 "task_count": 2048, 00:18:09.796 "sequence_count": 2048, 00:18:09.796 "buf_count": 2048 00:18:09.796 } 00:18:09.796 } 00:18:09.796 ] 00:18:09.796 }, 00:18:09.796 { 00:18:09.796 "subsystem": "bdev", 00:18:09.796 "config": [ 00:18:09.796 { 00:18:09.796 "method": "bdev_set_options", 00:18:09.796 "params": { 00:18:09.796 "bdev_io_pool_size": 65535, 00:18:09.796 "bdev_io_cache_size": 256, 00:18:09.796 "bdev_auto_examine": true, 00:18:09.796 "iobuf_small_cache_size": 128, 00:18:09.796 "iobuf_large_cache_size": 16 00:18:09.796 } 00:18:09.796 }, 00:18:09.796 { 00:18:09.796 "method": "bdev_raid_set_options", 00:18:09.796 "params": { 00:18:09.796 "process_window_size_kb": 1024 00:18:09.796 } 00:18:09.796 }, 00:18:09.796 { 00:18:09.796 "method": "bdev_iscsi_set_options", 00:18:09.796 "params": { 00:18:09.796 "timeout_sec": 30 00:18:09.796 } 00:18:09.796 }, 00:18:09.797 { 00:18:09.797 "method": "bdev_nvme_set_options", 00:18:09.797 "params": { 00:18:09.797 "action_on_timeout": "none", 00:18:09.797 "timeout_us": 0, 00:18:09.797 "timeout_admin_us": 0, 00:18:09.797 "keep_alive_timeout_ms": 10000, 00:18:09.797 "transport_retry_count": 4, 00:18:09.797 "arbitration_burst": 0, 00:18:09.797 "low_priority_weight": 0, 00:18:09.797 "medium_priority_weight": 0, 00:18:09.797 "high_priority_weight": 0, 00:18:09.797 "nvme_adminq_poll_period_us": 10000, 00:18:09.797 "nvme_ioq_poll_period_us": 0, 00:18:09.797 "io_queue_requests": 512, 00:18:09.797 "delay_cmd_submit": true, 00:18:09.797 "bdev_retry_count": 3, 00:18:09.797 "transport_ack_timeout": 0, 00:18:09.797 "ctrlr_loss_timeout_sec": 0, 00:18:09.797 "reconnect_delay_sec": 0, 00:18:09.797 "fast_io_fail_timeout_sec": 0, 00:18:09.797 "generate_uuids": false, 00:18:09.797 "transport_tos": 0, 00:18:09.797 "io_path_stat": false, 00:18:09.797 "allow_accel_sequence": false 00:18:09.797 } 00:18:09.797 }, 00:18:09.797 { 00:18:09.797 "method": "bdev_nvme_attach_controller", 00:18:09.797 "params": { 00:18:09.797 "name": "TLSTEST", 00:18:09.797 "trtype": "TCP", 00:18:09.797 "adrfam": "IPv4", 00:18:09.797 "traddr": "10.0.0.2", 00:18:09.797 "trsvcid": "4420", 00:18:09.797 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:09.797 "prchk_reftag": false, 00:18:09.797 "prchk_guard": false, 00:18:09.797 "ctrlr_loss_timeout_sec": 0, 00:18:09.797 "reconnect_delay_sec": 0, 00:18:09.797 "fast_io_fail_timeout_sec": 0, 00:18:09.797 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:09.797 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:09.797 "hdgst": false, 00:18:09.797 "ddgst": false 00:18:09.797 } 00:18:09.797 }, 00:18:09.797 { 00:18:09.797 "method": "bdev_nvme_set_hotplug", 00:18:09.797 "params": { 00:18:09.797 "period_us": 100000, 00:18:09.797 "enable": false 00:18:09.797 } 00:18:09.797 }, 00:18:09.797 { 00:18:09.797 "method": "bdev_wait_for_examine" 00:18:09.797 } 00:18:09.797 ] 00:18:09.797 }, 00:18:09.797 { 00:18:09.797 "subsystem": "nbd", 00:18:09.797 "config": [] 00:18:09.797 } 00:18:09.797 ] 00:18:09.797 }' 00:18:09.797 09:41:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:09.797 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:09.797 09:41:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:09.797 09:41:32 -- common/autotest_common.sh@10 -- # set +x 00:18:09.797 [2024-11-29 09:41:32.493017] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:09.797 [2024-11-29 09:41:32.493101] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid48836 ] 00:18:09.797 EAL: No free 2048 kB hugepages reported on node 1 00:18:09.797 [2024-11-29 09:41:32.552116] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:10.056 [2024-11-29 09:41:32.660218] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:10.056 [2024-11-29 09:41:32.826258] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:10.995 09:41:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:10.995 09:41:33 -- common/autotest_common.sh@862 -- # return 0 00:18:10.995 09:41:33 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:10.995 Running I/O for 10 seconds... 00:18:20.973 00:18:20.973 Latency(us) 00:18:20.973 [2024-11-29T08:41:43.816Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:20.973 [2024-11-29T08:41:43.816Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:20.973 Verification LBA range: start 0x0 length 0x2000 00:18:20.973 TLSTESTn1 : 10.01 3974.09 15.52 0.00 0.00 32172.89 4854.52 71846.87 00:18:20.973 [2024-11-29T08:41:43.816Z] =================================================================================================================== 00:18:20.973 [2024-11-29T08:41:43.816Z] Total : 3974.09 15.52 0.00 0.00 32172.89 4854.52 71846.87 00:18:20.973 0 00:18:20.973 09:41:43 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:20.973 09:41:43 -- target/tls.sh@223 -- # killprocess 48836 00:18:20.973 09:41:43 -- common/autotest_common.sh@936 -- # '[' -z 48836 ']' 00:18:20.973 09:41:43 -- common/autotest_common.sh@940 -- # kill -0 48836 00:18:20.973 09:41:43 -- common/autotest_common.sh@941 -- # uname 00:18:20.973 09:41:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:20.973 09:41:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 48836 00:18:20.973 09:41:43 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:20.973 09:41:43 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:20.973 09:41:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 48836' 00:18:20.973 killing process with pid 48836 00:18:20.973 09:41:43 -- common/autotest_common.sh@955 -- # kill 48836 00:18:20.973 Received shutdown signal, test time was about 10.000000 seconds 00:18:20.973 00:18:20.973 Latency(us) 00:18:20.973 [2024-11-29T08:41:43.816Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:20.973 [2024-11-29T08:41:43.816Z] =================================================================================================================== 00:18:20.973 [2024-11-29T08:41:43.816Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:20.973 09:41:43 -- common/autotest_common.sh@960 -- # wait 48836 00:18:21.233 09:41:43 -- target/tls.sh@224 -- # killprocess 48679 00:18:21.233 09:41:43 -- common/autotest_common.sh@936 -- # '[' -z 48679 ']' 00:18:21.233 09:41:43 -- common/autotest_common.sh@940 -- # kill -0 48679 00:18:21.233 09:41:43 -- common/autotest_common.sh@941 -- # uname 00:18:21.233 09:41:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:21.233 09:41:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 48679 00:18:21.233 09:41:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:21.233 09:41:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:21.233 09:41:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 48679' 00:18:21.233 killing process with pid 48679 00:18:21.233 09:41:43 -- common/autotest_common.sh@955 -- # kill 48679 00:18:21.233 09:41:43 -- common/autotest_common.sh@960 -- # wait 48679 00:18:21.493 09:41:44 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:21.493 09:41:44 -- target/tls.sh@227 -- # cleanup 00:18:21.493 09:41:44 -- target/tls.sh@15 -- # process_shm --id 0 00:18:21.493 09:41:44 -- common/autotest_common.sh@806 -- # type=--id 00:18:21.493 09:41:44 -- common/autotest_common.sh@807 -- # id=0 00:18:21.493 09:41:44 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:21.493 09:41:44 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:21.493 09:41:44 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:21.493 09:41:44 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:21.493 09:41:44 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:21.493 09:41:44 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:21.493 nvmf_trace.0 00:18:21.493 09:41:44 -- common/autotest_common.sh@821 -- # return 0 00:18:21.493 09:41:44 -- target/tls.sh@16 -- # killprocess 48836 00:18:21.493 09:41:44 -- common/autotest_common.sh@936 -- # '[' -z 48836 ']' 00:18:21.493 09:41:44 -- common/autotest_common.sh@940 -- # kill -0 48836 00:18:21.493 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (48836) - No such process 00:18:21.493 09:41:44 -- common/autotest_common.sh@963 -- # echo 'Process with pid 48836 is not found' 00:18:21.493 Process with pid 48836 is not found 00:18:21.493 09:41:44 -- target/tls.sh@17 -- # nvmftestfini 00:18:21.493 09:41:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:21.493 09:41:44 -- nvmf/common.sh@116 -- # sync 00:18:21.493 09:41:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:21.493 09:41:44 -- nvmf/common.sh@119 -- # set +e 00:18:21.493 09:41:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:21.493 09:41:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:21.493 rmmod nvme_tcp 00:18:21.753 rmmod nvme_fabrics 00:18:21.753 rmmod nvme_keyring 00:18:21.753 09:41:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:21.753 09:41:44 -- nvmf/common.sh@123 -- # set -e 00:18:21.753 09:41:44 -- nvmf/common.sh@124 -- # return 0 00:18:21.753 09:41:44 -- nvmf/common.sh@477 -- # '[' -n 48679 ']' 00:18:21.753 09:41:44 -- nvmf/common.sh@478 -- # killprocess 48679 00:18:21.753 09:41:44 -- common/autotest_common.sh@936 -- # '[' -z 48679 ']' 00:18:21.753 09:41:44 -- common/autotest_common.sh@940 -- # kill -0 48679 00:18:21.753 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (48679) - No such process 00:18:21.753 09:41:44 -- common/autotest_common.sh@963 -- # echo 'Process with pid 48679 is not found' 00:18:21.753 Process with pid 48679 is not found 00:18:21.753 09:41:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:21.753 09:41:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:21.753 09:41:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:21.753 09:41:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:21.753 09:41:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:21.753 09:41:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:21.753 09:41:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:21.753 09:41:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.659 09:41:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:23.659 09:41:46 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:23.659 00:18:23.659 real 1m15.929s 00:18:23.659 user 2m4.024s 00:18:23.659 sys 0m23.086s 00:18:23.659 09:41:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:23.659 09:41:46 -- common/autotest_common.sh@10 -- # set +x 00:18:23.659 ************************************ 00:18:23.659 END TEST nvmf_tls 00:18:23.659 ************************************ 00:18:23.659 09:41:46 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:23.659 09:41:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:23.659 09:41:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:23.659 09:41:46 -- common/autotest_common.sh@10 -- # set +x 00:18:23.659 ************************************ 00:18:23.659 START TEST nvmf_fips 00:18:23.659 ************************************ 00:18:23.659 09:41:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:23.659 * Looking for test storage... 00:18:23.659 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:23.659 09:41:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:23.918 09:41:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:23.918 09:41:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:23.918 09:41:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:23.918 09:41:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:23.918 09:41:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:23.918 09:41:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:23.918 09:41:46 -- scripts/common.sh@335 -- # IFS=.-: 00:18:23.918 09:41:46 -- scripts/common.sh@335 -- # read -ra ver1 00:18:23.918 09:41:46 -- scripts/common.sh@336 -- # IFS=.-: 00:18:23.918 09:41:46 -- scripts/common.sh@336 -- # read -ra ver2 00:18:23.918 09:41:46 -- scripts/common.sh@337 -- # local 'op=<' 00:18:23.918 09:41:46 -- scripts/common.sh@339 -- # ver1_l=2 00:18:23.918 09:41:46 -- scripts/common.sh@340 -- # ver2_l=1 00:18:23.918 09:41:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:23.918 09:41:46 -- scripts/common.sh@343 -- # case "$op" in 00:18:23.918 09:41:46 -- scripts/common.sh@344 -- # : 1 00:18:23.918 09:41:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:23.918 09:41:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:23.918 09:41:46 -- scripts/common.sh@364 -- # decimal 1 00:18:23.918 09:41:46 -- scripts/common.sh@352 -- # local d=1 00:18:23.918 09:41:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:23.918 09:41:46 -- scripts/common.sh@354 -- # echo 1 00:18:23.918 09:41:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:23.918 09:41:46 -- scripts/common.sh@365 -- # decimal 2 00:18:23.918 09:41:46 -- scripts/common.sh@352 -- # local d=2 00:18:23.918 09:41:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:23.918 09:41:46 -- scripts/common.sh@354 -- # echo 2 00:18:23.918 09:41:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:23.918 09:41:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:23.918 09:41:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:23.918 09:41:46 -- scripts/common.sh@367 -- # return 0 00:18:23.918 09:41:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:23.918 09:41:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:23.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.918 --rc genhtml_branch_coverage=1 00:18:23.918 --rc genhtml_function_coverage=1 00:18:23.918 --rc genhtml_legend=1 00:18:23.918 --rc geninfo_all_blocks=1 00:18:23.918 --rc geninfo_unexecuted_blocks=1 00:18:23.918 00:18:23.918 ' 00:18:23.918 09:41:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:23.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.918 --rc genhtml_branch_coverage=1 00:18:23.918 --rc genhtml_function_coverage=1 00:18:23.918 --rc genhtml_legend=1 00:18:23.918 --rc geninfo_all_blocks=1 00:18:23.918 --rc geninfo_unexecuted_blocks=1 00:18:23.918 00:18:23.918 ' 00:18:23.918 09:41:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:23.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.918 --rc genhtml_branch_coverage=1 00:18:23.918 --rc genhtml_function_coverage=1 00:18:23.918 --rc genhtml_legend=1 00:18:23.918 --rc geninfo_all_blocks=1 00:18:23.918 --rc geninfo_unexecuted_blocks=1 00:18:23.918 00:18:23.918 ' 00:18:23.918 09:41:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:23.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.918 --rc genhtml_branch_coverage=1 00:18:23.918 --rc genhtml_function_coverage=1 00:18:23.918 --rc genhtml_legend=1 00:18:23.918 --rc geninfo_all_blocks=1 00:18:23.918 --rc geninfo_unexecuted_blocks=1 00:18:23.918 00:18:23.918 ' 00:18:23.918 09:41:46 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:23.918 09:41:46 -- nvmf/common.sh@7 -- # uname -s 00:18:23.918 09:41:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:23.918 09:41:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:23.918 09:41:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:23.918 09:41:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:23.918 09:41:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:23.918 09:41:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:23.918 09:41:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:23.918 09:41:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:23.918 09:41:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:23.918 09:41:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:23.918 09:41:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:23.918 09:41:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:23.918 09:41:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:23.918 09:41:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:23.918 09:41:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:23.918 09:41:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:23.918 09:41:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:23.918 09:41:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:23.918 09:41:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:23.918 09:41:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.918 09:41:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.918 09:41:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.918 09:41:46 -- paths/export.sh@5 -- # export PATH 00:18:23.918 09:41:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.918 09:41:46 -- nvmf/common.sh@46 -- # : 0 00:18:23.918 09:41:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:23.918 09:41:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:23.918 09:41:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:23.918 09:41:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:23.918 09:41:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:23.918 09:41:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:23.918 09:41:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:23.918 09:41:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:23.918 09:41:46 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:23.918 09:41:46 -- fips/fips.sh@89 -- # check_openssl_version 00:18:23.918 09:41:46 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:23.918 09:41:46 -- fips/fips.sh@85 -- # openssl version 00:18:23.918 09:41:46 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:23.918 09:41:46 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:23.918 09:41:46 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:23.918 09:41:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:23.918 09:41:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:23.918 09:41:46 -- scripts/common.sh@335 -- # IFS=.-: 00:18:23.918 09:41:46 -- scripts/common.sh@335 -- # read -ra ver1 00:18:23.919 09:41:46 -- scripts/common.sh@336 -- # IFS=.-: 00:18:23.919 09:41:46 -- scripts/common.sh@336 -- # read -ra ver2 00:18:23.919 09:41:46 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:23.919 09:41:46 -- scripts/common.sh@339 -- # ver1_l=3 00:18:23.919 09:41:46 -- scripts/common.sh@340 -- # ver2_l=3 00:18:23.919 09:41:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:23.919 09:41:46 -- scripts/common.sh@343 -- # case "$op" in 00:18:23.919 09:41:46 -- scripts/common.sh@347 -- # : 1 00:18:23.919 09:41:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:23.919 09:41:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:23.919 09:41:46 -- scripts/common.sh@364 -- # decimal 3 00:18:23.919 09:41:46 -- scripts/common.sh@352 -- # local d=3 00:18:23.919 09:41:46 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:23.919 09:41:46 -- scripts/common.sh@354 -- # echo 3 00:18:23.919 09:41:46 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:23.919 09:41:46 -- scripts/common.sh@365 -- # decimal 3 00:18:23.919 09:41:46 -- scripts/common.sh@352 -- # local d=3 00:18:23.919 09:41:46 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:23.919 09:41:46 -- scripts/common.sh@354 -- # echo 3 00:18:23.919 09:41:46 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:23.919 09:41:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:23.919 09:41:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:23.919 09:41:46 -- scripts/common.sh@363 -- # (( v++ )) 00:18:23.919 09:41:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:23.919 09:41:46 -- scripts/common.sh@364 -- # decimal 1 00:18:23.919 09:41:46 -- scripts/common.sh@352 -- # local d=1 00:18:23.919 09:41:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:23.919 09:41:46 -- scripts/common.sh@354 -- # echo 1 00:18:23.919 09:41:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:23.919 09:41:46 -- scripts/common.sh@365 -- # decimal 0 00:18:23.919 09:41:46 -- scripts/common.sh@352 -- # local d=0 00:18:23.919 09:41:46 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:23.919 09:41:46 -- scripts/common.sh@354 -- # echo 0 00:18:23.919 09:41:46 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:23.919 09:41:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:23.919 09:41:46 -- scripts/common.sh@366 -- # return 0 00:18:23.919 09:41:46 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:23.919 09:41:46 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:23.919 09:41:46 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:23.919 09:41:46 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:23.919 09:41:46 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:23.919 09:41:46 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:23.919 09:41:46 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:23.919 09:41:46 -- fips/fips.sh@113 -- # build_openssl_config 00:18:23.919 09:41:46 -- fips/fips.sh@37 -- # cat 00:18:23.919 09:41:46 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:23.919 09:41:46 -- fips/fips.sh@58 -- # cat - 00:18:23.919 09:41:46 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:23.919 09:41:46 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:23.919 09:41:46 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:23.919 09:41:46 -- fips/fips.sh@116 -- # openssl list -providers 00:18:23.919 09:41:46 -- fips/fips.sh@116 -- # grep name 00:18:23.919 09:41:46 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:23.919 09:41:46 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:23.919 09:41:46 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:23.919 09:41:46 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:23.919 09:41:46 -- fips/fips.sh@127 -- # : 00:18:23.919 09:41:46 -- common/autotest_common.sh@650 -- # local es=0 00:18:23.919 09:41:46 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:23.919 09:41:46 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:23.919 09:41:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:23.919 09:41:46 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:23.919 09:41:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:23.919 09:41:46 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:23.919 09:41:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:23.919 09:41:46 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:23.919 09:41:46 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:23.919 09:41:46 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:23.919 Error setting digest 00:18:23.919 4082CD0D187F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:23.919 4082CD0D187F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:23.919 09:41:46 -- common/autotest_common.sh@653 -- # es=1 00:18:23.919 09:41:46 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:23.919 09:41:46 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:23.919 09:41:46 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:23.919 09:41:46 -- fips/fips.sh@130 -- # nvmftestinit 00:18:23.919 09:41:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:23.919 09:41:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:23.919 09:41:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:23.919 09:41:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:23.919 09:41:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:23.919 09:41:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:23.919 09:41:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:23.919 09:41:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.919 09:41:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:23.919 09:41:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:23.919 09:41:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:23.919 09:41:46 -- common/autotest_common.sh@10 -- # set +x 00:18:25.822 09:41:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:25.822 09:41:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:25.822 09:41:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:25.822 09:41:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:25.822 09:41:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:25.822 09:41:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:25.822 09:41:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:25.822 09:41:48 -- nvmf/common.sh@294 -- # net_devs=() 00:18:25.822 09:41:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:25.822 09:41:48 -- nvmf/common.sh@295 -- # e810=() 00:18:25.822 09:41:48 -- nvmf/common.sh@295 -- # local -ga e810 00:18:25.822 09:41:48 -- nvmf/common.sh@296 -- # x722=() 00:18:25.822 09:41:48 -- nvmf/common.sh@296 -- # local -ga x722 00:18:25.822 09:41:48 -- nvmf/common.sh@297 -- # mlx=() 00:18:25.822 09:41:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:25.822 09:41:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:25.822 09:41:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:25.822 09:41:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:25.822 09:41:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:25.822 09:41:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:25.822 09:41:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:25.822 09:41:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:25.822 09:41:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:25.822 09:41:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:25.822 09:41:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:25.822 09:41:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:25.822 09:41:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:25.822 09:41:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:25.822 09:41:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:25.822 09:41:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:25.822 09:41:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:25.822 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:25.822 09:41:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:25.822 09:41:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:25.822 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:25.822 09:41:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:25.822 09:41:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:25.822 09:41:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:25.822 09:41:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:25.822 09:41:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:25.822 09:41:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:25.822 09:41:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:25.822 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:25.822 09:41:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:25.822 09:41:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:25.822 09:41:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:25.822 09:41:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:25.823 09:41:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:25.823 09:41:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:25.823 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:25.823 09:41:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:25.823 09:41:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:25.823 09:41:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:25.823 09:41:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:25.823 09:41:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:25.823 09:41:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:25.823 09:41:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:25.823 09:41:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:25.823 09:41:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:25.823 09:41:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:25.823 09:41:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:25.823 09:41:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:25.823 09:41:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:25.823 09:41:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:25.823 09:41:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:25.823 09:41:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:25.823 09:41:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:25.823 09:41:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:25.823 09:41:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:26.081 09:41:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:26.081 09:41:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:26.081 09:41:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:26.081 09:41:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:26.081 09:41:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:26.081 09:41:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:26.081 09:41:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:26.081 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:26.081 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.190 ms 00:18:26.081 00:18:26.081 --- 10.0.0.2 ping statistics --- 00:18:26.081 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:26.081 rtt min/avg/max/mdev = 0.190/0.190/0.190/0.000 ms 00:18:26.081 09:41:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:26.081 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:26.081 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:18:26.081 00:18:26.081 --- 10.0.0.1 ping statistics --- 00:18:26.081 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:26.081 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:18:26.081 09:41:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:26.081 09:41:48 -- nvmf/common.sh@410 -- # return 0 00:18:26.081 09:41:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:26.081 09:41:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:26.081 09:41:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:26.081 09:41:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:26.081 09:41:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:26.081 09:41:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:26.081 09:41:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:26.081 09:41:48 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:26.081 09:41:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:26.081 09:41:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:26.081 09:41:48 -- common/autotest_common.sh@10 -- # set +x 00:18:26.081 09:41:48 -- nvmf/common.sh@469 -- # nvmfpid=52191 00:18:26.081 09:41:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:26.081 09:41:48 -- nvmf/common.sh@470 -- # waitforlisten 52191 00:18:26.081 09:41:48 -- common/autotest_common.sh@829 -- # '[' -z 52191 ']' 00:18:26.081 09:41:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:26.081 09:41:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:26.081 09:41:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:26.081 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:26.081 09:41:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:26.081 09:41:48 -- common/autotest_common.sh@10 -- # set +x 00:18:26.081 [2024-11-29 09:41:48.870889] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:26.081 [2024-11-29 09:41:48.870966] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:26.081 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.340 [2024-11-29 09:41:48.942221] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:26.340 [2024-11-29 09:41:49.055709] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:26.340 [2024-11-29 09:41:49.055896] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:26.340 [2024-11-29 09:41:49.055916] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:26.340 [2024-11-29 09:41:49.055933] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:26.340 [2024-11-29 09:41:49.055973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:27.277 09:41:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:27.277 09:41:49 -- common/autotest_common.sh@862 -- # return 0 00:18:27.277 09:41:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:27.277 09:41:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:27.277 09:41:49 -- common/autotest_common.sh@10 -- # set +x 00:18:27.277 09:41:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:27.277 09:41:49 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:27.277 09:41:49 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:27.277 09:41:49 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:27.277 09:41:49 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:27.277 09:41:49 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:27.277 09:41:49 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:27.277 09:41:49 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:27.277 09:41:49 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:27.536 [2024-11-29 09:41:50.149323] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:27.536 [2024-11-29 09:41:50.165331] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:27.536 [2024-11-29 09:41:50.165589] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:27.536 malloc0 00:18:27.536 09:41:50 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:27.536 09:41:50 -- fips/fips.sh@147 -- # bdevperf_pid=52472 00:18:27.536 09:41:50 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:27.536 09:41:50 -- fips/fips.sh@148 -- # waitforlisten 52472 /var/tmp/bdevperf.sock 00:18:27.536 09:41:50 -- common/autotest_common.sh@829 -- # '[' -z 52472 ']' 00:18:27.536 09:41:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:27.536 09:41:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:27.536 09:41:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:27.536 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:27.536 09:41:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:27.536 09:41:50 -- common/autotest_common.sh@10 -- # set +x 00:18:27.536 [2024-11-29 09:41:50.284269] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:27.536 [2024-11-29 09:41:50.284359] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid52472 ] 00:18:27.536 EAL: No free 2048 kB hugepages reported on node 1 00:18:27.536 [2024-11-29 09:41:50.346667] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:27.796 [2024-11-29 09:41:50.452489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:28.734 09:41:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:28.734 09:41:51 -- common/autotest_common.sh@862 -- # return 0 00:18:28.734 09:41:51 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:28.734 [2024-11-29 09:41:51.524002] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:28.994 TLSTESTn1 00:18:28.994 09:41:51 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:28.994 Running I/O for 10 seconds... 00:18:38.980 00:18:38.980 Latency(us) 00:18:38.980 [2024-11-29T08:42:01.823Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:38.980 [2024-11-29T08:42:01.823Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:38.980 Verification LBA range: start 0x0 length 0x2000 00:18:38.980 TLSTESTn1 : 10.02 3968.41 15.50 0.00 0.00 32212.77 5194.33 40777.96 00:18:38.980 [2024-11-29T08:42:01.823Z] =================================================================================================================== 00:18:38.980 [2024-11-29T08:42:01.823Z] Total : 3968.41 15.50 0.00 0.00 32212.77 5194.33 40777.96 00:18:38.980 0 00:18:38.980 09:42:01 -- fips/fips.sh@1 -- # cleanup 00:18:38.980 09:42:01 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:38.980 09:42:01 -- common/autotest_common.sh@806 -- # type=--id 00:18:38.980 09:42:01 -- common/autotest_common.sh@807 -- # id=0 00:18:38.980 09:42:01 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:38.980 09:42:01 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:38.980 09:42:01 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:38.980 09:42:01 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:38.980 09:42:01 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:38.980 09:42:01 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:38.980 nvmf_trace.0 00:18:39.240 09:42:01 -- common/autotest_common.sh@821 -- # return 0 00:18:39.240 09:42:01 -- fips/fips.sh@16 -- # killprocess 52472 00:18:39.240 09:42:01 -- common/autotest_common.sh@936 -- # '[' -z 52472 ']' 00:18:39.240 09:42:01 -- common/autotest_common.sh@940 -- # kill -0 52472 00:18:39.240 09:42:01 -- common/autotest_common.sh@941 -- # uname 00:18:39.240 09:42:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:39.240 09:42:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 52472 00:18:39.240 09:42:01 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:39.240 09:42:01 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:39.240 09:42:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 52472' 00:18:39.240 killing process with pid 52472 00:18:39.240 09:42:01 -- common/autotest_common.sh@955 -- # kill 52472 00:18:39.240 Received shutdown signal, test time was about 10.000000 seconds 00:18:39.240 00:18:39.240 Latency(us) 00:18:39.240 [2024-11-29T08:42:02.083Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:39.240 [2024-11-29T08:42:02.083Z] =================================================================================================================== 00:18:39.240 [2024-11-29T08:42:02.083Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:39.240 09:42:01 -- common/autotest_common.sh@960 -- # wait 52472 00:18:39.501 09:42:02 -- fips/fips.sh@17 -- # nvmftestfini 00:18:39.501 09:42:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:39.501 09:42:02 -- nvmf/common.sh@116 -- # sync 00:18:39.501 09:42:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:39.501 09:42:02 -- nvmf/common.sh@119 -- # set +e 00:18:39.501 09:42:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:39.501 09:42:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:39.501 rmmod nvme_tcp 00:18:39.501 rmmod nvme_fabrics 00:18:39.501 rmmod nvme_keyring 00:18:39.501 09:42:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:39.501 09:42:02 -- nvmf/common.sh@123 -- # set -e 00:18:39.501 09:42:02 -- nvmf/common.sh@124 -- # return 0 00:18:39.501 09:42:02 -- nvmf/common.sh@477 -- # '[' -n 52191 ']' 00:18:39.501 09:42:02 -- nvmf/common.sh@478 -- # killprocess 52191 00:18:39.501 09:42:02 -- common/autotest_common.sh@936 -- # '[' -z 52191 ']' 00:18:39.501 09:42:02 -- common/autotest_common.sh@940 -- # kill -0 52191 00:18:39.501 09:42:02 -- common/autotest_common.sh@941 -- # uname 00:18:39.501 09:42:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:39.501 09:42:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 52191 00:18:39.501 09:42:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:39.501 09:42:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:39.501 09:42:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 52191' 00:18:39.501 killing process with pid 52191 00:18:39.501 09:42:02 -- common/autotest_common.sh@955 -- # kill 52191 00:18:39.501 09:42:02 -- common/autotest_common.sh@960 -- # wait 52191 00:18:39.761 09:42:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:39.761 09:42:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:39.761 09:42:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:39.761 09:42:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:39.761 09:42:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:39.761 09:42:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:39.762 09:42:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:39.762 09:42:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:41.727 09:42:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:41.986 09:42:04 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:41.986 00:18:41.986 real 0m18.123s 00:18:41.986 user 0m20.874s 00:18:41.986 sys 0m6.810s 00:18:41.986 09:42:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:41.986 09:42:04 -- common/autotest_common.sh@10 -- # set +x 00:18:41.986 ************************************ 00:18:41.986 END TEST nvmf_fips 00:18:41.986 ************************************ 00:18:41.986 09:42:04 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:41.986 09:42:04 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:41.986 09:42:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:41.986 09:42:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:41.986 09:42:04 -- common/autotest_common.sh@10 -- # set +x 00:18:41.986 ************************************ 00:18:41.986 START TEST nvmf_fuzz 00:18:41.986 ************************************ 00:18:41.986 09:42:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:41.986 * Looking for test storage... 00:18:41.986 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:41.986 09:42:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:41.986 09:42:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:41.986 09:42:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:41.986 09:42:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:41.986 09:42:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:41.986 09:42:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:41.986 09:42:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:41.986 09:42:04 -- scripts/common.sh@335 -- # IFS=.-: 00:18:41.986 09:42:04 -- scripts/common.sh@335 -- # read -ra ver1 00:18:41.986 09:42:04 -- scripts/common.sh@336 -- # IFS=.-: 00:18:41.986 09:42:04 -- scripts/common.sh@336 -- # read -ra ver2 00:18:41.986 09:42:04 -- scripts/common.sh@337 -- # local 'op=<' 00:18:41.986 09:42:04 -- scripts/common.sh@339 -- # ver1_l=2 00:18:41.986 09:42:04 -- scripts/common.sh@340 -- # ver2_l=1 00:18:41.986 09:42:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:41.986 09:42:04 -- scripts/common.sh@343 -- # case "$op" in 00:18:41.986 09:42:04 -- scripts/common.sh@344 -- # : 1 00:18:41.986 09:42:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:41.986 09:42:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:41.986 09:42:04 -- scripts/common.sh@364 -- # decimal 1 00:18:41.986 09:42:04 -- scripts/common.sh@352 -- # local d=1 00:18:41.986 09:42:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:41.986 09:42:04 -- scripts/common.sh@354 -- # echo 1 00:18:41.986 09:42:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:41.986 09:42:04 -- scripts/common.sh@365 -- # decimal 2 00:18:41.986 09:42:04 -- scripts/common.sh@352 -- # local d=2 00:18:41.986 09:42:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:41.986 09:42:04 -- scripts/common.sh@354 -- # echo 2 00:18:41.986 09:42:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:41.986 09:42:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:41.986 09:42:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:41.986 09:42:04 -- scripts/common.sh@367 -- # return 0 00:18:41.986 09:42:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:41.986 09:42:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:41.986 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.986 --rc genhtml_branch_coverage=1 00:18:41.986 --rc genhtml_function_coverage=1 00:18:41.986 --rc genhtml_legend=1 00:18:41.986 --rc geninfo_all_blocks=1 00:18:41.986 --rc geninfo_unexecuted_blocks=1 00:18:41.986 00:18:41.986 ' 00:18:41.986 09:42:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:41.986 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.986 --rc genhtml_branch_coverage=1 00:18:41.986 --rc genhtml_function_coverage=1 00:18:41.986 --rc genhtml_legend=1 00:18:41.986 --rc geninfo_all_blocks=1 00:18:41.986 --rc geninfo_unexecuted_blocks=1 00:18:41.986 00:18:41.986 ' 00:18:41.986 09:42:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:41.986 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.986 --rc genhtml_branch_coverage=1 00:18:41.986 --rc genhtml_function_coverage=1 00:18:41.986 --rc genhtml_legend=1 00:18:41.986 --rc geninfo_all_blocks=1 00:18:41.986 --rc geninfo_unexecuted_blocks=1 00:18:41.986 00:18:41.986 ' 00:18:41.986 09:42:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:41.986 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.986 --rc genhtml_branch_coverage=1 00:18:41.986 --rc genhtml_function_coverage=1 00:18:41.986 --rc genhtml_legend=1 00:18:41.986 --rc geninfo_all_blocks=1 00:18:41.986 --rc geninfo_unexecuted_blocks=1 00:18:41.986 00:18:41.986 ' 00:18:41.986 09:42:04 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:41.986 09:42:04 -- nvmf/common.sh@7 -- # uname -s 00:18:41.986 09:42:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:41.986 09:42:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:41.986 09:42:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:41.986 09:42:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:41.986 09:42:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:41.986 09:42:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:41.986 09:42:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:41.986 09:42:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:41.986 09:42:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:41.986 09:42:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:41.986 09:42:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:41.986 09:42:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:41.986 09:42:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:41.986 09:42:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:41.986 09:42:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:41.986 09:42:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:41.986 09:42:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:41.986 09:42:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:41.986 09:42:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:41.986 09:42:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.986 09:42:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.986 09:42:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.986 09:42:04 -- paths/export.sh@5 -- # export PATH 00:18:41.986 09:42:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.986 09:42:04 -- nvmf/common.sh@46 -- # : 0 00:18:41.986 09:42:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:41.986 09:42:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:41.986 09:42:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:41.987 09:42:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:41.987 09:42:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:41.987 09:42:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:41.987 09:42:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:41.987 09:42:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:41.987 09:42:04 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:41.987 09:42:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:41.987 09:42:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:41.987 09:42:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:41.987 09:42:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:41.987 09:42:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:41.987 09:42:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:41.987 09:42:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:41.987 09:42:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:41.987 09:42:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:41.987 09:42:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:41.987 09:42:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:41.987 09:42:04 -- common/autotest_common.sh@10 -- # set +x 00:18:43.891 09:42:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:43.891 09:42:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:43.891 09:42:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:43.891 09:42:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:43.891 09:42:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:43.891 09:42:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:43.891 09:42:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:43.891 09:42:06 -- nvmf/common.sh@294 -- # net_devs=() 00:18:43.891 09:42:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:43.891 09:42:06 -- nvmf/common.sh@295 -- # e810=() 00:18:43.891 09:42:06 -- nvmf/common.sh@295 -- # local -ga e810 00:18:43.891 09:42:06 -- nvmf/common.sh@296 -- # x722=() 00:18:43.891 09:42:06 -- nvmf/common.sh@296 -- # local -ga x722 00:18:43.891 09:42:06 -- nvmf/common.sh@297 -- # mlx=() 00:18:43.891 09:42:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:43.891 09:42:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:43.891 09:42:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:43.891 09:42:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:43.891 09:42:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:43.891 09:42:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:43.891 09:42:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:43.891 09:42:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:43.891 09:42:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:43.891 09:42:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:43.891 09:42:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:43.891 09:42:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:43.891 09:42:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:43.891 09:42:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:43.891 09:42:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:43.891 09:42:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:43.891 09:42:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:43.891 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:43.891 09:42:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:43.891 09:42:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:43.891 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:43.891 09:42:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:43.891 09:42:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:43.891 09:42:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:43.891 09:42:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:43.891 09:42:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:43.891 09:42:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:43.891 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:43.891 09:42:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:43.891 09:42:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:43.891 09:42:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:43.891 09:42:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:43.891 09:42:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:43.891 09:42:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:43.891 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:43.891 09:42:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:43.891 09:42:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:43.891 09:42:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:43.891 09:42:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:43.891 09:42:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:43.891 09:42:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:43.891 09:42:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:43.891 09:42:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:43.891 09:42:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:43.891 09:42:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:43.891 09:42:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:43.891 09:42:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:43.891 09:42:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:43.891 09:42:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:43.891 09:42:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:43.891 09:42:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:43.891 09:42:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:43.891 09:42:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:44.150 09:42:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:44.150 09:42:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:44.150 09:42:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:44.150 09:42:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:44.150 09:42:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:44.150 09:42:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:44.150 09:42:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:44.150 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:44.150 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.194 ms 00:18:44.150 00:18:44.150 --- 10.0.0.2 ping statistics --- 00:18:44.150 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:44.150 rtt min/avg/max/mdev = 0.194/0.194/0.194/0.000 ms 00:18:44.150 09:42:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:44.150 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:44.150 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.140 ms 00:18:44.150 00:18:44.150 --- 10.0.0.1 ping statistics --- 00:18:44.150 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:44.150 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:18:44.150 09:42:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:44.150 09:42:06 -- nvmf/common.sh@410 -- # return 0 00:18:44.150 09:42:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:44.150 09:42:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:44.150 09:42:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:44.150 09:42:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:44.150 09:42:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:44.150 09:42:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:44.150 09:42:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:44.150 09:42:06 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=55905 00:18:44.150 09:42:06 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:44.150 09:42:06 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 55905 00:18:44.150 09:42:06 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:44.150 09:42:06 -- common/autotest_common.sh@829 -- # '[' -z 55905 ']' 00:18:44.150 09:42:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:44.150 09:42:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:44.150 09:42:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:44.150 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:44.150 09:42:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:44.150 09:42:06 -- common/autotest_common.sh@10 -- # set +x 00:18:45.085 09:42:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:45.085 09:42:07 -- common/autotest_common.sh@862 -- # return 0 00:18:45.085 09:42:07 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:45.085 09:42:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:45.085 09:42:07 -- common/autotest_common.sh@10 -- # set +x 00:18:45.085 09:42:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:45.085 09:42:07 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:45.085 09:42:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:45.085 09:42:07 -- common/autotest_common.sh@10 -- # set +x 00:18:45.344 Malloc0 00:18:45.344 09:42:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:45.344 09:42:07 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:45.344 09:42:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:45.344 09:42:07 -- common/autotest_common.sh@10 -- # set +x 00:18:45.344 09:42:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:45.344 09:42:07 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:45.344 09:42:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:45.344 09:42:07 -- common/autotest_common.sh@10 -- # set +x 00:18:45.344 09:42:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:45.344 09:42:07 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:45.344 09:42:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:45.344 09:42:07 -- common/autotest_common.sh@10 -- # set +x 00:18:45.344 09:42:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:45.344 09:42:07 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:45.344 09:42:07 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:17.422 Fuzzing completed. Shutting down the fuzz application 00:19:17.422 00:19:17.422 Dumping successful admin opcodes: 00:19:17.422 8, 9, 10, 24, 00:19:17.422 Dumping successful io opcodes: 00:19:17.422 0, 9, 00:19:17.422 NS: 0x200003aeff00 I/O qp, Total commands completed: 460976, total successful commands: 2667, random_seed: 2864066112 00:19:17.422 NS: 0x200003aeff00 admin qp, Total commands completed: 57440, total successful commands: 459, random_seed: 1284092480 00:19:17.422 09:42:38 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:17.422 Fuzzing completed. Shutting down the fuzz application 00:19:17.422 00:19:17.422 Dumping successful admin opcodes: 00:19:17.422 24, 00:19:17.422 Dumping successful io opcodes: 00:19:17.422 00:19:17.422 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 394035290 00:19:17.422 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 394185262 00:19:17.422 09:42:39 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:17.422 09:42:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.422 09:42:39 -- common/autotest_common.sh@10 -- # set +x 00:19:17.422 09:42:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.422 09:42:39 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:17.422 09:42:39 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:17.422 09:42:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:17.422 09:42:39 -- nvmf/common.sh@116 -- # sync 00:19:17.422 09:42:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:17.422 09:42:39 -- nvmf/common.sh@119 -- # set +e 00:19:17.422 09:42:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:17.422 09:42:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:17.422 rmmod nvme_tcp 00:19:17.422 rmmod nvme_fabrics 00:19:17.422 rmmod nvme_keyring 00:19:17.422 09:42:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:17.422 09:42:39 -- nvmf/common.sh@123 -- # set -e 00:19:17.422 09:42:39 -- nvmf/common.sh@124 -- # return 0 00:19:17.422 09:42:39 -- nvmf/common.sh@477 -- # '[' -n 55905 ']' 00:19:17.422 09:42:39 -- nvmf/common.sh@478 -- # killprocess 55905 00:19:17.422 09:42:39 -- common/autotest_common.sh@936 -- # '[' -z 55905 ']' 00:19:17.422 09:42:39 -- common/autotest_common.sh@940 -- # kill -0 55905 00:19:17.422 09:42:39 -- common/autotest_common.sh@941 -- # uname 00:19:17.422 09:42:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:17.422 09:42:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 55905 00:19:17.422 09:42:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:17.422 09:42:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:17.422 09:42:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 55905' 00:19:17.422 killing process with pid 55905 00:19:17.422 09:42:39 -- common/autotest_common.sh@955 -- # kill 55905 00:19:17.422 09:42:39 -- common/autotest_common.sh@960 -- # wait 55905 00:19:17.422 09:42:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:17.422 09:42:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:17.422 09:42:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:17.422 09:42:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:17.422 09:42:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:17.422 09:42:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:17.422 09:42:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:17.422 09:42:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:19.968 09:42:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:19.968 09:42:42 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:19.968 00:19:19.968 real 0m37.697s 00:19:19.968 user 0m52.006s 00:19:19.968 sys 0m15.196s 00:19:19.968 09:42:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:19.968 09:42:42 -- common/autotest_common.sh@10 -- # set +x 00:19:19.968 ************************************ 00:19:19.968 END TEST nvmf_fuzz 00:19:19.968 ************************************ 00:19:19.968 09:42:42 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:19.968 09:42:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:19.968 09:42:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:19.968 09:42:42 -- common/autotest_common.sh@10 -- # set +x 00:19:19.968 ************************************ 00:19:19.968 START TEST nvmf_multiconnection 00:19:19.968 ************************************ 00:19:19.968 09:42:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:19.968 * Looking for test storage... 00:19:19.968 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:19.968 09:42:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:19.968 09:42:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:19.968 09:42:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:19.968 09:42:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:19.968 09:42:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:19.968 09:42:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:19.968 09:42:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:19.968 09:42:42 -- scripts/common.sh@335 -- # IFS=.-: 00:19:19.968 09:42:42 -- scripts/common.sh@335 -- # read -ra ver1 00:19:19.968 09:42:42 -- scripts/common.sh@336 -- # IFS=.-: 00:19:19.968 09:42:42 -- scripts/common.sh@336 -- # read -ra ver2 00:19:19.968 09:42:42 -- scripts/common.sh@337 -- # local 'op=<' 00:19:19.968 09:42:42 -- scripts/common.sh@339 -- # ver1_l=2 00:19:19.968 09:42:42 -- scripts/common.sh@340 -- # ver2_l=1 00:19:19.968 09:42:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:19.968 09:42:42 -- scripts/common.sh@343 -- # case "$op" in 00:19:19.968 09:42:42 -- scripts/common.sh@344 -- # : 1 00:19:19.968 09:42:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:19.968 09:42:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:19.968 09:42:42 -- scripts/common.sh@364 -- # decimal 1 00:19:19.968 09:42:42 -- scripts/common.sh@352 -- # local d=1 00:19:19.968 09:42:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:19.968 09:42:42 -- scripts/common.sh@354 -- # echo 1 00:19:19.968 09:42:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:19.968 09:42:42 -- scripts/common.sh@365 -- # decimal 2 00:19:19.968 09:42:42 -- scripts/common.sh@352 -- # local d=2 00:19:19.968 09:42:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:19.968 09:42:42 -- scripts/common.sh@354 -- # echo 2 00:19:19.968 09:42:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:19.968 09:42:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:19.968 09:42:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:19.968 09:42:42 -- scripts/common.sh@367 -- # return 0 00:19:19.968 09:42:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:19.968 09:42:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:19.968 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:19.968 --rc genhtml_branch_coverage=1 00:19:19.968 --rc genhtml_function_coverage=1 00:19:19.968 --rc genhtml_legend=1 00:19:19.968 --rc geninfo_all_blocks=1 00:19:19.968 --rc geninfo_unexecuted_blocks=1 00:19:19.968 00:19:19.968 ' 00:19:19.968 09:42:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:19.968 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:19.968 --rc genhtml_branch_coverage=1 00:19:19.968 --rc genhtml_function_coverage=1 00:19:19.968 --rc genhtml_legend=1 00:19:19.968 --rc geninfo_all_blocks=1 00:19:19.968 --rc geninfo_unexecuted_blocks=1 00:19:19.968 00:19:19.968 ' 00:19:19.968 09:42:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:19.968 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:19.968 --rc genhtml_branch_coverage=1 00:19:19.968 --rc genhtml_function_coverage=1 00:19:19.968 --rc genhtml_legend=1 00:19:19.968 --rc geninfo_all_blocks=1 00:19:19.968 --rc geninfo_unexecuted_blocks=1 00:19:19.968 00:19:19.968 ' 00:19:19.968 09:42:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:19.968 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:19.968 --rc genhtml_branch_coverage=1 00:19:19.968 --rc genhtml_function_coverage=1 00:19:19.968 --rc genhtml_legend=1 00:19:19.968 --rc geninfo_all_blocks=1 00:19:19.968 --rc geninfo_unexecuted_blocks=1 00:19:19.968 00:19:19.968 ' 00:19:19.968 09:42:42 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:19.968 09:42:42 -- nvmf/common.sh@7 -- # uname -s 00:19:19.968 09:42:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:19.968 09:42:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:19.968 09:42:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:19.968 09:42:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:19.968 09:42:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:19.968 09:42:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:19.968 09:42:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:19.968 09:42:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:19.968 09:42:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:19.968 09:42:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:19.968 09:42:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:19.968 09:42:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:19.968 09:42:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:19.968 09:42:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:19.968 09:42:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:19.968 09:42:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:19.968 09:42:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:19.968 09:42:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:19.968 09:42:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:19.968 09:42:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:19.969 09:42:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:19.969 09:42:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:19.969 09:42:42 -- paths/export.sh@5 -- # export PATH 00:19:19.969 09:42:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:19.969 09:42:42 -- nvmf/common.sh@46 -- # : 0 00:19:19.969 09:42:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:19.969 09:42:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:19.969 09:42:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:19.969 09:42:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:19.969 09:42:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:19.969 09:42:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:19.969 09:42:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:19.969 09:42:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:19.969 09:42:42 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:19.969 09:42:42 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:19.969 09:42:42 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:19.969 09:42:42 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:19.969 09:42:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:19.969 09:42:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:19.969 09:42:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:19.969 09:42:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:19.969 09:42:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:19.969 09:42:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:19.969 09:42:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:19.969 09:42:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:19.969 09:42:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:19.969 09:42:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:19.969 09:42:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:19.969 09:42:42 -- common/autotest_common.sh@10 -- # set +x 00:19:21.881 09:42:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:21.881 09:42:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:21.881 09:42:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:21.881 09:42:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:21.881 09:42:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:21.881 09:42:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:21.881 09:42:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:21.881 09:42:44 -- nvmf/common.sh@294 -- # net_devs=() 00:19:21.881 09:42:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:21.881 09:42:44 -- nvmf/common.sh@295 -- # e810=() 00:19:21.881 09:42:44 -- nvmf/common.sh@295 -- # local -ga e810 00:19:21.881 09:42:44 -- nvmf/common.sh@296 -- # x722=() 00:19:21.881 09:42:44 -- nvmf/common.sh@296 -- # local -ga x722 00:19:21.881 09:42:44 -- nvmf/common.sh@297 -- # mlx=() 00:19:21.881 09:42:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:21.881 09:42:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:21.881 09:42:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:21.881 09:42:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:21.881 09:42:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:21.881 09:42:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:21.881 09:42:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:21.881 09:42:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:21.881 09:42:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:21.881 09:42:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:21.881 09:42:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:21.881 09:42:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:21.881 09:42:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:21.881 09:42:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:21.881 09:42:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:21.881 09:42:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:21.881 09:42:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:21.881 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:21.881 09:42:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:21.881 09:42:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:21.881 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:21.881 09:42:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:21.881 09:42:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:21.881 09:42:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:21.881 09:42:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:21.881 09:42:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:21.881 09:42:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:21.881 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:21.881 09:42:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:21.881 09:42:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:21.881 09:42:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:21.881 09:42:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:21.881 09:42:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:21.881 09:42:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:21.881 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:21.881 09:42:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:21.881 09:42:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:21.881 09:42:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:21.881 09:42:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:21.881 09:42:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:21.881 09:42:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:21.881 09:42:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:21.881 09:42:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:21.881 09:42:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:21.881 09:42:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:21.881 09:42:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:21.881 09:42:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:21.881 09:42:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:21.881 09:42:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:21.881 09:42:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:21.881 09:42:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:21.881 09:42:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:21.881 09:42:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:21.881 09:42:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:21.881 09:42:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:21.881 09:42:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:21.881 09:42:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:21.881 09:42:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:21.881 09:42:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:22.140 09:42:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:22.140 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:22.140 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:19:22.140 00:19:22.140 --- 10.0.0.2 ping statistics --- 00:19:22.140 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:22.140 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:19:22.140 09:42:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:22.140 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:22.140 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.087 ms 00:19:22.140 00:19:22.140 --- 10.0.0.1 ping statistics --- 00:19:22.140 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:22.140 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:19:22.140 09:42:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:22.140 09:42:44 -- nvmf/common.sh@410 -- # return 0 00:19:22.140 09:42:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:22.140 09:42:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:22.140 09:42:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:22.140 09:42:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:22.140 09:42:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:22.140 09:42:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:22.140 09:42:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:22.140 09:42:44 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:22.140 09:42:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:22.140 09:42:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:22.140 09:42:44 -- common/autotest_common.sh@10 -- # set +x 00:19:22.140 09:42:44 -- nvmf/common.sh@469 -- # nvmfpid=62417 00:19:22.141 09:42:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:22.141 09:42:44 -- nvmf/common.sh@470 -- # waitforlisten 62417 00:19:22.141 09:42:44 -- common/autotest_common.sh@829 -- # '[' -z 62417 ']' 00:19:22.141 09:42:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:22.141 09:42:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:22.141 09:42:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:22.141 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:22.141 09:42:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:22.141 09:42:44 -- common/autotest_common.sh@10 -- # set +x 00:19:22.141 [2024-11-29 09:42:44.801732] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:22.141 [2024-11-29 09:42:44.801818] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:22.141 EAL: No free 2048 kB hugepages reported on node 1 00:19:22.141 [2024-11-29 09:42:44.872906] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:22.401 [2024-11-29 09:42:44.994764] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:22.401 [2024-11-29 09:42:44.994938] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:22.401 [2024-11-29 09:42:44.994957] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:22.401 [2024-11-29 09:42:44.994971] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:22.401 [2024-11-29 09:42:44.995050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:22.401 [2024-11-29 09:42:44.995108] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:22.401 [2024-11-29 09:42:44.995134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:22.401 [2024-11-29 09:42:44.995141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:22.966 09:42:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:22.966 09:42:45 -- common/autotest_common.sh@862 -- # return 0 00:19:22.966 09:42:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:22.966 09:42:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:22.966 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:22.966 09:42:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:22.966 09:42:45 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:22.966 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.966 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:22.966 [2024-11-29 09:42:45.801984] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:23.226 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.226 09:42:45 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:23.226 09:42:45 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.226 09:42:45 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:23.226 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.226 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.226 Malloc1 00:19:23.226 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.226 09:42:45 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:23.226 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.226 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.226 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.226 09:42:45 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:23.226 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.226 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.226 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.226 09:42:45 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:23.226 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.226 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.226 [2024-11-29 09:42:45.858886] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:23.226 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.226 09:42:45 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.226 09:42:45 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:23.226 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.226 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.226 Malloc2 00:19:23.226 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.226 09:42:45 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:23.226 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.226 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.226 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.226 09:42:45 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:23.226 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.226 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.226 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.226 09:42:45 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:23.226 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.226 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.226 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.226 09:42:45 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.226 09:42:45 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:23.226 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.226 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.226 Malloc3 00:19:23.226 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.226 09:42:45 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:23.226 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.226 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.226 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.226 09:42:45 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:23.226 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.226 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.226 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.226 09:42:45 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:23.226 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.226 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.226 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.226 09:42:45 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.226 09:42:45 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:23.226 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.226 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.226 Malloc4 00:19:23.226 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.226 09:42:45 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:23.226 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.226 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.227 09:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.227 09:42:45 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:23.227 09:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.227 09:42:45 -- common/autotest_common.sh@10 -- # set +x 00:19:23.227 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.227 09:42:46 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:23.227 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.227 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.227 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.227 09:42:46 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.227 09:42:46 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:23.227 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.227 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.227 Malloc5 00:19:23.227 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.227 09:42:46 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:23.227 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.227 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.227 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.227 09:42:46 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:23.227 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.227 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.227 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.227 09:42:46 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:23.227 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.227 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.227 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.227 09:42:46 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.227 09:42:46 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:23.227 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.227 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 Malloc6 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.488 09:42:46 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 Malloc7 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.488 09:42:46 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 Malloc8 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.488 09:42:46 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 Malloc9 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.488 09:42:46 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 Malloc10 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.488 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.488 09:42:46 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.488 09:42:46 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:23.488 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.488 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.747 Malloc11 00:19:23.747 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.748 09:42:46 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:23.748 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.748 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.748 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.748 09:42:46 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:23.748 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.748 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.748 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.748 09:42:46 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:23.748 09:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.748 09:42:46 -- common/autotest_common.sh@10 -- # set +x 00:19:23.748 09:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.748 09:42:46 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:23.748 09:42:46 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:23.748 09:42:46 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:24.315 09:42:47 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:24.315 09:42:47 -- common/autotest_common.sh@1187 -- # local i=0 00:19:24.315 09:42:47 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:24.315 09:42:47 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:24.315 09:42:47 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:26.224 09:42:49 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:26.224 09:42:49 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:26.224 09:42:49 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:26.484 09:42:49 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:26.484 09:42:49 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:26.484 09:42:49 -- common/autotest_common.sh@1197 -- # return 0 00:19:26.484 09:42:49 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:26.484 09:42:49 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:27.055 09:42:49 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:27.055 09:42:49 -- common/autotest_common.sh@1187 -- # local i=0 00:19:27.055 09:42:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:27.055 09:42:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:27.055 09:42:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:28.963 09:42:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:29.224 09:42:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:29.224 09:42:51 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:29.224 09:42:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:29.224 09:42:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:29.224 09:42:51 -- common/autotest_common.sh@1197 -- # return 0 00:19:29.224 09:42:51 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:29.224 09:42:51 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:29.794 09:42:52 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:29.794 09:42:52 -- common/autotest_common.sh@1187 -- # local i=0 00:19:29.794 09:42:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:29.794 09:42:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:29.794 09:42:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:31.698 09:42:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:31.698 09:42:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:31.698 09:42:54 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:31.698 09:42:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:31.698 09:42:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:31.698 09:42:54 -- common/autotest_common.sh@1197 -- # return 0 00:19:31.698 09:42:54 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:31.698 09:42:54 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:32.635 09:42:55 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:32.635 09:42:55 -- common/autotest_common.sh@1187 -- # local i=0 00:19:32.635 09:42:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:32.635 09:42:55 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:32.635 09:42:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:34.542 09:42:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:34.542 09:42:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:34.542 09:42:57 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:34.542 09:42:57 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:34.542 09:42:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:34.542 09:42:57 -- common/autotest_common.sh@1197 -- # return 0 00:19:34.542 09:42:57 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:34.542 09:42:57 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:35.477 09:42:57 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:35.477 09:42:57 -- common/autotest_common.sh@1187 -- # local i=0 00:19:35.477 09:42:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:35.477 09:42:57 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:35.477 09:42:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:37.387 09:42:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:37.387 09:42:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:37.387 09:42:59 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:37.387 09:42:59 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:37.387 09:42:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:37.387 09:42:59 -- common/autotest_common.sh@1197 -- # return 0 00:19:37.387 09:42:59 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:37.387 09:42:59 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:37.958 09:43:00 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:37.958 09:43:00 -- common/autotest_common.sh@1187 -- # local i=0 00:19:37.958 09:43:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:37.958 09:43:00 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:37.958 09:43:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:39.862 09:43:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:39.862 09:43:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:39.862 09:43:02 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:40.121 09:43:02 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:40.121 09:43:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:40.121 09:43:02 -- common/autotest_common.sh@1197 -- # return 0 00:19:40.121 09:43:02 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:40.121 09:43:02 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:41.058 09:43:03 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:41.058 09:43:03 -- common/autotest_common.sh@1187 -- # local i=0 00:19:41.058 09:43:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:41.058 09:43:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:41.058 09:43:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:42.975 09:43:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:42.975 09:43:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:42.975 09:43:05 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:42.975 09:43:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:42.975 09:43:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:42.975 09:43:05 -- common/autotest_common.sh@1197 -- # return 0 00:19:42.975 09:43:05 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:42.975 09:43:05 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:43.623 09:43:06 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:43.623 09:43:06 -- common/autotest_common.sh@1187 -- # local i=0 00:19:43.623 09:43:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:43.623 09:43:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:43.623 09:43:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:45.531 09:43:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:45.531 09:43:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:45.531 09:43:08 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:45.531 09:43:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:45.531 09:43:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:45.531 09:43:08 -- common/autotest_common.sh@1197 -- # return 0 00:19:45.531 09:43:08 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:45.531 09:43:08 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:46.472 09:43:09 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:46.472 09:43:09 -- common/autotest_common.sh@1187 -- # local i=0 00:19:46.472 09:43:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:46.472 09:43:09 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:46.472 09:43:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:48.380 09:43:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:48.380 09:43:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:48.380 09:43:11 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:19:48.639 09:43:11 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:48.639 09:43:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:48.639 09:43:11 -- common/autotest_common.sh@1197 -- # return 0 00:19:48.639 09:43:11 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:48.639 09:43:11 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:49.576 09:43:12 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:49.577 09:43:12 -- common/autotest_common.sh@1187 -- # local i=0 00:19:49.577 09:43:12 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:49.577 09:43:12 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:49.577 09:43:12 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:51.484 09:43:14 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:51.484 09:43:14 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:51.484 09:43:14 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:19:51.484 09:43:14 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:51.484 09:43:14 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:51.484 09:43:14 -- common/autotest_common.sh@1197 -- # return 0 00:19:51.484 09:43:14 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:51.484 09:43:14 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:19:52.420 09:43:14 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:19:52.420 09:43:14 -- common/autotest_common.sh@1187 -- # local i=0 00:19:52.420 09:43:14 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:52.420 09:43:14 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:52.420 09:43:14 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:54.325 09:43:16 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:54.325 09:43:16 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:54.325 09:43:16 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:19:54.325 09:43:16 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:54.325 09:43:16 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:54.325 09:43:16 -- common/autotest_common.sh@1197 -- # return 0 00:19:54.325 09:43:16 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:19:54.325 [global] 00:19:54.325 thread=1 00:19:54.325 invalidate=1 00:19:54.325 rw=read 00:19:54.325 time_based=1 00:19:54.325 runtime=10 00:19:54.325 ioengine=libaio 00:19:54.325 direct=1 00:19:54.325 bs=262144 00:19:54.325 iodepth=64 00:19:54.325 norandommap=1 00:19:54.325 numjobs=1 00:19:54.325 00:19:54.325 [job0] 00:19:54.325 filename=/dev/nvme0n1 00:19:54.325 [job1] 00:19:54.325 filename=/dev/nvme10n1 00:19:54.325 [job2] 00:19:54.326 filename=/dev/nvme1n1 00:19:54.326 [job3] 00:19:54.326 filename=/dev/nvme2n1 00:19:54.326 [job4] 00:19:54.326 filename=/dev/nvme3n1 00:19:54.326 [job5] 00:19:54.326 filename=/dev/nvme4n1 00:19:54.326 [job6] 00:19:54.326 filename=/dev/nvme5n1 00:19:54.326 [job7] 00:19:54.326 filename=/dev/nvme6n1 00:19:54.326 [job8] 00:19:54.326 filename=/dev/nvme7n1 00:19:54.326 [job9] 00:19:54.326 filename=/dev/nvme8n1 00:19:54.326 [job10] 00:19:54.326 filename=/dev/nvme9n1 00:19:54.326 Could not set queue depth (nvme0n1) 00:19:54.326 Could not set queue depth (nvme10n1) 00:19:54.326 Could not set queue depth (nvme1n1) 00:19:54.326 Could not set queue depth (nvme2n1) 00:19:54.326 Could not set queue depth (nvme3n1) 00:19:54.326 Could not set queue depth (nvme4n1) 00:19:54.326 Could not set queue depth (nvme5n1) 00:19:54.326 Could not set queue depth (nvme6n1) 00:19:54.326 Could not set queue depth (nvme7n1) 00:19:54.326 Could not set queue depth (nvme8n1) 00:19:54.326 Could not set queue depth (nvme9n1) 00:19:54.584 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.584 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.584 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.584 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.584 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.584 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.584 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.584 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.584 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.584 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.584 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:54.584 fio-3.35 00:19:54.584 Starting 11 threads 00:20:06.793 00:20:06.793 job0: (groupid=0, jobs=1): err= 0: pid=66933: Fri Nov 29 09:43:27 2024 00:20:06.793 read: IOPS=817, BW=204MiB/s (214MB/s)(2046MiB/10017msec) 00:20:06.793 slat (usec): min=9, max=219526, avg=965.55, stdev=5105.98 00:20:06.793 clat (usec): min=720, max=392684, avg=77322.03, stdev=53792.61 00:20:06.793 lat (usec): min=744, max=520582, avg=78287.58, stdev=54605.75 00:20:06.793 clat percentiles (msec): 00:20:06.793 | 1.00th=[ 7], 5.00th=[ 22], 10.00th=[ 28], 20.00th=[ 32], 00:20:06.793 | 30.00th=[ 38], 40.00th=[ 51], 50.00th=[ 66], 60.00th=[ 83], 00:20:06.793 | 70.00th=[ 97], 80.00th=[ 113], 90.00th=[ 144], 95.00th=[ 174], 00:20:06.793 | 99.00th=[ 284], 99.50th=[ 300], 99.90th=[ 305], 99.95th=[ 313], 00:20:06.793 | 99.99th=[ 393] 00:20:06.793 bw ( KiB/s): min=64512, max=450560, per=10.78%, avg=207880.90, stdev=101058.38, samples=20 00:20:06.793 iops : min= 252, max= 1760, avg=812.00, stdev=394.77, samples=20 00:20:06.793 lat (usec) : 750=0.01%, 1000=0.04% 00:20:06.793 lat (msec) : 2=0.18%, 4=0.27%, 10=1.17%, 20=3.09%, 50=34.69% 00:20:06.793 lat (msec) : 100=32.16%, 250=26.28%, 500=2.10% 00:20:06.793 cpu : usr=0.35%, sys=2.14%, ctx=1492, majf=0, minf=3722 00:20:06.793 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:06.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.794 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.794 issued rwts: total=8184,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.794 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.794 job1: (groupid=0, jobs=1): err= 0: pid=66949: Fri Nov 29 09:43:27 2024 00:20:06.794 read: IOPS=940, BW=235MiB/s (247MB/s)(2356MiB/10018msec) 00:20:06.794 slat (usec): min=9, max=89536, avg=930.69, stdev=3094.07 00:20:06.794 clat (msec): min=2, max=240, avg=67.05, stdev=33.09 00:20:06.794 lat (msec): min=2, max=240, avg=67.98, stdev=33.44 00:20:06.794 clat percentiles (msec): 00:20:06.794 | 1.00th=[ 24], 5.00th=[ 28], 10.00th=[ 30], 20.00th=[ 32], 00:20:06.794 | 30.00th=[ 43], 40.00th=[ 56], 50.00th=[ 64], 60.00th=[ 74], 00:20:06.794 | 70.00th=[ 84], 80.00th=[ 94], 90.00th=[ 109], 95.00th=[ 124], 00:20:06.794 | 99.00th=[ 169], 99.50th=[ 182], 99.90th=[ 228], 99.95th=[ 241], 00:20:06.794 | 99.99th=[ 241] 00:20:06.794 bw ( KiB/s): min=87552, max=490027, per=12.42%, avg=239618.15, stdev=103174.91, samples=20 00:20:06.794 iops : min= 342, max= 1914, avg=936.00, stdev=403.01, samples=20 00:20:06.794 lat (msec) : 4=0.33%, 10=0.32%, 20=0.11%, 50=34.18%, 100=50.07% 00:20:06.794 lat (msec) : 250=15.00% 00:20:06.794 cpu : usr=0.60%, sys=2.99%, ctx=1748, majf=0, minf=4097 00:20:06.794 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:20:06.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.794 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.794 issued rwts: total=9425,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.794 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.794 job2: (groupid=0, jobs=1): err= 0: pid=66951: Fri Nov 29 09:43:27 2024 00:20:06.794 read: IOPS=565, BW=141MiB/s (148MB/s)(1422MiB/10056msec) 00:20:06.794 slat (usec): min=10, max=115495, avg=1242.29, stdev=5148.10 00:20:06.794 clat (msec): min=4, max=389, avg=111.84, stdev=57.95 00:20:06.794 lat (msec): min=5, max=389, avg=113.09, stdev=58.97 00:20:06.794 clat percentiles (msec): 00:20:06.794 | 1.00th=[ 10], 5.00th=[ 25], 10.00th=[ 46], 20.00th=[ 67], 00:20:06.794 | 30.00th=[ 82], 40.00th=[ 94], 50.00th=[ 105], 60.00th=[ 114], 00:20:06.794 | 70.00th=[ 132], 80.00th=[ 159], 90.00th=[ 186], 95.00th=[ 213], 00:20:06.794 | 99.00th=[ 305], 99.50th=[ 317], 99.90th=[ 326], 99.95th=[ 355], 00:20:06.794 | 99.99th=[ 388] 00:20:06.794 bw ( KiB/s): min=57856, max=244224, per=7.46%, avg=143971.80, stdev=57778.51, samples=20 00:20:06.794 iops : min= 226, max= 954, avg=562.30, stdev=225.72, samples=20 00:20:06.794 lat (msec) : 10=1.04%, 20=2.62%, 50=8.11%, 100=33.32%, 250=52.28% 00:20:06.794 lat (msec) : 500=2.64% 00:20:06.794 cpu : usr=0.33%, sys=1.66%, ctx=1288, majf=0, minf=4097 00:20:06.794 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:06.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.794 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.794 issued rwts: total=5687,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.794 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.794 job3: (groupid=0, jobs=1): err= 0: pid=66952: Fri Nov 29 09:43:27 2024 00:20:06.794 read: IOPS=660, BW=165MiB/s (173MB/s)(1671MiB/10117msec) 00:20:06.794 slat (usec): min=8, max=93525, avg=1014.75, stdev=4105.61 00:20:06.794 clat (usec): min=863, max=319024, avg=95798.12, stdev=51829.99 00:20:06.794 lat (usec): min=882, max=359811, avg=96812.87, stdev=52264.27 00:20:06.794 clat percentiles (msec): 00:20:06.794 | 1.00th=[ 5], 5.00th=[ 17], 10.00th=[ 35], 20.00th=[ 64], 00:20:06.794 | 30.00th=[ 74], 40.00th=[ 84], 50.00th=[ 92], 60.00th=[ 101], 00:20:06.794 | 70.00th=[ 109], 80.00th=[ 122], 90.00th=[ 148], 95.00th=[ 197], 00:20:06.794 | 99.00th=[ 305], 99.50th=[ 309], 99.90th=[ 317], 99.95th=[ 317], 00:20:06.794 | 99.99th=[ 321] 00:20:06.794 bw ( KiB/s): min=60416, max=294400, per=8.78%, avg=169428.30, stdev=51129.46, samples=20 00:20:06.794 iops : min= 236, max= 1150, avg=661.80, stdev=199.72, samples=20 00:20:06.794 lat (usec) : 1000=0.07% 00:20:06.794 lat (msec) : 2=0.13%, 4=0.73%, 10=1.89%, 20=3.50%, 50=8.32% 00:20:06.794 lat (msec) : 100=45.34%, 250=37.80%, 500=2.21% 00:20:06.794 cpu : usr=0.39%, sys=2.03%, ctx=1380, majf=0, minf=4097 00:20:06.794 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:06.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.794 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.794 issued rwts: total=6683,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.794 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.794 job4: (groupid=0, jobs=1): err= 0: pid=66955: Fri Nov 29 09:43:27 2024 00:20:06.794 read: IOPS=551, BW=138MiB/s (145MB/s)(1395MiB/10118msec) 00:20:06.794 slat (usec): min=9, max=157446, avg=1469.56, stdev=6077.47 00:20:06.794 clat (msec): min=2, max=361, avg=114.52, stdev=65.38 00:20:06.794 lat (msec): min=2, max=372, avg=115.99, stdev=66.34 00:20:06.794 clat percentiles (msec): 00:20:06.794 | 1.00th=[ 5], 5.00th=[ 18], 10.00th=[ 32], 20.00th=[ 61], 00:20:06.794 | 30.00th=[ 73], 40.00th=[ 93], 50.00th=[ 110], 60.00th=[ 125], 00:20:06.794 | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 194], 95.00th=[ 222], 00:20:06.794 | 99.00th=[ 309], 99.50th=[ 317], 99.90th=[ 338], 99.95th=[ 355], 00:20:06.794 | 99.99th=[ 363] 00:20:06.794 bw ( KiB/s): min=63488, max=319488, per=7.32%, avg=141193.00, stdev=62759.40, samples=20 00:20:06.794 iops : min= 248, max= 1248, avg=551.50, stdev=245.14, samples=20 00:20:06.794 lat (msec) : 4=0.43%, 10=2.17%, 20=3.51%, 50=10.18%, 100=27.66% 00:20:06.794 lat (msec) : 250=52.54%, 500=3.51% 00:20:06.794 cpu : usr=0.41%, sys=1.82%, ctx=1127, majf=0, minf=4097 00:20:06.794 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:06.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.794 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.794 issued rwts: total=5579,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.794 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.794 job5: (groupid=0, jobs=1): err= 0: pid=66956: Fri Nov 29 09:43:27 2024 00:20:06.794 read: IOPS=948, BW=237MiB/s (249MB/s)(2385MiB/10060msec) 00:20:06.794 slat (usec): min=8, max=46948, avg=840.17, stdev=2992.45 00:20:06.794 clat (usec): min=1674, max=173861, avg=66606.67, stdev=34505.54 00:20:06.794 lat (usec): min=1735, max=207053, avg=67446.84, stdev=35056.63 00:20:06.794 clat percentiles (msec): 00:20:06.794 | 1.00th=[ 6], 5.00th=[ 15], 10.00th=[ 23], 20.00th=[ 36], 00:20:06.794 | 30.00th=[ 45], 40.00th=[ 54], 50.00th=[ 62], 60.00th=[ 75], 00:20:06.794 | 70.00th=[ 86], 80.00th=[ 101], 90.00th=[ 115], 95.00th=[ 126], 00:20:06.794 | 99.00th=[ 146], 99.50th=[ 157], 99.90th=[ 169], 99.95th=[ 169], 00:20:06.794 | 99.99th=[ 174] 00:20:06.794 bw ( KiB/s): min=121856, max=492505, per=12.58%, avg=242621.40, stdev=102373.54, samples=20 00:20:06.794 iops : min= 476, max= 1923, avg=947.65, stdev=399.84, samples=20 00:20:06.794 lat (msec) : 2=0.14%, 4=0.22%, 10=3.09%, 20=4.42%, 50=28.45% 00:20:06.794 lat (msec) : 100=42.90%, 250=20.78% 00:20:06.794 cpu : usr=0.46%, sys=2.59%, ctx=1678, majf=0, minf=4097 00:20:06.794 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:20:06.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.794 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.794 issued rwts: total=9539,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.794 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.794 job6: (groupid=0, jobs=1): err= 0: pid=66957: Fri Nov 29 09:43:27 2024 00:20:06.794 read: IOPS=721, BW=180MiB/s (189MB/s)(1806MiB/10019msec) 00:20:06.794 slat (usec): min=9, max=129854, avg=990.86, stdev=4919.45 00:20:06.794 clat (msec): min=2, max=331, avg=87.72, stdev=58.58 00:20:06.794 lat (msec): min=2, max=385, avg=88.71, stdev=59.33 00:20:06.794 clat percentiles (msec): 00:20:06.794 | 1.00th=[ 10], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 34], 00:20:06.794 | 30.00th=[ 46], 40.00th=[ 57], 50.00th=[ 71], 60.00th=[ 88], 00:20:06.794 | 70.00th=[ 111], 80.00th=[ 148], 90.00th=[ 176], 95.00th=[ 194], 00:20:06.794 | 99.00th=[ 241], 99.50th=[ 305], 99.90th=[ 309], 99.95th=[ 313], 00:20:06.794 | 99.99th=[ 334] 00:20:06.794 bw ( KiB/s): min=88064, max=440832, per=9.50%, avg=183307.85, stdev=92785.37, samples=20 00:20:06.794 iops : min= 344, max= 1722, avg=716.00, stdev=362.47, samples=20 00:20:06.794 lat (msec) : 4=0.10%, 10=1.04%, 20=2.39%, 50=30.38%, 100=31.76% 00:20:06.794 lat (msec) : 250=33.39%, 500=0.94% 00:20:06.794 cpu : usr=0.32%, sys=2.16%, ctx=1475, majf=0, minf=4097 00:20:06.794 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:20:06.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.794 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.794 issued rwts: total=7224,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.794 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.794 job7: (groupid=0, jobs=1): err= 0: pid=66958: Fri Nov 29 09:43:27 2024 00:20:06.794 read: IOPS=477, BW=119MiB/s (125MB/s)(1209MiB/10123msec) 00:20:06.794 slat (usec): min=9, max=90683, avg=1531.19, stdev=6010.48 00:20:06.794 clat (usec): min=1008, max=373109, avg=132394.22, stdev=63652.82 00:20:06.794 lat (usec): min=1058, max=396051, avg=133925.41, stdev=64742.99 00:20:06.794 clat percentiles (msec): 00:20:06.794 | 1.00th=[ 5], 5.00th=[ 30], 10.00th=[ 45], 20.00th=[ 79], 00:20:06.794 | 30.00th=[ 96], 40.00th=[ 115], 50.00th=[ 133], 60.00th=[ 150], 00:20:06.794 | 70.00th=[ 167], 80.00th=[ 184], 90.00th=[ 209], 95.00th=[ 230], 00:20:06.794 | 99.00th=[ 309], 99.50th=[ 317], 99.90th=[ 351], 99.95th=[ 372], 00:20:06.794 | 99.99th=[ 372] 00:20:06.794 bw ( KiB/s): min=56832, max=190976, per=6.33%, avg=122095.55, stdev=42111.21, samples=20 00:20:06.794 iops : min= 222, max= 746, avg=476.90, stdev=164.46, samples=20 00:20:06.794 lat (msec) : 2=0.19%, 4=0.81%, 10=1.16%, 20=1.68%, 50=7.12% 00:20:06.794 lat (msec) : 100=20.42%, 250=65.27%, 500=3.37% 00:20:06.794 cpu : usr=0.24%, sys=1.48%, ctx=1131, majf=0, minf=4098 00:20:06.794 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:06.794 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.794 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.795 issued rwts: total=4834,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.795 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.795 job8: (groupid=0, jobs=1): err= 0: pid=66959: Fri Nov 29 09:43:27 2024 00:20:06.795 read: IOPS=515, BW=129MiB/s (135MB/s)(1304MiB/10120msec) 00:20:06.795 slat (usec): min=9, max=214748, avg=1057.02, stdev=6086.50 00:20:06.795 clat (msec): min=5, max=507, avg=123.04, stdev=57.35 00:20:06.795 lat (msec): min=5, max=507, avg=124.09, stdev=58.18 00:20:06.795 clat percentiles (msec): 00:20:06.795 | 1.00th=[ 20], 5.00th=[ 50], 10.00th=[ 68], 20.00th=[ 81], 00:20:06.795 | 30.00th=[ 90], 40.00th=[ 100], 50.00th=[ 110], 60.00th=[ 123], 00:20:06.795 | 70.00th=[ 140], 80.00th=[ 171], 90.00th=[ 194], 95.00th=[ 228], 00:20:06.795 | 99.00th=[ 313], 99.50th=[ 321], 99.90th=[ 334], 99.95th=[ 506], 00:20:06.795 | 99.99th=[ 506] 00:20:06.795 bw ( KiB/s): min=74752, max=214528, per=6.84%, avg=131871.65, stdev=38078.95, samples=20 00:20:06.795 iops : min= 292, max= 838, avg=515.10, stdev=148.70, samples=20 00:20:06.795 lat (msec) : 10=0.25%, 20=0.96%, 50=3.87%, 100=35.42%, 250=55.84% 00:20:06.795 lat (msec) : 500=3.60%, 750=0.06% 00:20:06.795 cpu : usr=0.26%, sys=1.45%, ctx=1368, majf=0, minf=4098 00:20:06.795 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:06.795 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.795 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.795 issued rwts: total=5215,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.795 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.795 job9: (groupid=0, jobs=1): err= 0: pid=66960: Fri Nov 29 09:43:27 2024 00:20:06.795 read: IOPS=659, BW=165MiB/s (173MB/s)(1667MiB/10115msec) 00:20:06.795 slat (usec): min=9, max=143218, avg=1133.28, stdev=4968.18 00:20:06.795 clat (msec): min=3, max=374, avg=95.85, stdev=57.85 00:20:06.795 lat (msec): min=3, max=374, avg=96.98, stdev=58.59 00:20:06.795 clat percentiles (msec): 00:20:06.795 | 1.00th=[ 17], 5.00th=[ 40], 10.00th=[ 46], 20.00th=[ 54], 00:20:06.795 | 30.00th=[ 63], 40.00th=[ 71], 50.00th=[ 78], 60.00th=[ 86], 00:20:06.795 | 70.00th=[ 103], 80.00th=[ 130], 90.00th=[ 178], 95.00th=[ 215], 00:20:06.795 | 99.00th=[ 309], 99.50th=[ 313], 99.90th=[ 330], 99.95th=[ 334], 00:20:06.795 | 99.99th=[ 376] 00:20:06.795 bw ( KiB/s): min=58368, max=263680, per=8.77%, avg=169097.85, stdev=63176.25, samples=20 00:20:06.795 iops : min= 228, max= 1030, avg=660.50, stdev=246.79, samples=20 00:20:06.795 lat (msec) : 4=0.06%, 10=0.34%, 20=1.08%, 50=14.16%, 100=53.76% 00:20:06.795 lat (msec) : 250=28.12%, 500=2.49% 00:20:06.795 cpu : usr=0.40%, sys=2.06%, ctx=1400, majf=0, minf=4097 00:20:06.795 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:06.795 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.795 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.795 issued rwts: total=6669,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.795 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.795 job10: (groupid=0, jobs=1): err= 0: pid=66961: Fri Nov 29 09:43:27 2024 00:20:06.795 read: IOPS=714, BW=179MiB/s (187MB/s)(1806MiB/10115msec) 00:20:06.795 slat (usec): min=9, max=142539, avg=1034.79, stdev=4760.40 00:20:06.795 clat (usec): min=1662, max=313906, avg=88474.91, stdev=50726.50 00:20:06.795 lat (usec): min=1729, max=373508, avg=89509.70, stdev=51315.25 00:20:06.795 clat percentiles (msec): 00:20:06.795 | 1.00th=[ 5], 5.00th=[ 12], 10.00th=[ 31], 20.00th=[ 45], 00:20:06.795 | 30.00th=[ 58], 40.00th=[ 72], 50.00th=[ 82], 60.00th=[ 93], 00:20:06.795 | 70.00th=[ 107], 80.00th=[ 129], 90.00th=[ 165], 95.00th=[ 182], 00:20:06.795 | 99.00th=[ 226], 99.50th=[ 241], 99.90th=[ 305], 99.95th=[ 313], 00:20:06.795 | 99.99th=[ 313] 00:20:06.795 bw ( KiB/s): min=91831, max=386560, per=9.51%, avg=183341.30, stdev=78765.51, samples=20 00:20:06.795 iops : min= 358, max= 1510, avg=716.10, stdev=307.74, samples=20 00:20:06.795 lat (msec) : 2=0.01%, 4=0.86%, 10=3.06%, 20=1.80%, 50=18.37% 00:20:06.795 lat (msec) : 100=41.80%, 250=33.65%, 500=0.46% 00:20:06.795 cpu : usr=0.43%, sys=2.42%, ctx=1501, majf=0, minf=4097 00:20:06.795 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:20:06.795 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:06.795 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:06.795 issued rwts: total=7225,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:06.795 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:06.795 00:20:06.795 Run status group 0 (all jobs): 00:20:06.795 READ: bw=1883MiB/s (1975MB/s), 119MiB/s-237MiB/s (125MB/s-249MB/s), io=18.6GiB (20.0GB), run=10017-10123msec 00:20:06.795 00:20:06.795 Disk stats (read/write): 00:20:06.795 nvme0n1: ios=16017/0, merge=0/0, ticks=1244103/0, in_queue=1244103, util=97.30% 00:20:06.795 nvme10n1: ios=18585/0, merge=0/0, ticks=1241492/0, in_queue=1241492, util=97.52% 00:20:06.795 nvme1n1: ios=11155/0, merge=0/0, ticks=1237501/0, in_queue=1237501, util=97.79% 00:20:06.795 nvme2n1: ios=13206/0, merge=0/0, ticks=1234932/0, in_queue=1234932, util=97.93% 00:20:06.795 nvme3n1: ios=10992/0, merge=0/0, ticks=1229753/0, in_queue=1229753, util=98.01% 00:20:06.795 nvme4n1: ios=18867/0, merge=0/0, ticks=1235447/0, in_queue=1235447, util=98.32% 00:20:06.795 nvme5n1: ios=14166/0, merge=0/0, ticks=1240643/0, in_queue=1240643, util=98.48% 00:20:06.795 nvme6n1: ios=9542/0, merge=0/0, ticks=1234837/0, in_queue=1234837, util=98.58% 00:20:06.795 nvme7n1: ios=10260/0, merge=0/0, ticks=1236930/0, in_queue=1236930, util=98.97% 00:20:06.795 nvme8n1: ios=13211/0, merge=0/0, ticks=1235091/0, in_queue=1235091, util=99.12% 00:20:06.795 nvme9n1: ios=14324/0, merge=0/0, ticks=1235604/0, in_queue=1235604, util=99.24% 00:20:06.795 09:43:27 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:06.795 [global] 00:20:06.795 thread=1 00:20:06.795 invalidate=1 00:20:06.795 rw=randwrite 00:20:06.795 time_based=1 00:20:06.795 runtime=10 00:20:06.795 ioengine=libaio 00:20:06.795 direct=1 00:20:06.795 bs=262144 00:20:06.795 iodepth=64 00:20:06.795 norandommap=1 00:20:06.795 numjobs=1 00:20:06.795 00:20:06.795 [job0] 00:20:06.795 filename=/dev/nvme0n1 00:20:06.795 [job1] 00:20:06.795 filename=/dev/nvme10n1 00:20:06.795 [job2] 00:20:06.795 filename=/dev/nvme1n1 00:20:06.795 [job3] 00:20:06.795 filename=/dev/nvme2n1 00:20:06.795 [job4] 00:20:06.795 filename=/dev/nvme3n1 00:20:06.795 [job5] 00:20:06.795 filename=/dev/nvme4n1 00:20:06.795 [job6] 00:20:06.795 filename=/dev/nvme5n1 00:20:06.795 [job7] 00:20:06.795 filename=/dev/nvme6n1 00:20:06.795 [job8] 00:20:06.795 filename=/dev/nvme7n1 00:20:06.795 [job9] 00:20:06.795 filename=/dev/nvme8n1 00:20:06.795 [job10] 00:20:06.795 filename=/dev/nvme9n1 00:20:06.795 Could not set queue depth (nvme0n1) 00:20:06.795 Could not set queue depth (nvme10n1) 00:20:06.795 Could not set queue depth (nvme1n1) 00:20:06.795 Could not set queue depth (nvme2n1) 00:20:06.795 Could not set queue depth (nvme3n1) 00:20:06.795 Could not set queue depth (nvme4n1) 00:20:06.795 Could not set queue depth (nvme5n1) 00:20:06.795 Could not set queue depth (nvme6n1) 00:20:06.795 Could not set queue depth (nvme7n1) 00:20:06.795 Could not set queue depth (nvme8n1) 00:20:06.795 Could not set queue depth (nvme9n1) 00:20:06.795 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.795 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.795 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.795 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.795 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.795 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.795 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.795 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.795 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.795 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.795 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:06.795 fio-3.35 00:20:06.795 Starting 11 threads 00:20:16.778 00:20:16.778 job0: (groupid=0, jobs=1): err= 0: pid=68006: Fri Nov 29 09:43:38 2024 00:20:16.778 write: IOPS=500, BW=125MiB/s (131MB/s)(1274MiB/10183msec); 0 zone resets 00:20:16.778 slat (usec): min=26, max=64819, avg=1817.94, stdev=3921.52 00:20:16.778 clat (msec): min=3, max=371, avg=125.90, stdev=51.73 00:20:16.778 lat (msec): min=4, max=372, avg=127.72, stdev=52.36 00:20:16.778 clat percentiles (msec): 00:20:16.778 | 1.00th=[ 20], 5.00th=[ 61], 10.00th=[ 79], 20.00th=[ 83], 00:20:16.778 | 30.00th=[ 94], 40.00th=[ 107], 50.00th=[ 114], 60.00th=[ 132], 00:20:16.778 | 70.00th=[ 148], 80.00th=[ 165], 90.00th=[ 194], 95.00th=[ 220], 00:20:16.778 | 99.00th=[ 292], 99.50th=[ 309], 99.90th=[ 363], 99.95th=[ 363], 00:20:16.778 | 99.99th=[ 372] 00:20:16.778 bw ( KiB/s): min=72849, max=206848, per=8.19%, avg=128877.65, stdev=39889.70, samples=20 00:20:16.778 iops : min= 284, max= 808, avg=503.40, stdev=155.86, samples=20 00:20:16.778 lat (msec) : 4=0.02%, 10=0.12%, 20=0.98%, 50=3.10%, 100=29.06% 00:20:16.778 lat (msec) : 250=64.53%, 500=2.20% 00:20:16.778 cpu : usr=1.62%, sys=1.69%, ctx=1725, majf=0, minf=1 00:20:16.778 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:16.778 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.778 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.778 issued rwts: total=0,5097,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.778 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.778 job1: (groupid=0, jobs=1): err= 0: pid=68008: Fri Nov 29 09:43:38 2024 00:20:16.778 write: IOPS=563, BW=141MiB/s (148MB/s)(1434MiB/10180msec); 0 zone resets 00:20:16.778 slat (usec): min=22, max=82832, avg=1420.69, stdev=3670.62 00:20:16.778 clat (msec): min=3, max=321, avg=112.14, stdev=60.36 00:20:16.778 lat (msec): min=5, max=321, avg=113.56, stdev=61.04 00:20:16.778 clat percentiles (msec): 00:20:16.778 | 1.00th=[ 16], 5.00th=[ 34], 10.00th=[ 42], 20.00th=[ 68], 00:20:16.778 | 30.00th=[ 79], 40.00th=[ 84], 50.00th=[ 104], 60.00th=[ 111], 00:20:16.778 | 70.00th=[ 132], 80.00th=[ 157], 90.00th=[ 207], 95.00th=[ 224], 00:20:16.778 | 99.00th=[ 288], 99.50th=[ 300], 99.90th=[ 317], 99.95th=[ 321], 00:20:16.778 | 99.99th=[ 321] 00:20:16.778 bw ( KiB/s): min=51200, max=306176, per=9.22%, avg=145177.60, stdev=59744.40, samples=20 00:20:16.778 iops : min= 200, max= 1196, avg=567.10, stdev=233.38, samples=20 00:20:16.778 lat (msec) : 4=0.02%, 10=0.37%, 20=1.19%, 50=16.06%, 100=29.14% 00:20:16.778 lat (msec) : 250=50.61%, 500=2.62% 00:20:16.778 cpu : usr=1.84%, sys=2.01%, ctx=2565, majf=0, minf=1 00:20:16.778 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:16.778 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.778 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.778 issued rwts: total=0,5734,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.778 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.778 job2: (groupid=0, jobs=1): err= 0: pid=68009: Fri Nov 29 09:43:38 2024 00:20:16.778 write: IOPS=563, BW=141MiB/s (148MB/s)(1419MiB/10063msec); 0 zone resets 00:20:16.778 slat (usec): min=16, max=26778, avg=1353.72, stdev=3047.36 00:20:16.778 clat (usec): min=947, max=251748, avg=112083.37, stdev=48296.04 00:20:16.778 lat (usec): min=973, max=258294, avg=113437.08, stdev=48830.04 00:20:16.778 clat percentiles (msec): 00:20:16.778 | 1.00th=[ 11], 5.00th=[ 37], 10.00th=[ 44], 20.00th=[ 60], 00:20:16.778 | 30.00th=[ 85], 40.00th=[ 110], 50.00th=[ 118], 60.00th=[ 133], 00:20:16.778 | 70.00th=[ 144], 80.00th=[ 150], 90.00th=[ 161], 95.00th=[ 186], 00:20:16.778 | 99.00th=[ 230], 99.50th=[ 234], 99.90th=[ 245], 99.95th=[ 253], 00:20:16.778 | 99.99th=[ 253] 00:20:16.778 bw ( KiB/s): min=92857, max=284160, per=9.13%, avg=143676.45, stdev=48848.04, samples=20 00:20:16.778 iops : min= 362, max= 1110, avg=561.20, stdev=190.85, samples=20 00:20:16.778 lat (usec) : 1000=0.02% 00:20:16.778 lat (msec) : 2=0.16%, 4=0.21%, 10=0.55%, 20=1.25%, 50=14.85% 00:20:16.778 lat (msec) : 100=17.92%, 250=64.97%, 500=0.07% 00:20:16.778 cpu : usr=1.87%, sys=1.83%, ctx=2448, majf=0, minf=1 00:20:16.778 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:16.778 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.778 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.778 issued rwts: total=0,5675,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.778 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.778 job3: (groupid=0, jobs=1): err= 0: pid=68021: Fri Nov 29 09:43:38 2024 00:20:16.778 write: IOPS=566, BW=142MiB/s (148MB/s)(1441MiB/10183msec); 0 zone resets 00:20:16.778 slat (usec): min=24, max=72571, avg=1187.32, stdev=3389.59 00:20:16.778 clat (msec): min=2, max=372, avg=111.78, stdev=64.62 00:20:16.778 lat (msec): min=2, max=372, avg=112.97, stdev=65.46 00:20:16.778 clat percentiles (msec): 00:20:16.778 | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 24], 20.00th=[ 40], 00:20:16.778 | 30.00th=[ 67], 40.00th=[ 105], 50.00th=[ 115], 60.00th=[ 136], 00:20:16.778 | 70.00th=[ 153], 80.00th=[ 169], 90.00th=[ 190], 95.00th=[ 209], 00:20:16.778 | 99.00th=[ 262], 99.50th=[ 300], 99.90th=[ 363], 99.95th=[ 363], 00:20:16.778 | 99.99th=[ 372] 00:20:16.778 bw ( KiB/s): min=92672, max=404480, per=9.27%, avg=145984.75, stdev=68733.45, samples=20 00:20:16.779 iops : min= 362, max= 1580, avg=570.25, stdev=268.49, samples=20 00:20:16.779 lat (msec) : 4=0.17%, 10=0.49%, 20=7.08%, 50=19.51%, 100=11.24% 00:20:16.779 lat (msec) : 250=60.33%, 500=1.18% 00:20:16.779 cpu : usr=1.86%, sys=2.18%, ctx=3516, majf=0, minf=1 00:20:16.779 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:16.779 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.779 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.779 issued rwts: total=0,5765,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.779 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.779 job4: (groupid=0, jobs=1): err= 0: pid=68022: Fri Nov 29 09:43:38 2024 00:20:16.779 write: IOPS=587, BW=147MiB/s (154MB/s)(1495MiB/10183msec); 0 zone resets 00:20:16.779 slat (usec): min=19, max=29825, avg=1295.56, stdev=3162.56 00:20:16.779 clat (usec): min=798, max=370377, avg=107638.42, stdev=61348.86 00:20:16.779 lat (usec): min=825, max=370407, avg=108933.98, stdev=62094.17 00:20:16.779 clat percentiles (msec): 00:20:16.779 | 1.00th=[ 5], 5.00th=[ 22], 10.00th=[ 35], 20.00th=[ 46], 00:20:16.779 | 30.00th=[ 66], 40.00th=[ 88], 50.00th=[ 108], 60.00th=[ 117], 00:20:16.779 | 70.00th=[ 130], 80.00th=[ 163], 90.00th=[ 197], 95.00th=[ 211], 00:20:16.779 | 99.00th=[ 268], 99.50th=[ 296], 99.90th=[ 359], 99.95th=[ 359], 00:20:16.779 | 99.99th=[ 372] 00:20:16.779 bw ( KiB/s): min=74240, max=344576, per=9.62%, avg=151459.30, stdev=72991.23, samples=20 00:20:16.779 iops : min= 290, max= 1346, avg=591.60, stdev=285.15, samples=20 00:20:16.779 lat (usec) : 1000=0.05% 00:20:16.779 lat (msec) : 2=0.18%, 4=0.49%, 10=1.61%, 20=2.09%, 50=19.22% 00:20:16.779 lat (msec) : 100=21.29%, 250=53.89%, 500=1.19% 00:20:16.779 cpu : usr=1.93%, sys=1.91%, ctx=2911, majf=0, minf=1 00:20:16.779 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:16.779 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.779 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.779 issued rwts: total=0,5979,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.779 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.779 job5: (groupid=0, jobs=1): err= 0: pid=68023: Fri Nov 29 09:43:38 2024 00:20:16.779 write: IOPS=499, BW=125MiB/s (131MB/s)(1256MiB/10062msec); 0 zone resets 00:20:16.779 slat (usec): min=20, max=26520, avg=1669.44, stdev=3552.97 00:20:16.779 clat (msec): min=2, max=234, avg=126.42, stdev=44.30 00:20:16.779 lat (msec): min=2, max=242, avg=128.09, stdev=44.96 00:20:16.779 clat percentiles (msec): 00:20:16.779 | 1.00th=[ 15], 5.00th=[ 43], 10.00th=[ 72], 20.00th=[ 89], 00:20:16.779 | 30.00th=[ 109], 40.00th=[ 117], 50.00th=[ 131], 60.00th=[ 144], 00:20:16.779 | 70.00th=[ 150], 80.00th=[ 155], 90.00th=[ 186], 95.00th=[ 205], 00:20:16.779 | 99.00th=[ 226], 99.50th=[ 230], 99.90th=[ 232], 99.95th=[ 234], 00:20:16.779 | 99.99th=[ 234] 00:20:16.779 bw ( KiB/s): min=83968, max=164864, per=8.07%, avg=127042.55, stdev=21649.91, samples=20 00:20:16.779 iops : min= 328, max= 644, avg=496.25, stdev=84.56, samples=20 00:20:16.779 lat (msec) : 4=0.14%, 10=0.56%, 20=0.98%, 50=4.18%, 100=18.19% 00:20:16.779 lat (msec) : 250=75.96% 00:20:16.779 cpu : usr=1.77%, sys=1.77%, ctx=2102, majf=0, minf=2 00:20:16.779 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:16.779 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.779 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.779 issued rwts: total=0,5025,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.779 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.779 job6: (groupid=0, jobs=1): err= 0: pid=68024: Fri Nov 29 09:43:38 2024 00:20:16.779 write: IOPS=658, BW=165MiB/s (173MB/s)(1657MiB/10064msec); 0 zone resets 00:20:16.779 slat (usec): min=16, max=45141, avg=1040.62, stdev=2744.24 00:20:16.779 clat (usec): min=925, max=244287, avg=96120.35, stdev=49961.58 00:20:16.779 lat (usec): min=995, max=249821, avg=97160.97, stdev=50550.99 00:20:16.779 clat percentiles (msec): 00:20:16.779 | 1.00th=[ 5], 5.00th=[ 18], 10.00th=[ 33], 20.00th=[ 48], 00:20:16.779 | 30.00th=[ 63], 40.00th=[ 78], 50.00th=[ 103], 60.00th=[ 112], 00:20:16.779 | 70.00th=[ 118], 80.00th=[ 138], 90.00th=[ 167], 95.00th=[ 184], 00:20:16.779 | 99.00th=[ 220], 99.50th=[ 228], 99.90th=[ 241], 99.95th=[ 243], 00:20:16.779 | 99.99th=[ 245] 00:20:16.779 bw ( KiB/s): min=103424, max=290816, per=10.67%, avg=168012.80, stdev=49847.23, samples=20 00:20:16.779 iops : min= 404, max= 1136, avg=656.30, stdev=194.72, samples=20 00:20:16.779 lat (usec) : 1000=0.06% 00:20:16.779 lat (msec) : 2=0.20%, 4=0.65%, 10=2.07%, 20=2.52%, 50=16.96% 00:20:16.779 lat (msec) : 100=26.53%, 250=51.01% 00:20:16.779 cpu : usr=2.23%, sys=2.42%, ctx=3656, majf=0, minf=1 00:20:16.779 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:16.779 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.779 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.779 issued rwts: total=0,6626,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.779 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.779 job7: (groupid=0, jobs=1): err= 0: pid=68025: Fri Nov 29 09:43:38 2024 00:20:16.779 write: IOPS=683, BW=171MiB/s (179MB/s)(1730MiB/10127msec); 0 zone resets 00:20:16.779 slat (usec): min=17, max=53444, avg=1184.55, stdev=2880.82 00:20:16.779 clat (usec): min=778, max=356516, avg=92421.47, stdev=52256.99 00:20:16.779 lat (usec): min=819, max=356554, avg=93606.02, stdev=52916.74 00:20:16.779 clat percentiles (msec): 00:20:16.779 | 1.00th=[ 7], 5.00th=[ 23], 10.00th=[ 41], 20.00th=[ 47], 00:20:16.779 | 30.00th=[ 54], 40.00th=[ 65], 50.00th=[ 82], 60.00th=[ 104], 00:20:16.779 | 70.00th=[ 125], 80.00th=[ 138], 90.00th=[ 157], 95.00th=[ 188], 00:20:16.779 | 99.00th=[ 224], 99.50th=[ 251], 99.90th=[ 334], 99.95th=[ 347], 00:20:16.779 | 99.99th=[ 359] 00:20:16.779 bw ( KiB/s): min=72192, max=297984, per=11.15%, avg=175539.20, stdev=65978.35, samples=20 00:20:16.779 iops : min= 282, max= 1164, avg=685.70, stdev=257.73, samples=20 00:20:16.779 lat (usec) : 1000=0.03% 00:20:16.779 lat (msec) : 2=0.09%, 4=0.36%, 10=1.40%, 20=2.41%, 50=19.12% 00:20:16.779 lat (msec) : 100=35.77%, 250=40.27%, 500=0.55% 00:20:16.779 cpu : usr=2.27%, sys=2.32%, ctx=2914, majf=0, minf=1 00:20:16.779 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:16.779 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.779 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.779 issued rwts: total=0,6920,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.779 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.779 job8: (groupid=0, jobs=1): err= 0: pid=68028: Fri Nov 29 09:43:38 2024 00:20:16.779 write: IOPS=551, BW=138MiB/s (145MB/s)(1397MiB/10128msec); 0 zone resets 00:20:16.779 slat (usec): min=25, max=110740, avg=1310.14, stdev=3699.23 00:20:16.779 clat (msec): min=3, max=334, avg=114.63, stdev=48.52 00:20:16.779 lat (msec): min=4, max=334, avg=115.94, stdev=49.17 00:20:16.779 clat percentiles (msec): 00:20:16.779 | 1.00th=[ 9], 5.00th=[ 25], 10.00th=[ 46], 20.00th=[ 77], 00:20:16.779 | 30.00th=[ 90], 40.00th=[ 111], 50.00th=[ 120], 60.00th=[ 132], 00:20:16.779 | 70.00th=[ 142], 80.00th=[ 148], 90.00th=[ 167], 95.00th=[ 180], 00:20:16.779 | 99.00th=[ 253], 99.50th=[ 288], 99.90th=[ 317], 99.95th=[ 326], 00:20:16.779 | 99.99th=[ 334] 00:20:16.779 bw ( KiB/s): min=108544, max=214528, per=8.98%, avg=141388.80, stdev=31530.87, samples=20 00:20:16.779 iops : min= 424, max= 838, avg=552.30, stdev=123.17, samples=20 00:20:16.779 lat (msec) : 4=0.04%, 10=1.32%, 20=2.65%, 50=7.12%, 100=23.22% 00:20:16.779 lat (msec) : 250=64.63%, 500=1.02% 00:20:16.779 cpu : usr=1.91%, sys=2.05%, ctx=2861, majf=0, minf=1 00:20:16.779 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:16.779 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.779 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.779 issued rwts: total=0,5586,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.779 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.779 job9: (groupid=0, jobs=1): err= 0: pid=68029: Fri Nov 29 09:43:38 2024 00:20:16.779 write: IOPS=495, BW=124MiB/s (130MB/s)(1255MiB/10129msec); 0 zone resets 00:20:16.779 slat (usec): min=16, max=77020, avg=1484.30, stdev=3862.94 00:20:16.779 clat (usec): min=893, max=306447, avg=127574.99, stdev=60327.40 00:20:16.779 lat (usec): min=932, max=306493, avg=129059.29, stdev=61099.43 00:20:16.779 clat percentiles (msec): 00:20:16.779 | 1.00th=[ 5], 5.00th=[ 21], 10.00th=[ 35], 20.00th=[ 75], 00:20:16.779 | 30.00th=[ 107], 40.00th=[ 122], 50.00th=[ 136], 60.00th=[ 142], 00:20:16.779 | 70.00th=[ 153], 80.00th=[ 176], 90.00th=[ 205], 95.00th=[ 222], 00:20:16.779 | 99.00th=[ 275], 99.50th=[ 284], 99.90th=[ 296], 99.95th=[ 296], 00:20:16.779 | 99.99th=[ 309] 00:20:16.779 bw ( KiB/s): min=63488, max=195584, per=8.06%, avg=126899.20, stdev=34985.70, samples=20 00:20:16.779 iops : min= 248, max= 764, avg=495.70, stdev=136.66, samples=20 00:20:16.779 lat (usec) : 1000=0.02% 00:20:16.779 lat (msec) : 2=0.16%, 4=0.76%, 10=1.10%, 20=2.63%, 50=9.50% 00:20:16.779 lat (msec) : 100=12.41%, 250=70.36%, 500=3.07% 00:20:16.779 cpu : usr=1.48%, sys=1.96%, ctx=2625, majf=0, minf=1 00:20:16.779 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:16.779 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.779 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.779 issued rwts: total=0,5020,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.779 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.779 job10: (groupid=0, jobs=1): err= 0: pid=68030: Fri Nov 29 09:43:38 2024 00:20:16.779 write: IOPS=509, BW=127MiB/s (134MB/s)(1298MiB/10184msec); 0 zone resets 00:20:16.779 slat (usec): min=21, max=21953, avg=1396.38, stdev=3403.46 00:20:16.779 clat (usec): min=1018, max=371211, avg=124102.68, stdev=58259.37 00:20:16.779 lat (usec): min=1073, max=371241, avg=125499.06, stdev=58950.71 00:20:16.779 clat percentiles (msec): 00:20:16.779 | 1.00th=[ 5], 5.00th=[ 20], 10.00th=[ 37], 20.00th=[ 63], 00:20:16.779 | 30.00th=[ 107], 40.00th=[ 118], 50.00th=[ 130], 60.00th=[ 146], 00:20:16.779 | 70.00th=[ 155], 80.00th=[ 167], 90.00th=[ 194], 95.00th=[ 211], 00:20:16.779 | 99.00th=[ 239], 99.50th=[ 309], 99.90th=[ 363], 99.95th=[ 363], 00:20:16.779 | 99.99th=[ 372] 00:20:16.779 bw ( KiB/s): min=81920, max=244736, per=8.34%, avg=131251.20, stdev=40908.19, samples=20 00:20:16.779 iops : min= 320, max= 956, avg=512.70, stdev=159.80, samples=20 00:20:16.779 lat (msec) : 2=0.19%, 4=0.60%, 10=1.91%, 20=2.66%, 50=10.33% 00:20:16.779 lat (msec) : 100=11.54%, 250=71.97%, 500=0.81% 00:20:16.780 cpu : usr=1.69%, sys=1.92%, ctx=2728, majf=0, minf=1 00:20:16.780 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:16.780 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:16.780 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:16.780 issued rwts: total=0,5190,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:16.780 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:16.780 00:20:16.780 Run status group 0 (all jobs): 00:20:16.780 WRITE: bw=1537MiB/s (1612MB/s), 124MiB/s-171MiB/s (130MB/s-179MB/s), io=15.3GiB (16.4GB), run=10062-10184msec 00:20:16.780 00:20:16.780 Disk stats (read/write): 00:20:16.780 nvme0n1: ios=51/10035, merge=0/0, ticks=628/1206462, in_queue=1207090, util=99.56% 00:20:16.780 nvme10n1: ios=49/11312, merge=0/0, ticks=35/1217539, in_queue=1217574, util=97.57% 00:20:16.780 nvme1n1: ios=49/11120, merge=0/0, ticks=209/1220930, in_queue=1221139, util=98.23% 00:20:16.780 nvme2n1: ios=43/11371, merge=0/0, ticks=35/1218381, in_queue=1218416, util=97.98% 00:20:16.780 nvme3n1: ios=20/11958, merge=0/0, ticks=428/1245690, in_queue=1246118, util=98.70% 00:20:16.780 nvme4n1: ios=44/9769, merge=0/0, ticks=117/1212164, in_queue=1212281, util=99.13% 00:20:16.780 nvme5n1: ios=13/12898, merge=0/0, ticks=12/1218418, in_queue=1218430, util=98.35% 00:20:16.780 nvme6n1: ios=0/13694, merge=0/0, ticks=0/1210323, in_queue=1210323, util=98.42% 00:20:16.780 nvme7n1: ios=45/11002, merge=0/0, ticks=1464/1198147, in_queue=1199611, util=100.00% 00:20:16.780 nvme8n1: ios=41/9868, merge=0/0, ticks=73/1214390, in_queue=1214463, util=99.56% 00:20:16.780 nvme9n1: ios=15/10220, merge=0/0, ticks=15/1217257, in_queue=1217272, util=99.16% 00:20:16.780 09:43:38 -- target/multiconnection.sh@36 -- # sync 00:20:16.780 09:43:38 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:16.780 09:43:38 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.780 09:43:38 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:16.780 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:16.780 09:43:38 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:16.780 09:43:38 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.780 09:43:38 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.780 09:43:38 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:20:16.780 09:43:38 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.780 09:43:38 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:20:16.780 09:43:38 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.780 09:43:38 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:16.780 09:43:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.780 09:43:38 -- common/autotest_common.sh@10 -- # set +x 00:20:16.780 09:43:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.780 09:43:38 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.780 09:43:38 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:16.780 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:16.780 09:43:39 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:16.780 09:43:39 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.780 09:43:39 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.780 09:43:39 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:20:16.780 09:43:39 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.780 09:43:39 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:20:16.780 09:43:39 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.780 09:43:39 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:16.780 09:43:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.780 09:43:39 -- common/autotest_common.sh@10 -- # set +x 00:20:16.780 09:43:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.780 09:43:39 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.780 09:43:39 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:16.780 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:16.780 09:43:39 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:16.780 09:43:39 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.780 09:43:39 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.780 09:43:39 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:20:16.780 09:43:39 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.780 09:43:39 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:20:16.780 09:43:39 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.780 09:43:39 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:16.780 09:43:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.780 09:43:39 -- common/autotest_common.sh@10 -- # set +x 00:20:16.780 09:43:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.780 09:43:39 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.780 09:43:39 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:17.040 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:17.040 09:43:39 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:17.040 09:43:39 -- common/autotest_common.sh@1208 -- # local i=0 00:20:17.040 09:43:39 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:17.040 09:43:39 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:20:17.040 09:43:39 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:17.040 09:43:39 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:20:17.040 09:43:39 -- common/autotest_common.sh@1220 -- # return 0 00:20:17.040 09:43:39 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:17.040 09:43:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.040 09:43:39 -- common/autotest_common.sh@10 -- # set +x 00:20:17.040 09:43:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.040 09:43:39 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:17.040 09:43:39 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:17.040 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:17.040 09:43:39 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:17.040 09:43:39 -- common/autotest_common.sh@1208 -- # local i=0 00:20:17.040 09:43:39 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:17.040 09:43:39 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:20:17.040 09:43:39 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:17.040 09:43:39 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:20:17.040 09:43:39 -- common/autotest_common.sh@1220 -- # return 0 00:20:17.040 09:43:39 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:17.040 09:43:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.040 09:43:39 -- common/autotest_common.sh@10 -- # set +x 00:20:17.040 09:43:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.040 09:43:39 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:17.040 09:43:39 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:17.300 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:17.300 09:43:40 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:17.300 09:43:40 -- common/autotest_common.sh@1208 -- # local i=0 00:20:17.300 09:43:40 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:17.301 09:43:40 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:20:17.301 09:43:40 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:17.301 09:43:40 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:20:17.301 09:43:40 -- common/autotest_common.sh@1220 -- # return 0 00:20:17.301 09:43:40 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:17.301 09:43:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.301 09:43:40 -- common/autotest_common.sh@10 -- # set +x 00:20:17.301 09:43:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.301 09:43:40 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:17.301 09:43:40 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:17.561 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:17.561 09:43:40 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:17.561 09:43:40 -- common/autotest_common.sh@1208 -- # local i=0 00:20:17.561 09:43:40 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:17.561 09:43:40 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:20:17.561 09:43:40 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:17.561 09:43:40 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:20:17.561 09:43:40 -- common/autotest_common.sh@1220 -- # return 0 00:20:17.561 09:43:40 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:17.561 09:43:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.561 09:43:40 -- common/autotest_common.sh@10 -- # set +x 00:20:17.561 09:43:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.561 09:43:40 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:17.561 09:43:40 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:17.820 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:17.820 09:43:40 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:17.820 09:43:40 -- common/autotest_common.sh@1208 -- # local i=0 00:20:17.820 09:43:40 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:17.820 09:43:40 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:20:17.820 09:43:40 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:17.820 09:43:40 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:20:17.820 09:43:40 -- common/autotest_common.sh@1220 -- # return 0 00:20:17.820 09:43:40 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:17.820 09:43:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.820 09:43:40 -- common/autotest_common.sh@10 -- # set +x 00:20:17.820 09:43:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.820 09:43:40 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:17.820 09:43:40 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:18.079 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:18.079 09:43:40 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:18.079 09:43:40 -- common/autotest_common.sh@1208 -- # local i=0 00:20:18.079 09:43:40 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:18.079 09:43:40 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:20:18.079 09:43:40 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:18.079 09:43:40 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:20:18.079 09:43:40 -- common/autotest_common.sh@1220 -- # return 0 00:20:18.079 09:43:40 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:18.079 09:43:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:18.079 09:43:40 -- common/autotest_common.sh@10 -- # set +x 00:20:18.079 09:43:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:18.079 09:43:40 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:18.079 09:43:40 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:18.079 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:18.079 09:43:40 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:18.079 09:43:40 -- common/autotest_common.sh@1208 -- # local i=0 00:20:18.079 09:43:40 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:18.079 09:43:40 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:20:18.079 09:43:40 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:18.079 09:43:40 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:20:18.079 09:43:40 -- common/autotest_common.sh@1220 -- # return 0 00:20:18.079 09:43:40 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:18.079 09:43:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:18.079 09:43:40 -- common/autotest_common.sh@10 -- # set +x 00:20:18.079 09:43:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:18.079 09:43:40 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:18.079 09:43:40 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:18.337 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:18.337 09:43:40 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:18.337 09:43:40 -- common/autotest_common.sh@1208 -- # local i=0 00:20:18.337 09:43:40 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:18.337 09:43:40 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:20:18.337 09:43:40 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:18.337 09:43:40 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:20:18.337 09:43:40 -- common/autotest_common.sh@1220 -- # return 0 00:20:18.337 09:43:41 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:18.337 09:43:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:18.337 09:43:41 -- common/autotest_common.sh@10 -- # set +x 00:20:18.337 09:43:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:18.337 09:43:41 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:18.337 09:43:41 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:18.337 09:43:41 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:18.337 09:43:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:18.337 09:43:41 -- nvmf/common.sh@116 -- # sync 00:20:18.337 09:43:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:18.337 09:43:41 -- nvmf/common.sh@119 -- # set +e 00:20:18.337 09:43:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:18.337 09:43:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:18.337 rmmod nvme_tcp 00:20:18.337 rmmod nvme_fabrics 00:20:18.337 rmmod nvme_keyring 00:20:18.337 09:43:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:18.337 09:43:41 -- nvmf/common.sh@123 -- # set -e 00:20:18.337 09:43:41 -- nvmf/common.sh@124 -- # return 0 00:20:18.337 09:43:41 -- nvmf/common.sh@477 -- # '[' -n 62417 ']' 00:20:18.337 09:43:41 -- nvmf/common.sh@478 -- # killprocess 62417 00:20:18.337 09:43:41 -- common/autotest_common.sh@936 -- # '[' -z 62417 ']' 00:20:18.337 09:43:41 -- common/autotest_common.sh@940 -- # kill -0 62417 00:20:18.337 09:43:41 -- common/autotest_common.sh@941 -- # uname 00:20:18.337 09:43:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:18.337 09:43:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 62417 00:20:18.337 09:43:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:18.337 09:43:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:18.337 09:43:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 62417' 00:20:18.337 killing process with pid 62417 00:20:18.337 09:43:41 -- common/autotest_common.sh@955 -- # kill 62417 00:20:18.337 09:43:41 -- common/autotest_common.sh@960 -- # wait 62417 00:20:18.905 09:43:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:18.905 09:43:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:18.905 09:43:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:18.905 09:43:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:18.905 09:43:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:18.905 09:43:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:18.905 09:43:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:18.905 09:43:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:21.444 09:43:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:21.444 00:20:21.444 real 1m1.376s 00:20:21.444 user 3m25.439s 00:20:21.444 sys 0m25.848s 00:20:21.444 09:43:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:21.444 09:43:43 -- common/autotest_common.sh@10 -- # set +x 00:20:21.444 ************************************ 00:20:21.444 END TEST nvmf_multiconnection 00:20:21.444 ************************************ 00:20:21.444 09:43:43 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:21.444 09:43:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:21.444 09:43:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:21.444 09:43:43 -- common/autotest_common.sh@10 -- # set +x 00:20:21.444 ************************************ 00:20:21.444 START TEST nvmf_initiator_timeout 00:20:21.444 ************************************ 00:20:21.444 09:43:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:21.444 * Looking for test storage... 00:20:21.444 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:21.444 09:43:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:21.444 09:43:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:21.444 09:43:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:21.444 09:43:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:21.444 09:43:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:21.444 09:43:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:21.444 09:43:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:21.444 09:43:43 -- scripts/common.sh@335 -- # IFS=.-: 00:20:21.444 09:43:43 -- scripts/common.sh@335 -- # read -ra ver1 00:20:21.444 09:43:43 -- scripts/common.sh@336 -- # IFS=.-: 00:20:21.444 09:43:43 -- scripts/common.sh@336 -- # read -ra ver2 00:20:21.444 09:43:43 -- scripts/common.sh@337 -- # local 'op=<' 00:20:21.444 09:43:43 -- scripts/common.sh@339 -- # ver1_l=2 00:20:21.444 09:43:43 -- scripts/common.sh@340 -- # ver2_l=1 00:20:21.444 09:43:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:21.444 09:43:43 -- scripts/common.sh@343 -- # case "$op" in 00:20:21.444 09:43:43 -- scripts/common.sh@344 -- # : 1 00:20:21.444 09:43:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:21.444 09:43:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:21.444 09:43:43 -- scripts/common.sh@364 -- # decimal 1 00:20:21.444 09:43:43 -- scripts/common.sh@352 -- # local d=1 00:20:21.444 09:43:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:21.444 09:43:43 -- scripts/common.sh@354 -- # echo 1 00:20:21.444 09:43:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:21.444 09:43:43 -- scripts/common.sh@365 -- # decimal 2 00:20:21.444 09:43:43 -- scripts/common.sh@352 -- # local d=2 00:20:21.444 09:43:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:21.444 09:43:43 -- scripts/common.sh@354 -- # echo 2 00:20:21.444 09:43:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:21.444 09:43:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:21.444 09:43:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:21.444 09:43:43 -- scripts/common.sh@367 -- # return 0 00:20:21.444 09:43:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:21.444 09:43:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:21.444 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:21.444 --rc genhtml_branch_coverage=1 00:20:21.444 --rc genhtml_function_coverage=1 00:20:21.444 --rc genhtml_legend=1 00:20:21.444 --rc geninfo_all_blocks=1 00:20:21.444 --rc geninfo_unexecuted_blocks=1 00:20:21.444 00:20:21.444 ' 00:20:21.444 09:43:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:21.444 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:21.444 --rc genhtml_branch_coverage=1 00:20:21.444 --rc genhtml_function_coverage=1 00:20:21.444 --rc genhtml_legend=1 00:20:21.444 --rc geninfo_all_blocks=1 00:20:21.444 --rc geninfo_unexecuted_blocks=1 00:20:21.444 00:20:21.444 ' 00:20:21.444 09:43:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:21.444 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:21.444 --rc genhtml_branch_coverage=1 00:20:21.444 --rc genhtml_function_coverage=1 00:20:21.444 --rc genhtml_legend=1 00:20:21.444 --rc geninfo_all_blocks=1 00:20:21.445 --rc geninfo_unexecuted_blocks=1 00:20:21.445 00:20:21.445 ' 00:20:21.445 09:43:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:21.445 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:21.445 --rc genhtml_branch_coverage=1 00:20:21.445 --rc genhtml_function_coverage=1 00:20:21.445 --rc genhtml_legend=1 00:20:21.445 --rc geninfo_all_blocks=1 00:20:21.445 --rc geninfo_unexecuted_blocks=1 00:20:21.445 00:20:21.445 ' 00:20:21.445 09:43:43 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:21.445 09:43:43 -- nvmf/common.sh@7 -- # uname -s 00:20:21.445 09:43:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:21.445 09:43:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:21.445 09:43:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:21.445 09:43:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:21.445 09:43:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:21.445 09:43:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:21.445 09:43:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:21.445 09:43:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:21.445 09:43:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:21.445 09:43:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:21.445 09:43:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:21.445 09:43:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:21.445 09:43:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:21.445 09:43:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:21.445 09:43:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:21.445 09:43:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:21.445 09:43:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:21.445 09:43:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:21.445 09:43:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:21.445 09:43:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:21.445 09:43:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:21.445 09:43:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:21.445 09:43:43 -- paths/export.sh@5 -- # export PATH 00:20:21.445 09:43:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:21.445 09:43:43 -- nvmf/common.sh@46 -- # : 0 00:20:21.445 09:43:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:21.445 09:43:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:21.445 09:43:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:21.445 09:43:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:21.445 09:43:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:21.445 09:43:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:21.445 09:43:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:21.445 09:43:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:21.445 09:43:43 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:21.445 09:43:43 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:21.445 09:43:43 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:21.445 09:43:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:21.445 09:43:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:21.445 09:43:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:21.445 09:43:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:21.445 09:43:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:21.445 09:43:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:21.445 09:43:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:21.445 09:43:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:21.445 09:43:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:21.445 09:43:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:21.445 09:43:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:21.445 09:43:43 -- common/autotest_common.sh@10 -- # set +x 00:20:23.349 09:43:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:23.349 09:43:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:23.349 09:43:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:23.349 09:43:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:23.349 09:43:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:23.349 09:43:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:23.349 09:43:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:23.349 09:43:45 -- nvmf/common.sh@294 -- # net_devs=() 00:20:23.349 09:43:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:23.349 09:43:45 -- nvmf/common.sh@295 -- # e810=() 00:20:23.349 09:43:45 -- nvmf/common.sh@295 -- # local -ga e810 00:20:23.349 09:43:45 -- nvmf/common.sh@296 -- # x722=() 00:20:23.349 09:43:45 -- nvmf/common.sh@296 -- # local -ga x722 00:20:23.349 09:43:45 -- nvmf/common.sh@297 -- # mlx=() 00:20:23.349 09:43:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:23.349 09:43:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:23.349 09:43:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:23.349 09:43:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:23.349 09:43:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:23.349 09:43:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:23.349 09:43:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:23.349 09:43:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:23.349 09:43:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:23.349 09:43:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:23.349 09:43:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:23.349 09:43:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:23.349 09:43:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:23.349 09:43:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:23.349 09:43:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:23.349 09:43:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:23.349 09:43:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:23.349 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:23.349 09:43:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:23.349 09:43:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:23.349 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:23.349 09:43:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:23.349 09:43:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:23.349 09:43:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:23.349 09:43:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:23.349 09:43:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:23.349 09:43:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:23.349 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:23.349 09:43:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:23.349 09:43:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:23.349 09:43:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:23.349 09:43:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:23.349 09:43:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:23.349 09:43:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:23.349 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:23.349 09:43:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:23.349 09:43:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:23.349 09:43:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:23.349 09:43:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:23.349 09:43:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:23.349 09:43:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:23.349 09:43:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:23.349 09:43:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:23.349 09:43:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:23.349 09:43:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:23.349 09:43:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:23.350 09:43:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:23.350 09:43:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:23.350 09:43:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:23.350 09:43:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:23.350 09:43:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:23.350 09:43:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:23.350 09:43:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:23.350 09:43:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:23.350 09:43:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:23.350 09:43:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:23.350 09:43:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:23.350 09:43:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:23.350 09:43:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:23.350 09:43:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:23.350 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:23.350 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.337 ms 00:20:23.350 00:20:23.350 --- 10.0.0.2 ping statistics --- 00:20:23.350 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:23.350 rtt min/avg/max/mdev = 0.337/0.337/0.337/0.000 ms 00:20:23.350 09:43:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:23.350 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:23.350 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:20:23.350 00:20:23.350 --- 10.0.0.1 ping statistics --- 00:20:23.350 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:23.350 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:20:23.350 09:43:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:23.350 09:43:46 -- nvmf/common.sh@410 -- # return 0 00:20:23.350 09:43:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:23.350 09:43:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:23.350 09:43:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:23.350 09:43:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:23.350 09:43:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:23.350 09:43:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:23.350 09:43:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:23.350 09:43:46 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:23.350 09:43:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:23.350 09:43:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:23.350 09:43:46 -- common/autotest_common.sh@10 -- # set +x 00:20:23.350 09:43:46 -- nvmf/common.sh@469 -- # nvmfpid=71413 00:20:23.350 09:43:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:23.350 09:43:46 -- nvmf/common.sh@470 -- # waitforlisten 71413 00:20:23.350 09:43:46 -- common/autotest_common.sh@829 -- # '[' -z 71413 ']' 00:20:23.350 09:43:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:23.350 09:43:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:23.350 09:43:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:23.350 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:23.350 09:43:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:23.350 09:43:46 -- common/autotest_common.sh@10 -- # set +x 00:20:23.350 [2024-11-29 09:43:46.109844] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:23.350 [2024-11-29 09:43:46.109912] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:23.350 EAL: No free 2048 kB hugepages reported on node 1 00:20:23.350 [2024-11-29 09:43:46.172858] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:23.609 [2024-11-29 09:43:46.280619] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:23.609 [2024-11-29 09:43:46.280771] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:23.609 [2024-11-29 09:43:46.280789] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:23.609 [2024-11-29 09:43:46.280803] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:23.609 [2024-11-29 09:43:46.280866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:23.609 [2024-11-29 09:43:46.280935] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:23.609 [2024-11-29 09:43:46.281023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:23.609 [2024-11-29 09:43:46.281026] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:24.543 09:43:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:24.543 09:43:47 -- common/autotest_common.sh@862 -- # return 0 00:20:24.543 09:43:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:24.543 09:43:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:24.543 09:43:47 -- common/autotest_common.sh@10 -- # set +x 00:20:24.543 09:43:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:24.543 09:43:47 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:24.543 09:43:47 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:24.543 09:43:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.543 09:43:47 -- common/autotest_common.sh@10 -- # set +x 00:20:24.543 Malloc0 00:20:24.543 09:43:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.543 09:43:47 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:24.543 09:43:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.543 09:43:47 -- common/autotest_common.sh@10 -- # set +x 00:20:24.543 Delay0 00:20:24.543 09:43:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.543 09:43:47 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:24.543 09:43:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.543 09:43:47 -- common/autotest_common.sh@10 -- # set +x 00:20:24.543 [2024-11-29 09:43:47.174445] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:24.543 09:43:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.543 09:43:47 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:24.543 09:43:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.543 09:43:47 -- common/autotest_common.sh@10 -- # set +x 00:20:24.543 09:43:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.543 09:43:47 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:24.543 09:43:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.543 09:43:47 -- common/autotest_common.sh@10 -- # set +x 00:20:24.543 09:43:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.543 09:43:47 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:24.543 09:43:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.543 09:43:47 -- common/autotest_common.sh@10 -- # set +x 00:20:24.543 [2024-11-29 09:43:47.202770] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:24.543 09:43:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.543 09:43:47 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:25.109 09:43:47 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:25.109 09:43:47 -- common/autotest_common.sh@1187 -- # local i=0 00:20:25.109 09:43:47 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:25.109 09:43:47 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:25.109 09:43:47 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:27.648 09:43:49 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:27.648 09:43:49 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:27.648 09:43:49 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:27.648 09:43:49 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:27.648 09:43:49 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:27.648 09:43:49 -- common/autotest_common.sh@1197 -- # return 0 00:20:27.648 09:43:49 -- target/initiator_timeout.sh@35 -- # fio_pid=71962 00:20:27.648 09:43:49 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:27.648 09:43:49 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:27.648 [global] 00:20:27.648 thread=1 00:20:27.648 invalidate=1 00:20:27.648 rw=write 00:20:27.648 time_based=1 00:20:27.648 runtime=60 00:20:27.648 ioengine=libaio 00:20:27.648 direct=1 00:20:27.648 bs=4096 00:20:27.648 iodepth=1 00:20:27.648 norandommap=0 00:20:27.648 numjobs=1 00:20:27.648 00:20:27.648 verify_dump=1 00:20:27.648 verify_backlog=512 00:20:27.648 verify_state_save=0 00:20:27.648 do_verify=1 00:20:27.648 verify=crc32c-intel 00:20:27.648 [job0] 00:20:27.648 filename=/dev/nvme0n1 00:20:27.648 Could not set queue depth (nvme0n1) 00:20:27.648 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:27.648 fio-3.35 00:20:27.648 Starting 1 thread 00:20:30.182 09:43:52 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:30.182 09:43:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.182 09:43:52 -- common/autotest_common.sh@10 -- # set +x 00:20:30.182 true 00:20:30.182 09:43:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.182 09:43:52 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:30.182 09:43:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.182 09:43:52 -- common/autotest_common.sh@10 -- # set +x 00:20:30.182 true 00:20:30.182 09:43:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.182 09:43:52 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:30.182 09:43:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.182 09:43:52 -- common/autotest_common.sh@10 -- # set +x 00:20:30.182 true 00:20:30.182 09:43:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.182 09:43:52 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:30.182 09:43:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.182 09:43:52 -- common/autotest_common.sh@10 -- # set +x 00:20:30.182 true 00:20:30.182 09:43:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.182 09:43:52 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:33.472 09:43:55 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:33.472 09:43:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.472 09:43:55 -- common/autotest_common.sh@10 -- # set +x 00:20:33.472 true 00:20:33.472 09:43:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.472 09:43:55 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:33.472 09:43:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.472 09:43:55 -- common/autotest_common.sh@10 -- # set +x 00:20:33.472 true 00:20:33.472 09:43:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.472 09:43:55 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:33.472 09:43:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.472 09:43:55 -- common/autotest_common.sh@10 -- # set +x 00:20:33.472 true 00:20:33.472 09:43:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.472 09:43:55 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:33.472 09:43:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:33.472 09:43:55 -- common/autotest_common.sh@10 -- # set +x 00:20:33.472 true 00:20:33.472 09:43:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:33.472 09:43:55 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:33.472 09:43:55 -- target/initiator_timeout.sh@54 -- # wait 71962 00:21:29.769 00:21:29.769 job0: (groupid=0, jobs=1): err= 0: pid=72057: Fri Nov 29 09:44:50 2024 00:21:29.769 read: IOPS=45, BW=182KiB/s (187kB/s)(10.7MiB/60016msec) 00:21:29.769 slat (usec): min=5, max=6887, avg=14.94, stdev=131.69 00:21:29.769 clat (usec): min=218, max=41124k, avg=21650.28, stdev=786223.39 00:21:29.769 lat (usec): min=224, max=41124k, avg=21665.22, stdev=786223.53 00:21:29.769 clat percentiles (usec): 00:21:29.769 | 1.00th=[ 231], 5.00th=[ 237], 10.00th=[ 241], 00:21:29.769 | 20.00th=[ 247], 30.00th=[ 251], 40.00th=[ 255], 00:21:29.769 | 50.00th=[ 262], 60.00th=[ 273], 70.00th=[ 281], 00:21:29.769 | 80.00th=[ 289], 90.00th=[ 41157], 95.00th=[ 42206], 00:21:29.769 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42206], 00:21:29.769 | 99.95th=[ 42206], 99.99th=[17112761] 00:21:29.769 write: IOPS=51, BW=205KiB/s (210kB/s)(12.0MiB/60016msec); 0 zone resets 00:21:29.769 slat (usec): min=7, max=28605, avg=23.17, stdev=515.91 00:21:29.769 clat (usec): min=172, max=405, avg=210.43, stdev=22.53 00:21:29.769 lat (usec): min=179, max=28848, avg=233.60, stdev=517.20 00:21:29.769 clat percentiles (usec): 00:21:29.769 | 1.00th=[ 180], 5.00th=[ 184], 10.00th=[ 186], 20.00th=[ 192], 00:21:29.769 | 30.00th=[ 196], 40.00th=[ 202], 50.00th=[ 208], 60.00th=[ 215], 00:21:29.769 | 70.00th=[ 221], 80.00th=[ 227], 90.00th=[ 237], 95.00th=[ 245], 00:21:29.769 | 99.00th=[ 302], 99.50th=[ 310], 99.90th=[ 330], 99.95th=[ 351], 00:21:29.769 | 99.99th=[ 404] 00:21:29.769 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=5120.00, stdev=2048.00, samples=4 00:21:29.769 iops : min= 1024, max= 2048, avg=1280.00, stdev=512.00, samples=4 00:21:29.769 lat (usec) : 250=64.69%, 500=27.96%, 750=0.05% 00:21:29.769 lat (msec) : 50=7.28%, >=2000=0.02% 00:21:29.769 cpu : usr=0.10%, sys=0.17%, ctx=5812, majf=0, minf=1 00:21:29.769 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:29.769 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:29.769 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:29.769 issued rwts: total=2736,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:29.769 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:29.769 00:21:29.769 Run status group 0 (all jobs): 00:21:29.769 READ: bw=182KiB/s (187kB/s), 182KiB/s-182KiB/s (187kB/s-187kB/s), io=10.7MiB (11.2MB), run=60016-60016msec 00:21:29.769 WRITE: bw=205KiB/s (210kB/s), 205KiB/s-205KiB/s (210kB/s-210kB/s), io=12.0MiB (12.6MB), run=60016-60016msec 00:21:29.769 00:21:29.769 Disk stats (read/write): 00:21:29.769 nvme0n1: ios=2785/3072, merge=0/0, ticks=19108/595, in_queue=19703, util=99.78% 00:21:29.769 09:44:50 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:29.769 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:29.770 09:44:50 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:29.770 09:44:50 -- common/autotest_common.sh@1208 -- # local i=0 00:21:29.770 09:44:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:29.770 09:44:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:29.770 09:44:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:29.770 09:44:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:29.770 09:44:50 -- common/autotest_common.sh@1220 -- # return 0 00:21:29.770 09:44:50 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:29.770 09:44:50 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:29.770 nvmf hotplug test: fio successful as expected 00:21:29.770 09:44:50 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:29.770 09:44:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:29.770 09:44:50 -- common/autotest_common.sh@10 -- # set +x 00:21:29.770 09:44:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:29.770 09:44:50 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:29.770 09:44:50 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:29.770 09:44:50 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:29.770 09:44:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:29.770 09:44:50 -- nvmf/common.sh@116 -- # sync 00:21:29.770 09:44:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:29.770 09:44:50 -- nvmf/common.sh@119 -- # set +e 00:21:29.770 09:44:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:29.770 09:44:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:29.770 rmmod nvme_tcp 00:21:29.770 rmmod nvme_fabrics 00:21:29.770 rmmod nvme_keyring 00:21:29.770 09:44:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:29.770 09:44:50 -- nvmf/common.sh@123 -- # set -e 00:21:29.770 09:44:50 -- nvmf/common.sh@124 -- # return 0 00:21:29.770 09:44:50 -- nvmf/common.sh@477 -- # '[' -n 71413 ']' 00:21:29.770 09:44:50 -- nvmf/common.sh@478 -- # killprocess 71413 00:21:29.770 09:44:50 -- common/autotest_common.sh@936 -- # '[' -z 71413 ']' 00:21:29.770 09:44:50 -- common/autotest_common.sh@940 -- # kill -0 71413 00:21:29.770 09:44:50 -- common/autotest_common.sh@941 -- # uname 00:21:29.770 09:44:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:29.770 09:44:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 71413 00:21:29.770 09:44:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:29.770 09:44:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:29.770 09:44:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 71413' 00:21:29.770 killing process with pid 71413 00:21:29.770 09:44:50 -- common/autotest_common.sh@955 -- # kill 71413 00:21:29.770 09:44:50 -- common/autotest_common.sh@960 -- # wait 71413 00:21:29.770 09:44:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:29.770 09:44:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:29.770 09:44:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:29.770 09:44:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:29.770 09:44:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:29.770 09:44:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:29.770 09:44:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:29.770 09:44:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:30.028 09:44:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:30.028 00:21:30.028 real 1m9.131s 00:21:30.028 user 4m14.690s 00:21:30.028 sys 0m6.459s 00:21:30.028 09:44:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:30.029 09:44:52 -- common/autotest_common.sh@10 -- # set +x 00:21:30.029 ************************************ 00:21:30.029 END TEST nvmf_initiator_timeout 00:21:30.029 ************************************ 00:21:30.287 09:44:52 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:30.287 09:44:52 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:30.287 09:44:52 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:30.287 09:44:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:30.287 09:44:52 -- common/autotest_common.sh@10 -- # set +x 00:21:32.193 09:44:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:32.193 09:44:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:32.193 09:44:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:32.193 09:44:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:32.193 09:44:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:32.193 09:44:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:32.193 09:44:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:32.193 09:44:54 -- nvmf/common.sh@294 -- # net_devs=() 00:21:32.193 09:44:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:32.193 09:44:54 -- nvmf/common.sh@295 -- # e810=() 00:21:32.193 09:44:54 -- nvmf/common.sh@295 -- # local -ga e810 00:21:32.193 09:44:54 -- nvmf/common.sh@296 -- # x722=() 00:21:32.193 09:44:54 -- nvmf/common.sh@296 -- # local -ga x722 00:21:32.193 09:44:54 -- nvmf/common.sh@297 -- # mlx=() 00:21:32.193 09:44:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:32.193 09:44:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:32.193 09:44:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:32.193 09:44:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:32.193 09:44:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:32.193 09:44:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:32.193 09:44:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:32.193 09:44:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:32.193 09:44:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:32.193 09:44:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:32.193 09:44:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:32.193 09:44:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:32.193 09:44:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:32.193 09:44:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:32.193 09:44:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:32.193 09:44:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:32.193 09:44:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:32.193 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:32.193 09:44:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:32.193 09:44:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:32.193 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:32.193 09:44:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:32.193 09:44:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:32.193 09:44:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:32.193 09:44:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:32.193 09:44:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:32.193 09:44:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:32.193 09:44:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:32.193 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:32.193 09:44:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:32.193 09:44:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:32.193 09:44:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:32.193 09:44:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:32.193 09:44:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:32.193 09:44:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:32.193 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:32.193 09:44:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:32.193 09:44:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:32.193 09:44:54 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:32.193 09:44:54 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:32.193 09:44:54 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:32.193 09:44:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:32.193 09:44:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:32.193 09:44:54 -- common/autotest_common.sh@10 -- # set +x 00:21:32.193 ************************************ 00:21:32.193 START TEST nvmf_perf_adq 00:21:32.193 ************************************ 00:21:32.193 09:44:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:32.193 * Looking for test storage... 00:21:32.193 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:32.193 09:44:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:32.193 09:44:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:32.193 09:44:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:32.452 09:44:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:32.452 09:44:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:32.452 09:44:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:32.452 09:44:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:32.452 09:44:55 -- scripts/common.sh@335 -- # IFS=.-: 00:21:32.452 09:44:55 -- scripts/common.sh@335 -- # read -ra ver1 00:21:32.452 09:44:55 -- scripts/common.sh@336 -- # IFS=.-: 00:21:32.452 09:44:55 -- scripts/common.sh@336 -- # read -ra ver2 00:21:32.452 09:44:55 -- scripts/common.sh@337 -- # local 'op=<' 00:21:32.452 09:44:55 -- scripts/common.sh@339 -- # ver1_l=2 00:21:32.452 09:44:55 -- scripts/common.sh@340 -- # ver2_l=1 00:21:32.452 09:44:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:32.452 09:44:55 -- scripts/common.sh@343 -- # case "$op" in 00:21:32.452 09:44:55 -- scripts/common.sh@344 -- # : 1 00:21:32.452 09:44:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:32.452 09:44:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:32.452 09:44:55 -- scripts/common.sh@364 -- # decimal 1 00:21:32.452 09:44:55 -- scripts/common.sh@352 -- # local d=1 00:21:32.452 09:44:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:32.452 09:44:55 -- scripts/common.sh@354 -- # echo 1 00:21:32.452 09:44:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:32.452 09:44:55 -- scripts/common.sh@365 -- # decimal 2 00:21:32.452 09:44:55 -- scripts/common.sh@352 -- # local d=2 00:21:32.452 09:44:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:32.452 09:44:55 -- scripts/common.sh@354 -- # echo 2 00:21:32.452 09:44:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:32.452 09:44:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:32.452 09:44:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:32.452 09:44:55 -- scripts/common.sh@367 -- # return 0 00:21:32.452 09:44:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:32.452 09:44:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:32.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.452 --rc genhtml_branch_coverage=1 00:21:32.452 --rc genhtml_function_coverage=1 00:21:32.452 --rc genhtml_legend=1 00:21:32.452 --rc geninfo_all_blocks=1 00:21:32.452 --rc geninfo_unexecuted_blocks=1 00:21:32.452 00:21:32.452 ' 00:21:32.452 09:44:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:32.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.452 --rc genhtml_branch_coverage=1 00:21:32.453 --rc genhtml_function_coverage=1 00:21:32.453 --rc genhtml_legend=1 00:21:32.453 --rc geninfo_all_blocks=1 00:21:32.453 --rc geninfo_unexecuted_blocks=1 00:21:32.453 00:21:32.453 ' 00:21:32.453 09:44:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:32.453 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.453 --rc genhtml_branch_coverage=1 00:21:32.453 --rc genhtml_function_coverage=1 00:21:32.453 --rc genhtml_legend=1 00:21:32.453 --rc geninfo_all_blocks=1 00:21:32.453 --rc geninfo_unexecuted_blocks=1 00:21:32.453 00:21:32.453 ' 00:21:32.453 09:44:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:32.453 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.453 --rc genhtml_branch_coverage=1 00:21:32.453 --rc genhtml_function_coverage=1 00:21:32.453 --rc genhtml_legend=1 00:21:32.453 --rc geninfo_all_blocks=1 00:21:32.453 --rc geninfo_unexecuted_blocks=1 00:21:32.453 00:21:32.453 ' 00:21:32.453 09:44:55 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:32.453 09:44:55 -- nvmf/common.sh@7 -- # uname -s 00:21:32.453 09:44:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:32.453 09:44:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:32.453 09:44:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:32.453 09:44:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:32.453 09:44:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:32.453 09:44:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:32.453 09:44:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:32.453 09:44:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:32.453 09:44:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:32.453 09:44:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:32.453 09:44:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:32.453 09:44:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:32.453 09:44:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:32.453 09:44:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:32.453 09:44:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:32.453 09:44:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:32.453 09:44:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:32.453 09:44:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:32.453 09:44:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:32.453 09:44:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.453 09:44:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.453 09:44:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.453 09:44:55 -- paths/export.sh@5 -- # export PATH 00:21:32.453 09:44:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.453 09:44:55 -- nvmf/common.sh@46 -- # : 0 00:21:32.453 09:44:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:32.453 09:44:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:32.453 09:44:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:32.453 09:44:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:32.453 09:44:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:32.453 09:44:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:32.453 09:44:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:32.453 09:44:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:32.453 09:44:55 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:32.453 09:44:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:32.453 09:44:55 -- common/autotest_common.sh@10 -- # set +x 00:21:34.361 09:44:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:34.361 09:44:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:34.361 09:44:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:34.361 09:44:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:34.361 09:44:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:34.361 09:44:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:34.361 09:44:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:34.361 09:44:57 -- nvmf/common.sh@294 -- # net_devs=() 00:21:34.361 09:44:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:34.361 09:44:57 -- nvmf/common.sh@295 -- # e810=() 00:21:34.361 09:44:57 -- nvmf/common.sh@295 -- # local -ga e810 00:21:34.361 09:44:57 -- nvmf/common.sh@296 -- # x722=() 00:21:34.361 09:44:57 -- nvmf/common.sh@296 -- # local -ga x722 00:21:34.361 09:44:57 -- nvmf/common.sh@297 -- # mlx=() 00:21:34.361 09:44:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:34.361 09:44:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:34.361 09:44:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:34.361 09:44:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:34.361 09:44:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:34.361 09:44:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:34.361 09:44:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:34.361 09:44:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:34.361 09:44:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:34.361 09:44:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:34.361 09:44:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:34.361 09:44:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:34.361 09:44:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:34.361 09:44:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:34.361 09:44:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:34.361 09:44:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:34.361 09:44:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:34.361 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:34.361 09:44:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:34.361 09:44:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:34.361 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:34.361 09:44:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:34.361 09:44:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:34.361 09:44:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:34.361 09:44:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:34.361 09:44:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:34.361 09:44:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:34.361 09:44:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:34.361 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:34.361 09:44:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:34.361 09:44:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:34.361 09:44:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:34.361 09:44:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:34.361 09:44:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:34.361 09:44:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:34.361 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:34.361 09:44:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:34.361 09:44:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:34.361 09:44:57 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:34.361 09:44:57 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:34.361 09:44:57 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:34.361 09:44:57 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:34.361 09:44:57 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:34.930 09:44:57 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:37.461 09:44:59 -- target/perf_adq.sh@54 -- # sleep 5 00:21:42.727 09:45:04 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:42.727 09:45:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:42.727 09:45:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:42.727 09:45:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:42.727 09:45:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:42.727 09:45:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:42.727 09:45:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:42.727 09:45:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:42.727 09:45:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:42.727 09:45:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:42.727 09:45:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:42.727 09:45:04 -- common/autotest_common.sh@10 -- # set +x 00:21:42.727 09:45:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:42.727 09:45:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:42.727 09:45:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:42.727 09:45:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:42.727 09:45:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:42.727 09:45:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:42.727 09:45:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:42.727 09:45:04 -- nvmf/common.sh@294 -- # net_devs=() 00:21:42.727 09:45:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:42.727 09:45:04 -- nvmf/common.sh@295 -- # e810=() 00:21:42.727 09:45:04 -- nvmf/common.sh@295 -- # local -ga e810 00:21:42.727 09:45:04 -- nvmf/common.sh@296 -- # x722=() 00:21:42.727 09:45:04 -- nvmf/common.sh@296 -- # local -ga x722 00:21:42.727 09:45:04 -- nvmf/common.sh@297 -- # mlx=() 00:21:42.727 09:45:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:42.727 09:45:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:42.727 09:45:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:42.727 09:45:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:42.727 09:45:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:42.727 09:45:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:42.727 09:45:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:42.727 09:45:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:42.727 09:45:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:42.727 09:45:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:42.727 09:45:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:42.727 09:45:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:42.727 09:45:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:42.727 09:45:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:42.727 09:45:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:42.727 09:45:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:42.727 09:45:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:42.727 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:42.727 09:45:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:42.727 09:45:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:42.727 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:42.727 09:45:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:42.727 09:45:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:42.727 09:45:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:42.727 09:45:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:42.727 09:45:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:42.727 09:45:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:42.727 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:42.727 09:45:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:42.727 09:45:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:42.727 09:45:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:42.727 09:45:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:42.727 09:45:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:42.727 09:45:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:42.727 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:42.727 09:45:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:42.727 09:45:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:42.727 09:45:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:42.727 09:45:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:42.727 09:45:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:42.727 09:45:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:42.727 09:45:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:42.727 09:45:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:42.727 09:45:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:42.727 09:45:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:42.727 09:45:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:42.727 09:45:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:42.727 09:45:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:42.727 09:45:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:42.727 09:45:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:42.727 09:45:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:42.727 09:45:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:42.727 09:45:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:42.727 09:45:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:42.727 09:45:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:42.727 09:45:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:42.727 09:45:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:42.727 09:45:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:42.727 09:45:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:42.727 09:45:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:42.727 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:42.727 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.374 ms 00:21:42.727 00:21:42.727 --- 10.0.0.2 ping statistics --- 00:21:42.727 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:42.727 rtt min/avg/max/mdev = 0.374/0.374/0.374/0.000 ms 00:21:42.727 09:45:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:42.727 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:42.727 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.147 ms 00:21:42.727 00:21:42.727 --- 10.0.0.1 ping statistics --- 00:21:42.727 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:42.727 rtt min/avg/max/mdev = 0.147/0.147/0.147/0.000 ms 00:21:42.727 09:45:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:42.727 09:45:05 -- nvmf/common.sh@410 -- # return 0 00:21:42.727 09:45:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:42.727 09:45:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:42.727 09:45:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:42.727 09:45:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:42.727 09:45:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:42.727 09:45:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:42.727 09:45:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:42.727 09:45:05 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:42.727 09:45:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:42.727 09:45:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:42.727 09:45:05 -- common/autotest_common.sh@10 -- # set +x 00:21:42.727 09:45:05 -- nvmf/common.sh@469 -- # nvmfpid=83979 00:21:42.727 09:45:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:42.727 09:45:05 -- nvmf/common.sh@470 -- # waitforlisten 83979 00:21:42.727 09:45:05 -- common/autotest_common.sh@829 -- # '[' -z 83979 ']' 00:21:42.727 09:45:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:42.727 09:45:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:42.727 09:45:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:42.727 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:42.727 09:45:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:42.727 09:45:05 -- common/autotest_common.sh@10 -- # set +x 00:21:42.727 [2024-11-29 09:45:05.198204] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:42.728 [2024-11-29 09:45:05.198280] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:42.728 EAL: No free 2048 kB hugepages reported on node 1 00:21:42.728 [2024-11-29 09:45:05.266539] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:42.728 [2024-11-29 09:45:05.375263] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:42.728 [2024-11-29 09:45:05.375417] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:42.728 [2024-11-29 09:45:05.375441] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:42.728 [2024-11-29 09:45:05.375453] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:42.728 [2024-11-29 09:45:05.375503] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:42.728 [2024-11-29 09:45:05.375563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:42.728 [2024-11-29 09:45:05.375631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:42.728 [2024-11-29 09:45:05.375633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:42.728 09:45:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:42.728 09:45:05 -- common/autotest_common.sh@862 -- # return 0 00:21:42.728 09:45:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:42.728 09:45:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:42.728 09:45:05 -- common/autotest_common.sh@10 -- # set +x 00:21:42.728 09:45:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:42.728 09:45:05 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:42.728 09:45:05 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:42.728 09:45:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.728 09:45:05 -- common/autotest_common.sh@10 -- # set +x 00:21:42.728 09:45:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.728 09:45:05 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:42.728 09:45:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.728 09:45:05 -- common/autotest_common.sh@10 -- # set +x 00:21:42.985 09:45:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.985 09:45:05 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:42.985 09:45:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.985 09:45:05 -- common/autotest_common.sh@10 -- # set +x 00:21:42.985 [2024-11-29 09:45:05.575480] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:42.985 09:45:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.985 09:45:05 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:42.985 09:45:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.985 09:45:05 -- common/autotest_common.sh@10 -- # set +x 00:21:42.985 Malloc1 00:21:42.985 09:45:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.985 09:45:05 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:42.985 09:45:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.985 09:45:05 -- common/autotest_common.sh@10 -- # set +x 00:21:42.985 09:45:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.985 09:45:05 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:42.985 09:45:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.985 09:45:05 -- common/autotest_common.sh@10 -- # set +x 00:21:42.985 09:45:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.985 09:45:05 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:42.985 09:45:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.985 09:45:05 -- common/autotest_common.sh@10 -- # set +x 00:21:42.985 [2024-11-29 09:45:05.629021] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:42.985 09:45:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.985 09:45:05 -- target/perf_adq.sh@73 -- # perfpid=84124 00:21:42.985 09:45:05 -- target/perf_adq.sh@74 -- # sleep 2 00:21:42.985 09:45:05 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:42.985 EAL: No free 2048 kB hugepages reported on node 1 00:21:44.882 09:45:07 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:44.882 09:45:07 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:44.882 09:45:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.882 09:45:07 -- target/perf_adq.sh@76 -- # wc -l 00:21:44.882 09:45:07 -- common/autotest_common.sh@10 -- # set +x 00:21:44.882 09:45:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.882 09:45:07 -- target/perf_adq.sh@76 -- # count=4 00:21:44.882 09:45:07 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:44.882 09:45:07 -- target/perf_adq.sh@81 -- # wait 84124 00:21:52.987 Initializing NVMe Controllers 00:21:52.987 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:52.987 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:52.987 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:52.987 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:52.987 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:52.987 Initialization complete. Launching workers. 00:21:52.987 ======================================================== 00:21:52.987 Latency(us) 00:21:52.987 Device Information : IOPS MiB/s Average min max 00:21:52.987 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11222.50 43.84 5704.63 1654.90 9750.28 00:21:52.987 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11141.20 43.52 5745.60 1274.43 9733.70 00:21:52.987 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 10582.90 41.34 6047.83 1382.37 10253.05 00:21:52.987 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11052.50 43.17 5792.14 1803.09 9884.32 00:21:52.987 ======================================================== 00:21:52.987 Total : 43999.10 171.87 5819.53 1274.43 10253.05 00:21:52.987 00:21:52.987 09:45:15 -- target/perf_adq.sh@82 -- # nvmftestfini 00:21:52.987 09:45:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:52.987 09:45:15 -- nvmf/common.sh@116 -- # sync 00:21:52.987 09:45:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:52.987 09:45:15 -- nvmf/common.sh@119 -- # set +e 00:21:52.987 09:45:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:52.987 09:45:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:52.987 rmmod nvme_tcp 00:21:52.987 rmmod nvme_fabrics 00:21:52.987 rmmod nvme_keyring 00:21:52.987 09:45:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:52.987 09:45:15 -- nvmf/common.sh@123 -- # set -e 00:21:52.987 09:45:15 -- nvmf/common.sh@124 -- # return 0 00:21:52.987 09:45:15 -- nvmf/common.sh@477 -- # '[' -n 83979 ']' 00:21:52.987 09:45:15 -- nvmf/common.sh@478 -- # killprocess 83979 00:21:52.987 09:45:15 -- common/autotest_common.sh@936 -- # '[' -z 83979 ']' 00:21:52.987 09:45:15 -- common/autotest_common.sh@940 -- # kill -0 83979 00:21:52.987 09:45:15 -- common/autotest_common.sh@941 -- # uname 00:21:53.245 09:45:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:53.245 09:45:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 83979 00:21:53.245 09:45:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:53.245 09:45:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:53.245 09:45:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 83979' 00:21:53.245 killing process with pid 83979 00:21:53.245 09:45:15 -- common/autotest_common.sh@955 -- # kill 83979 00:21:53.245 09:45:15 -- common/autotest_common.sh@960 -- # wait 83979 00:21:53.502 09:45:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:53.502 09:45:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:53.502 09:45:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:53.502 09:45:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:53.502 09:45:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:53.502 09:45:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:53.502 09:45:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:53.502 09:45:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:55.400 09:45:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:55.400 09:45:18 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:21:55.400 09:45:18 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:56.334 09:45:19 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:58.861 09:45:21 -- target/perf_adq.sh@54 -- # sleep 5 00:22:04.160 09:45:26 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:04.160 09:45:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:04.160 09:45:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:04.160 09:45:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:04.160 09:45:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:04.161 09:45:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:04.161 09:45:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:04.161 09:45:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:04.161 09:45:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:04.161 09:45:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:04.161 09:45:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:04.161 09:45:26 -- common/autotest_common.sh@10 -- # set +x 00:22:04.161 09:45:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:04.161 09:45:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:04.161 09:45:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:04.161 09:45:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:04.161 09:45:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:04.161 09:45:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:04.161 09:45:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:04.161 09:45:26 -- nvmf/common.sh@294 -- # net_devs=() 00:22:04.161 09:45:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:04.161 09:45:26 -- nvmf/common.sh@295 -- # e810=() 00:22:04.161 09:45:26 -- nvmf/common.sh@295 -- # local -ga e810 00:22:04.161 09:45:26 -- nvmf/common.sh@296 -- # x722=() 00:22:04.161 09:45:26 -- nvmf/common.sh@296 -- # local -ga x722 00:22:04.161 09:45:26 -- nvmf/common.sh@297 -- # mlx=() 00:22:04.161 09:45:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:04.161 09:45:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:04.161 09:45:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:04.161 09:45:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:04.161 09:45:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:04.161 09:45:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:04.161 09:45:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:04.161 09:45:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:04.161 09:45:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:04.161 09:45:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:04.161 09:45:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:04.161 09:45:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:04.161 09:45:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:04.161 09:45:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:04.161 09:45:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:04.161 09:45:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:04.161 09:45:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:04.161 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:04.161 09:45:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:04.161 09:45:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:04.161 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:04.161 09:45:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:04.161 09:45:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:04.161 09:45:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:04.161 09:45:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:04.161 09:45:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:04.161 09:45:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:04.161 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:04.161 09:45:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:04.161 09:45:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:04.161 09:45:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:04.161 09:45:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:04.161 09:45:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:04.161 09:45:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:04.161 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:04.161 09:45:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:04.161 09:45:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:04.161 09:45:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:04.161 09:45:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:04.161 09:45:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:04.161 09:45:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:04.161 09:45:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:04.161 09:45:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:04.161 09:45:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:04.161 09:45:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:04.161 09:45:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:04.161 09:45:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:04.161 09:45:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:04.161 09:45:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:04.161 09:45:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:04.161 09:45:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:04.161 09:45:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:04.161 09:45:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:04.161 09:45:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:04.161 09:45:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:04.161 09:45:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:04.161 09:45:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:04.161 09:45:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:04.161 09:45:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:04.161 09:45:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:04.161 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:04.161 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.314 ms 00:22:04.161 00:22:04.161 --- 10.0.0.2 ping statistics --- 00:22:04.161 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:04.161 rtt min/avg/max/mdev = 0.314/0.314/0.314/0.000 ms 00:22:04.161 09:45:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:04.161 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:04.161 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:22:04.161 00:22:04.161 --- 10.0.0.1 ping statistics --- 00:22:04.161 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:04.162 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:22:04.162 09:45:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:04.162 09:45:26 -- nvmf/common.sh@410 -- # return 0 00:22:04.162 09:45:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:04.162 09:45:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:04.162 09:45:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:04.162 09:45:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:04.162 09:45:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:04.162 09:45:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:04.162 09:45:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:04.162 09:45:26 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:04.162 09:45:26 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:04.162 09:45:26 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:04.162 09:45:26 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:04.162 net.core.busy_poll = 1 00:22:04.162 09:45:26 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:04.162 net.core.busy_read = 1 00:22:04.162 09:45:26 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:04.162 09:45:26 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:04.162 09:45:26 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:04.162 09:45:26 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:04.162 09:45:26 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:04.162 09:45:26 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:04.162 09:45:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:04.162 09:45:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:04.162 09:45:26 -- common/autotest_common.sh@10 -- # set +x 00:22:04.162 09:45:26 -- nvmf/common.sh@469 -- # nvmfpid=87346 00:22:04.162 09:45:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:04.162 09:45:26 -- nvmf/common.sh@470 -- # waitforlisten 87346 00:22:04.162 09:45:26 -- common/autotest_common.sh@829 -- # '[' -z 87346 ']' 00:22:04.162 09:45:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:04.162 09:45:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:04.162 09:45:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:04.162 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:04.162 09:45:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:04.162 09:45:26 -- common/autotest_common.sh@10 -- # set +x 00:22:04.162 [2024-11-29 09:45:26.784712] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:04.162 [2024-11-29 09:45:26.784801] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:04.162 EAL: No free 2048 kB hugepages reported on node 1 00:22:04.162 [2024-11-29 09:45:26.854237] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:04.162 [2024-11-29 09:45:26.967744] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:04.162 [2024-11-29 09:45:26.967887] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:04.162 [2024-11-29 09:45:26.967905] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:04.162 [2024-11-29 09:45:26.967917] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:04.162 [2024-11-29 09:45:26.967967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:04.162 [2024-11-29 09:45:26.968030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:04.162 [2024-11-29 09:45:26.968096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:04.162 [2024-11-29 09:45:26.968098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:04.421 09:45:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:04.421 09:45:27 -- common/autotest_common.sh@862 -- # return 0 00:22:04.421 09:45:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:04.421 09:45:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:04.421 09:45:27 -- common/autotest_common.sh@10 -- # set +x 00:22:04.421 09:45:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:04.421 09:45:27 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:04.421 09:45:27 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:04.421 09:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.421 09:45:27 -- common/autotest_common.sh@10 -- # set +x 00:22:04.421 09:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.421 09:45:27 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:04.421 09:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.421 09:45:27 -- common/autotest_common.sh@10 -- # set +x 00:22:04.421 09:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.421 09:45:27 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:04.421 09:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.421 09:45:27 -- common/autotest_common.sh@10 -- # set +x 00:22:04.421 [2024-11-29 09:45:27.175328] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:04.421 09:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.421 09:45:27 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:04.421 09:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.421 09:45:27 -- common/autotest_common.sh@10 -- # set +x 00:22:04.421 Malloc1 00:22:04.421 09:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.421 09:45:27 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:04.421 09:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.421 09:45:27 -- common/autotest_common.sh@10 -- # set +x 00:22:04.421 09:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.421 09:45:27 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:04.421 09:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.421 09:45:27 -- common/autotest_common.sh@10 -- # set +x 00:22:04.421 09:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.421 09:45:27 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:04.421 09:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:04.421 09:45:27 -- common/autotest_common.sh@10 -- # set +x 00:22:04.421 [2024-11-29 09:45:27.228708] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:04.421 09:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:04.421 09:45:27 -- target/perf_adq.sh@94 -- # perfpid=87479 00:22:04.421 09:45:27 -- target/perf_adq.sh@95 -- # sleep 2 00:22:04.421 09:45:27 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:04.421 EAL: No free 2048 kB hugepages reported on node 1 00:22:06.953 09:45:29 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:06.953 09:45:29 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:06.953 09:45:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:06.953 09:45:29 -- target/perf_adq.sh@97 -- # wc -l 00:22:06.953 09:45:29 -- common/autotest_common.sh@10 -- # set +x 00:22:06.953 09:45:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:06.953 09:45:29 -- target/perf_adq.sh@97 -- # count=2 00:22:06.953 09:45:29 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:06.953 09:45:29 -- target/perf_adq.sh@103 -- # wait 87479 00:22:15.056 Initializing NVMe Controllers 00:22:15.056 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:15.056 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:15.056 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:15.056 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:15.056 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:15.056 Initialization complete. Launching workers. 00:22:15.056 ======================================================== 00:22:15.056 Latency(us) 00:22:15.056 Device Information : IOPS MiB/s Average min max 00:22:15.056 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5407.28 21.12 11880.66 1099.05 58796.93 00:22:15.056 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 5490.57 21.45 11665.96 1289.94 59350.65 00:22:15.056 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 14167.09 55.34 4517.45 1213.13 46863.30 00:22:15.056 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 4691.93 18.33 13651.96 1175.41 59463.99 00:22:15.056 ======================================================== 00:22:15.056 Total : 29756.88 116.24 8614.75 1099.05 59463.99 00:22:15.056 00:22:15.056 09:45:37 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:15.056 09:45:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:15.056 09:45:37 -- nvmf/common.sh@116 -- # sync 00:22:15.056 09:45:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:15.056 09:45:37 -- nvmf/common.sh@119 -- # set +e 00:22:15.056 09:45:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:15.056 09:45:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:15.056 rmmod nvme_tcp 00:22:15.056 rmmod nvme_fabrics 00:22:15.056 rmmod nvme_keyring 00:22:15.056 09:45:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:15.056 09:45:37 -- nvmf/common.sh@123 -- # set -e 00:22:15.056 09:45:37 -- nvmf/common.sh@124 -- # return 0 00:22:15.056 09:45:37 -- nvmf/common.sh@477 -- # '[' -n 87346 ']' 00:22:15.056 09:45:37 -- nvmf/common.sh@478 -- # killprocess 87346 00:22:15.056 09:45:37 -- common/autotest_common.sh@936 -- # '[' -z 87346 ']' 00:22:15.056 09:45:37 -- common/autotest_common.sh@940 -- # kill -0 87346 00:22:15.056 09:45:37 -- common/autotest_common.sh@941 -- # uname 00:22:15.056 09:45:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:15.056 09:45:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 87346 00:22:15.056 09:45:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:15.056 09:45:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:15.056 09:45:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 87346' 00:22:15.056 killing process with pid 87346 00:22:15.056 09:45:37 -- common/autotest_common.sh@955 -- # kill 87346 00:22:15.056 09:45:37 -- common/autotest_common.sh@960 -- # wait 87346 00:22:15.056 09:45:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:15.056 09:45:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:15.056 09:45:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:15.056 09:45:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:15.056 09:45:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:15.056 09:45:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:15.056 09:45:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:15.056 09:45:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.591 09:45:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:17.591 09:45:39 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:17.591 00:22:17.591 real 0m44.944s 00:22:17.591 user 2m38.470s 00:22:17.591 sys 0m9.999s 00:22:17.591 09:45:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:17.591 09:45:39 -- common/autotest_common.sh@10 -- # set +x 00:22:17.591 ************************************ 00:22:17.591 END TEST nvmf_perf_adq 00:22:17.591 ************************************ 00:22:17.591 09:45:39 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:17.591 09:45:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:17.591 09:45:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:17.591 09:45:39 -- common/autotest_common.sh@10 -- # set +x 00:22:17.591 ************************************ 00:22:17.591 START TEST nvmf_shutdown 00:22:17.591 ************************************ 00:22:17.591 09:45:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:17.591 * Looking for test storage... 00:22:17.591 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:17.591 09:45:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:17.591 09:45:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:17.591 09:45:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:17.592 09:45:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:17.592 09:45:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:17.592 09:45:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:17.592 09:45:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:17.592 09:45:40 -- scripts/common.sh@335 -- # IFS=.-: 00:22:17.592 09:45:40 -- scripts/common.sh@335 -- # read -ra ver1 00:22:17.592 09:45:40 -- scripts/common.sh@336 -- # IFS=.-: 00:22:17.592 09:45:40 -- scripts/common.sh@336 -- # read -ra ver2 00:22:17.592 09:45:40 -- scripts/common.sh@337 -- # local 'op=<' 00:22:17.592 09:45:40 -- scripts/common.sh@339 -- # ver1_l=2 00:22:17.592 09:45:40 -- scripts/common.sh@340 -- # ver2_l=1 00:22:17.592 09:45:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:17.592 09:45:40 -- scripts/common.sh@343 -- # case "$op" in 00:22:17.592 09:45:40 -- scripts/common.sh@344 -- # : 1 00:22:17.592 09:45:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:17.592 09:45:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:17.592 09:45:40 -- scripts/common.sh@364 -- # decimal 1 00:22:17.592 09:45:40 -- scripts/common.sh@352 -- # local d=1 00:22:17.592 09:45:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:17.592 09:45:40 -- scripts/common.sh@354 -- # echo 1 00:22:17.592 09:45:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:17.592 09:45:40 -- scripts/common.sh@365 -- # decimal 2 00:22:17.592 09:45:40 -- scripts/common.sh@352 -- # local d=2 00:22:17.592 09:45:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:17.592 09:45:40 -- scripts/common.sh@354 -- # echo 2 00:22:17.592 09:45:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:17.592 09:45:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:17.592 09:45:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:17.592 09:45:40 -- scripts/common.sh@367 -- # return 0 00:22:17.592 09:45:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:17.592 09:45:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:17.592 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:17.592 --rc genhtml_branch_coverage=1 00:22:17.592 --rc genhtml_function_coverage=1 00:22:17.592 --rc genhtml_legend=1 00:22:17.592 --rc geninfo_all_blocks=1 00:22:17.592 --rc geninfo_unexecuted_blocks=1 00:22:17.592 00:22:17.592 ' 00:22:17.592 09:45:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:17.592 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:17.592 --rc genhtml_branch_coverage=1 00:22:17.592 --rc genhtml_function_coverage=1 00:22:17.592 --rc genhtml_legend=1 00:22:17.592 --rc geninfo_all_blocks=1 00:22:17.592 --rc geninfo_unexecuted_blocks=1 00:22:17.592 00:22:17.592 ' 00:22:17.592 09:45:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:17.592 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:17.592 --rc genhtml_branch_coverage=1 00:22:17.592 --rc genhtml_function_coverage=1 00:22:17.592 --rc genhtml_legend=1 00:22:17.592 --rc geninfo_all_blocks=1 00:22:17.592 --rc geninfo_unexecuted_blocks=1 00:22:17.592 00:22:17.592 ' 00:22:17.592 09:45:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:17.592 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:17.592 --rc genhtml_branch_coverage=1 00:22:17.592 --rc genhtml_function_coverage=1 00:22:17.592 --rc genhtml_legend=1 00:22:17.592 --rc geninfo_all_blocks=1 00:22:17.592 --rc geninfo_unexecuted_blocks=1 00:22:17.592 00:22:17.592 ' 00:22:17.592 09:45:40 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:17.592 09:45:40 -- nvmf/common.sh@7 -- # uname -s 00:22:17.592 09:45:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:17.592 09:45:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:17.592 09:45:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:17.592 09:45:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:17.592 09:45:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:17.592 09:45:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:17.592 09:45:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:17.592 09:45:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:17.592 09:45:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:17.592 09:45:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:17.592 09:45:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:17.592 09:45:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:17.592 09:45:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:17.592 09:45:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:17.592 09:45:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:17.592 09:45:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:17.592 09:45:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:17.592 09:45:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:17.592 09:45:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:17.592 09:45:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.592 09:45:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.592 09:45:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.592 09:45:40 -- paths/export.sh@5 -- # export PATH 00:22:17.592 09:45:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.592 09:45:40 -- nvmf/common.sh@46 -- # : 0 00:22:17.592 09:45:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:17.592 09:45:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:17.592 09:45:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:17.592 09:45:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:17.592 09:45:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:17.592 09:45:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:17.592 09:45:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:17.592 09:45:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:17.592 09:45:40 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:17.592 09:45:40 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:17.592 09:45:40 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:17.592 09:45:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:17.592 09:45:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:17.592 09:45:40 -- common/autotest_common.sh@10 -- # set +x 00:22:17.592 ************************************ 00:22:17.592 START TEST nvmf_shutdown_tc1 00:22:17.592 ************************************ 00:22:17.592 09:45:40 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:22:17.592 09:45:40 -- target/shutdown.sh@74 -- # starttarget 00:22:17.592 09:45:40 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:17.592 09:45:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:17.592 09:45:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:17.592 09:45:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:17.592 09:45:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:17.592 09:45:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:17.592 09:45:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:17.592 09:45:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:17.592 09:45:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.592 09:45:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:17.592 09:45:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:17.592 09:45:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:17.592 09:45:40 -- common/autotest_common.sh@10 -- # set +x 00:22:19.523 09:45:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:19.523 09:45:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:19.523 09:45:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:19.523 09:45:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:19.523 09:45:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:19.523 09:45:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:19.523 09:45:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:19.523 09:45:42 -- nvmf/common.sh@294 -- # net_devs=() 00:22:19.523 09:45:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:19.523 09:45:42 -- nvmf/common.sh@295 -- # e810=() 00:22:19.523 09:45:42 -- nvmf/common.sh@295 -- # local -ga e810 00:22:19.523 09:45:42 -- nvmf/common.sh@296 -- # x722=() 00:22:19.523 09:45:42 -- nvmf/common.sh@296 -- # local -ga x722 00:22:19.523 09:45:42 -- nvmf/common.sh@297 -- # mlx=() 00:22:19.523 09:45:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:19.523 09:45:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:19.523 09:45:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:19.523 09:45:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:19.523 09:45:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:19.523 09:45:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:19.523 09:45:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:19.523 09:45:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:19.523 09:45:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:19.523 09:45:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:19.523 09:45:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:19.523 09:45:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:19.523 09:45:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:19.523 09:45:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:19.523 09:45:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:19.523 09:45:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:19.523 09:45:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:19.523 09:45:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:19.523 09:45:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:19.523 09:45:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:19.523 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:19.523 09:45:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:19.523 09:45:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:19.523 09:45:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:19.523 09:45:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:19.523 09:45:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:19.523 09:45:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:19.523 09:45:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:19.523 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:19.523 09:45:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:19.523 09:45:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:19.523 09:45:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:19.523 09:45:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:19.523 09:45:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:19.523 09:45:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:19.523 09:45:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:19.523 09:45:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:19.524 09:45:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:19.524 09:45:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:19.524 09:45:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:19.524 09:45:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:19.524 09:45:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:19.524 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:19.524 09:45:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:19.524 09:45:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:19.524 09:45:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:19.524 09:45:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:19.524 09:45:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:19.524 09:45:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:19.524 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:19.524 09:45:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:19.524 09:45:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:19.524 09:45:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:19.524 09:45:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:19.524 09:45:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:19.524 09:45:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:19.524 09:45:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:19.524 09:45:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:19.524 09:45:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:19.524 09:45:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:19.524 09:45:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:19.524 09:45:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:19.524 09:45:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:19.524 09:45:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:19.524 09:45:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:19.524 09:45:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:19.524 09:45:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:19.524 09:45:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:19.524 09:45:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:19.524 09:45:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:19.524 09:45:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:19.524 09:45:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:19.524 09:45:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:19.524 09:45:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:19.524 09:45:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:19.524 09:45:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:19.524 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:19.524 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.255 ms 00:22:19.524 00:22:19.524 --- 10.0.0.2 ping statistics --- 00:22:19.524 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:19.524 rtt min/avg/max/mdev = 0.255/0.255/0.255/0.000 ms 00:22:19.524 09:45:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:19.524 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:19.524 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:22:19.524 00:22:19.524 --- 10.0.0.1 ping statistics --- 00:22:19.524 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:19.524 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:22:19.524 09:45:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:19.524 09:45:42 -- nvmf/common.sh@410 -- # return 0 00:22:19.524 09:45:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:19.524 09:45:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:19.524 09:45:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:19.524 09:45:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:19.524 09:45:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:19.524 09:45:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:19.524 09:45:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:19.524 09:45:42 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:19.524 09:45:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:19.524 09:45:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:19.524 09:45:42 -- common/autotest_common.sh@10 -- # set +x 00:22:19.524 09:45:42 -- nvmf/common.sh@469 -- # nvmfpid=90694 00:22:19.524 09:45:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:19.524 09:45:42 -- nvmf/common.sh@470 -- # waitforlisten 90694 00:22:19.524 09:45:42 -- common/autotest_common.sh@829 -- # '[' -z 90694 ']' 00:22:19.524 09:45:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:19.524 09:45:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:19.524 09:45:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:19.524 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:19.524 09:45:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:19.524 09:45:42 -- common/autotest_common.sh@10 -- # set +x 00:22:19.524 [2024-11-29 09:45:42.362879] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:19.524 [2024-11-29 09:45:42.362966] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:19.783 EAL: No free 2048 kB hugepages reported on node 1 00:22:19.783 [2024-11-29 09:45:42.435062] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:19.783 [2024-11-29 09:45:42.551409] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:19.783 [2024-11-29 09:45:42.551588] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:19.783 [2024-11-29 09:45:42.551608] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:19.783 [2024-11-29 09:45:42.551623] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:19.783 [2024-11-29 09:45:42.551684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:19.783 [2024-11-29 09:45:42.551814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:19.783 [2024-11-29 09:45:42.551880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:19.783 [2024-11-29 09:45:42.551884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:20.718 09:45:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:20.718 09:45:43 -- common/autotest_common.sh@862 -- # return 0 00:22:20.718 09:45:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:20.718 09:45:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:20.718 09:45:43 -- common/autotest_common.sh@10 -- # set +x 00:22:20.718 09:45:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:20.718 09:45:43 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:20.718 09:45:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.718 09:45:43 -- common/autotest_common.sh@10 -- # set +x 00:22:20.718 [2024-11-29 09:45:43.456257] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:20.718 09:45:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.718 09:45:43 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:20.718 09:45:43 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:20.718 09:45:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:20.718 09:45:43 -- common/autotest_common.sh@10 -- # set +x 00:22:20.718 09:45:43 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:20.718 09:45:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.718 09:45:43 -- target/shutdown.sh@28 -- # cat 00:22:20.718 09:45:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.718 09:45:43 -- target/shutdown.sh@28 -- # cat 00:22:20.718 09:45:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.718 09:45:43 -- target/shutdown.sh@28 -- # cat 00:22:20.718 09:45:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.718 09:45:43 -- target/shutdown.sh@28 -- # cat 00:22:20.718 09:45:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.718 09:45:43 -- target/shutdown.sh@28 -- # cat 00:22:20.718 09:45:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.718 09:45:43 -- target/shutdown.sh@28 -- # cat 00:22:20.718 09:45:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.718 09:45:43 -- target/shutdown.sh@28 -- # cat 00:22:20.718 09:45:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.718 09:45:43 -- target/shutdown.sh@28 -- # cat 00:22:20.718 09:45:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.718 09:45:43 -- target/shutdown.sh@28 -- # cat 00:22:20.718 09:45:43 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.718 09:45:43 -- target/shutdown.sh@28 -- # cat 00:22:20.718 09:45:43 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:20.718 09:45:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.718 09:45:43 -- common/autotest_common.sh@10 -- # set +x 00:22:20.718 Malloc1 00:22:20.718 [2024-11-29 09:45:43.545931] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:20.977 Malloc2 00:22:20.977 Malloc3 00:22:20.977 Malloc4 00:22:20.977 Malloc5 00:22:20.977 Malloc6 00:22:20.977 Malloc7 00:22:21.235 Malloc8 00:22:21.235 Malloc9 00:22:21.235 Malloc10 00:22:21.235 09:45:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:21.235 09:45:43 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:21.235 09:45:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:21.235 09:45:43 -- common/autotest_common.sh@10 -- # set +x 00:22:21.235 09:45:44 -- target/shutdown.sh@78 -- # perfpid=91012 00:22:21.235 09:45:44 -- target/shutdown.sh@79 -- # waitforlisten 91012 /var/tmp/bdevperf.sock 00:22:21.235 09:45:44 -- common/autotest_common.sh@829 -- # '[' -z 91012 ']' 00:22:21.235 09:45:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:21.235 09:45:44 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:21.235 09:45:44 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:21.235 09:45:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:21.235 09:45:44 -- nvmf/common.sh@520 -- # config=() 00:22:21.235 09:45:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:21.235 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:21.235 09:45:44 -- nvmf/common.sh@520 -- # local subsystem config 00:22:21.235 09:45:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:21.235 09:45:44 -- common/autotest_common.sh@10 -- # set +x 00:22:21.235 09:45:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.235 09:45:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.235 { 00:22:21.235 "params": { 00:22:21.235 "name": "Nvme$subsystem", 00:22:21.235 "trtype": "$TEST_TRANSPORT", 00:22:21.235 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.235 "adrfam": "ipv4", 00:22:21.235 "trsvcid": "$NVMF_PORT", 00:22:21.235 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.235 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.235 "hdgst": ${hdgst:-false}, 00:22:21.235 "ddgst": ${ddgst:-false} 00:22:21.235 }, 00:22:21.235 "method": "bdev_nvme_attach_controller" 00:22:21.235 } 00:22:21.235 EOF 00:22:21.235 )") 00:22:21.235 09:45:44 -- nvmf/common.sh@542 -- # cat 00:22:21.235 09:45:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.235 09:45:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.235 { 00:22:21.235 "params": { 00:22:21.235 "name": "Nvme$subsystem", 00:22:21.235 "trtype": "$TEST_TRANSPORT", 00:22:21.235 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.235 "adrfam": "ipv4", 00:22:21.235 "trsvcid": "$NVMF_PORT", 00:22:21.235 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.235 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.235 "hdgst": ${hdgst:-false}, 00:22:21.235 "ddgst": ${ddgst:-false} 00:22:21.235 }, 00:22:21.235 "method": "bdev_nvme_attach_controller" 00:22:21.235 } 00:22:21.235 EOF 00:22:21.235 )") 00:22:21.235 09:45:44 -- nvmf/common.sh@542 -- # cat 00:22:21.235 09:45:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.235 09:45:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.235 { 00:22:21.235 "params": { 00:22:21.235 "name": "Nvme$subsystem", 00:22:21.235 "trtype": "$TEST_TRANSPORT", 00:22:21.235 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.235 "adrfam": "ipv4", 00:22:21.235 "trsvcid": "$NVMF_PORT", 00:22:21.235 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.235 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.235 "hdgst": ${hdgst:-false}, 00:22:21.235 "ddgst": ${ddgst:-false} 00:22:21.235 }, 00:22:21.235 "method": "bdev_nvme_attach_controller" 00:22:21.235 } 00:22:21.235 EOF 00:22:21.235 )") 00:22:21.235 09:45:44 -- nvmf/common.sh@542 -- # cat 00:22:21.236 09:45:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.236 09:45:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.236 { 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme$subsystem", 00:22:21.236 "trtype": "$TEST_TRANSPORT", 00:22:21.236 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "$NVMF_PORT", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.236 "hdgst": ${hdgst:-false}, 00:22:21.236 "ddgst": ${ddgst:-false} 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 } 00:22:21.236 EOF 00:22:21.236 )") 00:22:21.236 09:45:44 -- nvmf/common.sh@542 -- # cat 00:22:21.236 09:45:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.236 09:45:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.236 { 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme$subsystem", 00:22:21.236 "trtype": "$TEST_TRANSPORT", 00:22:21.236 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "$NVMF_PORT", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.236 "hdgst": ${hdgst:-false}, 00:22:21.236 "ddgst": ${ddgst:-false} 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 } 00:22:21.236 EOF 00:22:21.236 )") 00:22:21.236 09:45:44 -- nvmf/common.sh@542 -- # cat 00:22:21.236 09:45:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.236 09:45:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.236 { 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme$subsystem", 00:22:21.236 "trtype": "$TEST_TRANSPORT", 00:22:21.236 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "$NVMF_PORT", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.236 "hdgst": ${hdgst:-false}, 00:22:21.236 "ddgst": ${ddgst:-false} 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 } 00:22:21.236 EOF 00:22:21.236 )") 00:22:21.236 09:45:44 -- nvmf/common.sh@542 -- # cat 00:22:21.236 09:45:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.236 09:45:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.236 { 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme$subsystem", 00:22:21.236 "trtype": "$TEST_TRANSPORT", 00:22:21.236 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "$NVMF_PORT", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.236 "hdgst": ${hdgst:-false}, 00:22:21.236 "ddgst": ${ddgst:-false} 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 } 00:22:21.236 EOF 00:22:21.236 )") 00:22:21.236 09:45:44 -- nvmf/common.sh@542 -- # cat 00:22:21.236 09:45:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.236 09:45:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.236 { 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme$subsystem", 00:22:21.236 "trtype": "$TEST_TRANSPORT", 00:22:21.236 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "$NVMF_PORT", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.236 "hdgst": ${hdgst:-false}, 00:22:21.236 "ddgst": ${ddgst:-false} 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 } 00:22:21.236 EOF 00:22:21.236 )") 00:22:21.236 09:45:44 -- nvmf/common.sh@542 -- # cat 00:22:21.236 09:45:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.236 09:45:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.236 { 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme$subsystem", 00:22:21.236 "trtype": "$TEST_TRANSPORT", 00:22:21.236 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "$NVMF_PORT", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.236 "hdgst": ${hdgst:-false}, 00:22:21.236 "ddgst": ${ddgst:-false} 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 } 00:22:21.236 EOF 00:22:21.236 )") 00:22:21.236 09:45:44 -- nvmf/common.sh@542 -- # cat 00:22:21.236 09:45:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.236 09:45:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.236 { 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme$subsystem", 00:22:21.236 "trtype": "$TEST_TRANSPORT", 00:22:21.236 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "$NVMF_PORT", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.236 "hdgst": ${hdgst:-false}, 00:22:21.236 "ddgst": ${ddgst:-false} 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 } 00:22:21.236 EOF 00:22:21.236 )") 00:22:21.236 09:45:44 -- nvmf/common.sh@542 -- # cat 00:22:21.236 09:45:44 -- nvmf/common.sh@544 -- # jq . 00:22:21.236 09:45:44 -- nvmf/common.sh@545 -- # IFS=, 00:22:21.236 09:45:44 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme1", 00:22:21.236 "trtype": "tcp", 00:22:21.236 "traddr": "10.0.0.2", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "4420", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:21.236 "hdgst": false, 00:22:21.236 "ddgst": false 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 },{ 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme2", 00:22:21.236 "trtype": "tcp", 00:22:21.236 "traddr": "10.0.0.2", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "4420", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:21.236 "hdgst": false, 00:22:21.236 "ddgst": false 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 },{ 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme3", 00:22:21.236 "trtype": "tcp", 00:22:21.236 "traddr": "10.0.0.2", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "4420", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:21.236 "hdgst": false, 00:22:21.236 "ddgst": false 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 },{ 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme4", 00:22:21.236 "trtype": "tcp", 00:22:21.236 "traddr": "10.0.0.2", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "4420", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:21.236 "hdgst": false, 00:22:21.236 "ddgst": false 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 },{ 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme5", 00:22:21.236 "trtype": "tcp", 00:22:21.236 "traddr": "10.0.0.2", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "4420", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:21.236 "hdgst": false, 00:22:21.236 "ddgst": false 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 },{ 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme6", 00:22:21.236 "trtype": "tcp", 00:22:21.236 "traddr": "10.0.0.2", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "4420", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:21.236 "hdgst": false, 00:22:21.236 "ddgst": false 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 },{ 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme7", 00:22:21.236 "trtype": "tcp", 00:22:21.236 "traddr": "10.0.0.2", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "4420", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:21.236 "hdgst": false, 00:22:21.236 "ddgst": false 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 },{ 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme8", 00:22:21.236 "trtype": "tcp", 00:22:21.236 "traddr": "10.0.0.2", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "4420", 00:22:21.236 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:21.236 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:21.236 "hdgst": false, 00:22:21.236 "ddgst": false 00:22:21.236 }, 00:22:21.236 "method": "bdev_nvme_attach_controller" 00:22:21.236 },{ 00:22:21.236 "params": { 00:22:21.236 "name": "Nvme9", 00:22:21.236 "trtype": "tcp", 00:22:21.236 "traddr": "10.0.0.2", 00:22:21.236 "adrfam": "ipv4", 00:22:21.236 "trsvcid": "4420", 00:22:21.237 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:21.237 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:21.237 "hdgst": false, 00:22:21.237 "ddgst": false 00:22:21.237 }, 00:22:21.237 "method": "bdev_nvme_attach_controller" 00:22:21.237 },{ 00:22:21.237 "params": { 00:22:21.237 "name": "Nvme10", 00:22:21.237 "trtype": "tcp", 00:22:21.237 "traddr": "10.0.0.2", 00:22:21.237 "adrfam": "ipv4", 00:22:21.237 "trsvcid": "4420", 00:22:21.237 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:21.237 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:21.237 "hdgst": false, 00:22:21.237 "ddgst": false 00:22:21.237 }, 00:22:21.237 "method": "bdev_nvme_attach_controller" 00:22:21.237 }' 00:22:21.237 [2024-11-29 09:45:44.044842] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:21.237 [2024-11-29 09:45:44.044927] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:21.237 EAL: No free 2048 kB hugepages reported on node 1 00:22:21.496 [2024-11-29 09:45:44.109292] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:21.496 [2024-11-29 09:45:44.216696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:23.408 09:45:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:23.408 09:45:45 -- common/autotest_common.sh@862 -- # return 0 00:22:23.408 09:45:45 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:23.408 09:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:23.408 09:45:45 -- common/autotest_common.sh@10 -- # set +x 00:22:23.408 09:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:23.408 09:45:45 -- target/shutdown.sh@83 -- # kill -9 91012 00:22:23.408 09:45:45 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:23.408 09:45:45 -- target/shutdown.sh@87 -- # sleep 1 00:22:24.348 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 91012 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:24.348 09:45:46 -- target/shutdown.sh@88 -- # kill -0 90694 00:22:24.348 09:45:46 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:24.348 09:45:46 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:24.348 09:45:46 -- nvmf/common.sh@520 -- # config=() 00:22:24.348 09:45:46 -- nvmf/common.sh@520 -- # local subsystem config 00:22:24.348 09:45:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:24.348 09:45:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:24.348 { 00:22:24.348 "params": { 00:22:24.348 "name": "Nvme$subsystem", 00:22:24.348 "trtype": "$TEST_TRANSPORT", 00:22:24.348 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:24.348 "adrfam": "ipv4", 00:22:24.348 "trsvcid": "$NVMF_PORT", 00:22:24.348 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:24.348 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:24.348 "hdgst": ${hdgst:-false}, 00:22:24.348 "ddgst": ${ddgst:-false} 00:22:24.348 }, 00:22:24.349 "method": "bdev_nvme_attach_controller" 00:22:24.349 } 00:22:24.349 EOF 00:22:24.349 )") 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # cat 00:22:24.349 09:45:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:24.349 { 00:22:24.349 "params": { 00:22:24.349 "name": "Nvme$subsystem", 00:22:24.349 "trtype": "$TEST_TRANSPORT", 00:22:24.349 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:24.349 "adrfam": "ipv4", 00:22:24.349 "trsvcid": "$NVMF_PORT", 00:22:24.349 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:24.349 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:24.349 "hdgst": ${hdgst:-false}, 00:22:24.349 "ddgst": ${ddgst:-false} 00:22:24.349 }, 00:22:24.349 "method": "bdev_nvme_attach_controller" 00:22:24.349 } 00:22:24.349 EOF 00:22:24.349 )") 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # cat 00:22:24.349 09:45:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:24.349 { 00:22:24.349 "params": { 00:22:24.349 "name": "Nvme$subsystem", 00:22:24.349 "trtype": "$TEST_TRANSPORT", 00:22:24.349 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:24.349 "adrfam": "ipv4", 00:22:24.349 "trsvcid": "$NVMF_PORT", 00:22:24.349 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:24.349 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:24.349 "hdgst": ${hdgst:-false}, 00:22:24.349 "ddgst": ${ddgst:-false} 00:22:24.349 }, 00:22:24.349 "method": "bdev_nvme_attach_controller" 00:22:24.349 } 00:22:24.349 EOF 00:22:24.349 )") 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # cat 00:22:24.349 09:45:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:24.349 { 00:22:24.349 "params": { 00:22:24.349 "name": "Nvme$subsystem", 00:22:24.349 "trtype": "$TEST_TRANSPORT", 00:22:24.349 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:24.349 "adrfam": "ipv4", 00:22:24.349 "trsvcid": "$NVMF_PORT", 00:22:24.349 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:24.349 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:24.349 "hdgst": ${hdgst:-false}, 00:22:24.349 "ddgst": ${ddgst:-false} 00:22:24.349 }, 00:22:24.349 "method": "bdev_nvme_attach_controller" 00:22:24.349 } 00:22:24.349 EOF 00:22:24.349 )") 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # cat 00:22:24.349 09:45:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:24.349 { 00:22:24.349 "params": { 00:22:24.349 "name": "Nvme$subsystem", 00:22:24.349 "trtype": "$TEST_TRANSPORT", 00:22:24.349 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:24.349 "adrfam": "ipv4", 00:22:24.349 "trsvcid": "$NVMF_PORT", 00:22:24.349 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:24.349 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:24.349 "hdgst": ${hdgst:-false}, 00:22:24.349 "ddgst": ${ddgst:-false} 00:22:24.349 }, 00:22:24.349 "method": "bdev_nvme_attach_controller" 00:22:24.349 } 00:22:24.349 EOF 00:22:24.349 )") 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # cat 00:22:24.349 09:45:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:24.349 { 00:22:24.349 "params": { 00:22:24.349 "name": "Nvme$subsystem", 00:22:24.349 "trtype": "$TEST_TRANSPORT", 00:22:24.349 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:24.349 "adrfam": "ipv4", 00:22:24.349 "trsvcid": "$NVMF_PORT", 00:22:24.349 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:24.349 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:24.349 "hdgst": ${hdgst:-false}, 00:22:24.349 "ddgst": ${ddgst:-false} 00:22:24.349 }, 00:22:24.349 "method": "bdev_nvme_attach_controller" 00:22:24.349 } 00:22:24.349 EOF 00:22:24.349 )") 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # cat 00:22:24.349 09:45:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:24.349 { 00:22:24.349 "params": { 00:22:24.349 "name": "Nvme$subsystem", 00:22:24.349 "trtype": "$TEST_TRANSPORT", 00:22:24.349 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:24.349 "adrfam": "ipv4", 00:22:24.349 "trsvcid": "$NVMF_PORT", 00:22:24.349 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:24.349 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:24.349 "hdgst": ${hdgst:-false}, 00:22:24.349 "ddgst": ${ddgst:-false} 00:22:24.349 }, 00:22:24.349 "method": "bdev_nvme_attach_controller" 00:22:24.349 } 00:22:24.349 EOF 00:22:24.349 )") 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # cat 00:22:24.349 09:45:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:24.349 { 00:22:24.349 "params": { 00:22:24.349 "name": "Nvme$subsystem", 00:22:24.349 "trtype": "$TEST_TRANSPORT", 00:22:24.349 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:24.349 "adrfam": "ipv4", 00:22:24.349 "trsvcid": "$NVMF_PORT", 00:22:24.349 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:24.349 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:24.349 "hdgst": ${hdgst:-false}, 00:22:24.349 "ddgst": ${ddgst:-false} 00:22:24.349 }, 00:22:24.349 "method": "bdev_nvme_attach_controller" 00:22:24.349 } 00:22:24.349 EOF 00:22:24.349 )") 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # cat 00:22:24.349 09:45:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:24.349 { 00:22:24.349 "params": { 00:22:24.349 "name": "Nvme$subsystem", 00:22:24.349 "trtype": "$TEST_TRANSPORT", 00:22:24.349 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:24.349 "adrfam": "ipv4", 00:22:24.349 "trsvcid": "$NVMF_PORT", 00:22:24.349 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:24.349 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:24.349 "hdgst": ${hdgst:-false}, 00:22:24.349 "ddgst": ${ddgst:-false} 00:22:24.349 }, 00:22:24.349 "method": "bdev_nvme_attach_controller" 00:22:24.349 } 00:22:24.349 EOF 00:22:24.349 )") 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # cat 00:22:24.349 09:45:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:24.349 { 00:22:24.349 "params": { 00:22:24.349 "name": "Nvme$subsystem", 00:22:24.349 "trtype": "$TEST_TRANSPORT", 00:22:24.349 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:24.349 "adrfam": "ipv4", 00:22:24.349 "trsvcid": "$NVMF_PORT", 00:22:24.349 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:24.349 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:24.349 "hdgst": ${hdgst:-false}, 00:22:24.349 "ddgst": ${ddgst:-false} 00:22:24.349 }, 00:22:24.349 "method": "bdev_nvme_attach_controller" 00:22:24.349 } 00:22:24.349 EOF 00:22:24.349 )") 00:22:24.349 09:45:46 -- nvmf/common.sh@542 -- # cat 00:22:24.349 09:45:46 -- nvmf/common.sh@544 -- # jq . 00:22:24.349 09:45:46 -- nvmf/common.sh@545 -- # IFS=, 00:22:24.349 09:45:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:24.349 "params": { 00:22:24.349 "name": "Nvme1", 00:22:24.349 "trtype": "tcp", 00:22:24.349 "traddr": "10.0.0.2", 00:22:24.349 "adrfam": "ipv4", 00:22:24.349 "trsvcid": "4420", 00:22:24.349 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:24.349 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:24.349 "hdgst": false, 00:22:24.349 "ddgst": false 00:22:24.349 }, 00:22:24.349 "method": "bdev_nvme_attach_controller" 00:22:24.349 },{ 00:22:24.349 "params": { 00:22:24.349 "name": "Nvme2", 00:22:24.349 "trtype": "tcp", 00:22:24.349 "traddr": "10.0.0.2", 00:22:24.349 "adrfam": "ipv4", 00:22:24.349 "trsvcid": "4420", 00:22:24.349 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:24.349 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:24.349 "hdgst": false, 00:22:24.349 "ddgst": false 00:22:24.349 }, 00:22:24.349 "method": "bdev_nvme_attach_controller" 00:22:24.349 },{ 00:22:24.349 "params": { 00:22:24.349 "name": "Nvme3", 00:22:24.349 "trtype": "tcp", 00:22:24.349 "traddr": "10.0.0.2", 00:22:24.349 "adrfam": "ipv4", 00:22:24.349 "trsvcid": "4420", 00:22:24.349 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:24.349 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:24.349 "hdgst": false, 00:22:24.349 "ddgst": false 00:22:24.349 }, 00:22:24.349 "method": "bdev_nvme_attach_controller" 00:22:24.349 },{ 00:22:24.349 "params": { 00:22:24.349 "name": "Nvme4", 00:22:24.349 "trtype": "tcp", 00:22:24.349 "traddr": "10.0.0.2", 00:22:24.349 "adrfam": "ipv4", 00:22:24.349 "trsvcid": "4420", 00:22:24.349 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:24.349 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:24.349 "hdgst": false, 00:22:24.349 "ddgst": false 00:22:24.349 }, 00:22:24.349 "method": "bdev_nvme_attach_controller" 00:22:24.349 },{ 00:22:24.349 "params": { 00:22:24.349 "name": "Nvme5", 00:22:24.349 "trtype": "tcp", 00:22:24.349 "traddr": "10.0.0.2", 00:22:24.349 "adrfam": "ipv4", 00:22:24.349 "trsvcid": "4420", 00:22:24.350 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:24.350 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:24.350 "hdgst": false, 00:22:24.350 "ddgst": false 00:22:24.350 }, 00:22:24.350 "method": "bdev_nvme_attach_controller" 00:22:24.350 },{ 00:22:24.350 "params": { 00:22:24.350 "name": "Nvme6", 00:22:24.350 "trtype": "tcp", 00:22:24.350 "traddr": "10.0.0.2", 00:22:24.350 "adrfam": "ipv4", 00:22:24.350 "trsvcid": "4420", 00:22:24.350 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:24.350 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:24.350 "hdgst": false, 00:22:24.350 "ddgst": false 00:22:24.350 }, 00:22:24.350 "method": "bdev_nvme_attach_controller" 00:22:24.350 },{ 00:22:24.350 "params": { 00:22:24.350 "name": "Nvme7", 00:22:24.350 "trtype": "tcp", 00:22:24.350 "traddr": "10.0.0.2", 00:22:24.350 "adrfam": "ipv4", 00:22:24.350 "trsvcid": "4420", 00:22:24.350 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:24.350 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:24.350 "hdgst": false, 00:22:24.350 "ddgst": false 00:22:24.350 }, 00:22:24.350 "method": "bdev_nvme_attach_controller" 00:22:24.350 },{ 00:22:24.350 "params": { 00:22:24.350 "name": "Nvme8", 00:22:24.350 "trtype": "tcp", 00:22:24.350 "traddr": "10.0.0.2", 00:22:24.350 "adrfam": "ipv4", 00:22:24.350 "trsvcid": "4420", 00:22:24.350 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:24.350 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:24.350 "hdgst": false, 00:22:24.350 "ddgst": false 00:22:24.350 }, 00:22:24.350 "method": "bdev_nvme_attach_controller" 00:22:24.350 },{ 00:22:24.350 "params": { 00:22:24.350 "name": "Nvme9", 00:22:24.350 "trtype": "tcp", 00:22:24.350 "traddr": "10.0.0.2", 00:22:24.350 "adrfam": "ipv4", 00:22:24.350 "trsvcid": "4420", 00:22:24.350 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:24.350 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:24.350 "hdgst": false, 00:22:24.350 "ddgst": false 00:22:24.350 }, 00:22:24.350 "method": "bdev_nvme_attach_controller" 00:22:24.350 },{ 00:22:24.350 "params": { 00:22:24.350 "name": "Nvme10", 00:22:24.350 "trtype": "tcp", 00:22:24.350 "traddr": "10.0.0.2", 00:22:24.350 "adrfam": "ipv4", 00:22:24.350 "trsvcid": "4420", 00:22:24.350 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:24.350 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:24.350 "hdgst": false, 00:22:24.350 "ddgst": false 00:22:24.350 }, 00:22:24.350 "method": "bdev_nvme_attach_controller" 00:22:24.350 }' 00:22:24.350 [2024-11-29 09:45:46.896779] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:24.350 [2024-11-29 09:45:46.896863] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91315 ] 00:22:24.350 EAL: No free 2048 kB hugepages reported on node 1 00:22:24.350 [2024-11-29 09:45:46.964298] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:24.350 [2024-11-29 09:45:47.073128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:26.257 Running I/O for 1 seconds... 00:22:27.194 00:22:27.194 Latency(us) 00:22:27.194 [2024-11-29T08:45:50.037Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:27.194 [2024-11-29T08:45:50.037Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.194 Verification LBA range: start 0x0 length 0x400 00:22:27.194 Nvme1n1 : 1.09 397.12 24.82 0.00 0.00 158468.15 17379.18 139033.41 00:22:27.194 [2024-11-29T08:45:50.037Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.194 Verification LBA range: start 0x0 length 0x400 00:22:27.194 Nvme2n1 : 1.10 395.70 24.73 0.00 0.00 157831.47 18155.90 121945.51 00:22:27.194 [2024-11-29T08:45:50.037Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.194 Verification LBA range: start 0x0 length 0x400 00:22:27.194 Nvme3n1 : 1.10 394.08 24.63 0.00 0.00 157160.79 20097.71 116508.44 00:22:27.194 [2024-11-29T08:45:50.037Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.194 Verification LBA range: start 0x0 length 0x400 00:22:27.194 Nvme4n1 : 1.11 392.63 24.54 0.00 0.00 156628.13 20583.16 117285.17 00:22:27.194 [2024-11-29T08:45:50.037Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.194 Verification LBA range: start 0x0 length 0x400 00:22:27.194 Nvme5n1 : 1.11 391.42 24.46 0.00 0.00 156167.74 19612.25 118838.61 00:22:27.194 [2024-11-29T08:45:50.037Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.194 Verification LBA range: start 0x0 length 0x400 00:22:27.194 Nvme6n1 : 1.11 389.85 24.37 0.00 0.00 155884.97 18155.90 122722.23 00:22:27.194 [2024-11-29T08:45:50.037Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.194 Verification LBA range: start 0x0 length 0x400 00:22:27.194 Nvme7n1 : 1.12 388.56 24.29 0.00 0.00 155433.07 17185.00 124275.67 00:22:27.194 [2024-11-29T08:45:50.037Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.194 Verification LBA range: start 0x0 length 0x400 00:22:27.194 Nvme8n1 : 1.12 387.87 24.24 0.00 0.00 154887.89 14272.28 127382.57 00:22:27.194 [2024-11-29T08:45:50.037Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.194 Verification LBA range: start 0x0 length 0x400 00:22:27.194 Nvme9n1 : 1.12 387.03 24.19 0.00 0.00 154702.26 10631.40 129712.73 00:22:27.194 [2024-11-29T08:45:50.037Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.194 Verification LBA range: start 0x0 length 0x400 00:22:27.194 Nvme10n1 : 1.12 386.26 24.14 0.00 0.00 154231.13 8058.50 131266.18 00:22:27.194 [2024-11-29T08:45:50.037Z] =================================================================================================================== 00:22:27.194 [2024-11-29T08:45:50.037Z] Total : 3910.52 244.41 0.00 0.00 156139.56 8058.50 139033.41 00:22:27.194 09:45:50 -- target/shutdown.sh@93 -- # stoptarget 00:22:27.194 09:45:50 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:27.194 09:45:50 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:27.194 09:45:50 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:27.194 09:45:50 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:27.194 09:45:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:27.194 09:45:50 -- nvmf/common.sh@116 -- # sync 00:22:27.194 09:45:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:27.194 09:45:50 -- nvmf/common.sh@119 -- # set +e 00:22:27.194 09:45:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:27.195 09:45:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:27.195 rmmod nvme_tcp 00:22:27.453 rmmod nvme_fabrics 00:22:27.453 rmmod nvme_keyring 00:22:27.453 09:45:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:27.453 09:45:50 -- nvmf/common.sh@123 -- # set -e 00:22:27.453 09:45:50 -- nvmf/common.sh@124 -- # return 0 00:22:27.453 09:45:50 -- nvmf/common.sh@477 -- # '[' -n 90694 ']' 00:22:27.453 09:45:50 -- nvmf/common.sh@478 -- # killprocess 90694 00:22:27.453 09:45:50 -- common/autotest_common.sh@936 -- # '[' -z 90694 ']' 00:22:27.453 09:45:50 -- common/autotest_common.sh@940 -- # kill -0 90694 00:22:27.453 09:45:50 -- common/autotest_common.sh@941 -- # uname 00:22:27.453 09:45:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:27.453 09:45:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 90694 00:22:27.453 09:45:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:27.453 09:45:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:27.453 09:45:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 90694' 00:22:27.453 killing process with pid 90694 00:22:27.453 09:45:50 -- common/autotest_common.sh@955 -- # kill 90694 00:22:27.453 09:45:50 -- common/autotest_common.sh@960 -- # wait 90694 00:22:28.020 09:45:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:28.020 09:45:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:28.020 09:45:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:28.020 09:45:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:28.020 09:45:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:28.020 09:45:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:28.020 09:45:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:28.020 09:45:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:29.925 09:45:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:29.925 00:22:29.925 real 0m12.579s 00:22:29.925 user 0m37.347s 00:22:29.925 sys 0m3.387s 00:22:29.925 09:45:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:29.925 09:45:52 -- common/autotest_common.sh@10 -- # set +x 00:22:29.925 ************************************ 00:22:29.925 END TEST nvmf_shutdown_tc1 00:22:29.925 ************************************ 00:22:29.925 09:45:52 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:29.925 09:45:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:29.925 09:45:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:29.925 09:45:52 -- common/autotest_common.sh@10 -- # set +x 00:22:29.925 ************************************ 00:22:29.925 START TEST nvmf_shutdown_tc2 00:22:29.925 ************************************ 00:22:29.925 09:45:52 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:29.925 09:45:52 -- target/shutdown.sh@98 -- # starttarget 00:22:29.925 09:45:52 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:29.925 09:45:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:29.925 09:45:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:29.925 09:45:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:29.925 09:45:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:29.925 09:45:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:29.925 09:45:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:29.925 09:45:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:29.925 09:45:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:29.925 09:45:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:29.925 09:45:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:29.925 09:45:52 -- common/autotest_common.sh@10 -- # set +x 00:22:29.925 09:45:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:29.925 09:45:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:29.925 09:45:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:29.925 09:45:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:29.925 09:45:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:29.925 09:45:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:29.925 09:45:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:29.925 09:45:52 -- nvmf/common.sh@294 -- # net_devs=() 00:22:29.925 09:45:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:29.925 09:45:52 -- nvmf/common.sh@295 -- # e810=() 00:22:29.925 09:45:52 -- nvmf/common.sh@295 -- # local -ga e810 00:22:29.925 09:45:52 -- nvmf/common.sh@296 -- # x722=() 00:22:29.925 09:45:52 -- nvmf/common.sh@296 -- # local -ga x722 00:22:29.925 09:45:52 -- nvmf/common.sh@297 -- # mlx=() 00:22:29.925 09:45:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:29.925 09:45:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:29.925 09:45:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:29.925 09:45:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:29.925 09:45:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:29.925 09:45:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:29.925 09:45:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:29.925 09:45:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:29.925 09:45:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:29.925 09:45:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:29.925 09:45:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:29.925 09:45:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:29.925 09:45:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:29.925 09:45:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:29.925 09:45:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:29.925 09:45:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:29.925 09:45:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:29.925 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:29.925 09:45:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:29.925 09:45:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:29.925 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:29.925 09:45:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:29.925 09:45:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:29.925 09:45:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:29.925 09:45:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:29.925 09:45:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:29.925 09:45:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:29.925 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:29.925 09:45:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:29.925 09:45:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:29.925 09:45:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:29.925 09:45:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:29.925 09:45:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:29.925 09:45:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:29.925 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:29.925 09:45:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:29.925 09:45:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:29.925 09:45:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:29.925 09:45:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:29.925 09:45:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:29.925 09:45:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:29.925 09:45:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:29.925 09:45:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:29.925 09:45:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:29.925 09:45:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:29.925 09:45:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:29.925 09:45:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:29.925 09:45:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:29.925 09:45:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:29.925 09:45:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:29.925 09:45:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:29.925 09:45:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:29.925 09:45:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:30.184 09:45:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:30.184 09:45:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:30.184 09:45:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:30.184 09:45:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:30.184 09:45:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:30.184 09:45:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:30.184 09:45:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:30.184 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:30.184 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.351 ms 00:22:30.184 00:22:30.184 --- 10.0.0.2 ping statistics --- 00:22:30.184 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:30.184 rtt min/avg/max/mdev = 0.351/0.351/0.351/0.000 ms 00:22:30.184 09:45:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:30.184 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:30.184 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:22:30.184 00:22:30.184 --- 10.0.0.1 ping statistics --- 00:22:30.184 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:30.184 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:22:30.184 09:45:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:30.184 09:45:52 -- nvmf/common.sh@410 -- # return 0 00:22:30.184 09:45:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:30.184 09:45:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:30.184 09:45:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:30.184 09:45:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:30.184 09:45:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:30.184 09:45:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:30.184 09:45:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:30.184 09:45:52 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:30.184 09:45:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:30.184 09:45:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:30.184 09:45:52 -- common/autotest_common.sh@10 -- # set +x 00:22:30.184 09:45:52 -- nvmf/common.sh@469 -- # nvmfpid=92105 00:22:30.184 09:45:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:30.184 09:45:52 -- nvmf/common.sh@470 -- # waitforlisten 92105 00:22:30.184 09:45:52 -- common/autotest_common.sh@829 -- # '[' -z 92105 ']' 00:22:30.184 09:45:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:30.184 09:45:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:30.184 09:45:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:30.184 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:30.184 09:45:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:30.184 09:45:52 -- common/autotest_common.sh@10 -- # set +x 00:22:30.184 [2024-11-29 09:45:52.929761] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:30.184 [2024-11-29 09:45:52.929835] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:30.184 EAL: No free 2048 kB hugepages reported on node 1 00:22:30.184 [2024-11-29 09:45:52.998889] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:30.444 [2024-11-29 09:45:53.108421] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:30.444 [2024-11-29 09:45:53.108581] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:30.444 [2024-11-29 09:45:53.108598] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:30.444 [2024-11-29 09:45:53.108610] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:30.444 [2024-11-29 09:45:53.108707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:30.444 [2024-11-29 09:45:53.108822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:30.444 [2024-11-29 09:45:53.108853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:30.444 [2024-11-29 09:45:53.108855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:31.380 09:45:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:31.380 09:45:53 -- common/autotest_common.sh@862 -- # return 0 00:22:31.380 09:45:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:31.380 09:45:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:31.380 09:45:53 -- common/autotest_common.sh@10 -- # set +x 00:22:31.380 09:45:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:31.380 09:45:53 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:31.380 09:45:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.380 09:45:53 -- common/autotest_common.sh@10 -- # set +x 00:22:31.380 [2024-11-29 09:45:53.992161] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:31.380 09:45:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.380 09:45:53 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:31.380 09:45:53 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:31.380 09:45:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:31.380 09:45:53 -- common/autotest_common.sh@10 -- # set +x 00:22:31.381 09:45:54 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:31.381 09:45:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.381 09:45:54 -- target/shutdown.sh@28 -- # cat 00:22:31.381 09:45:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.381 09:45:54 -- target/shutdown.sh@28 -- # cat 00:22:31.381 09:45:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.381 09:45:54 -- target/shutdown.sh@28 -- # cat 00:22:31.381 09:45:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.381 09:45:54 -- target/shutdown.sh@28 -- # cat 00:22:31.381 09:45:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.381 09:45:54 -- target/shutdown.sh@28 -- # cat 00:22:31.381 09:45:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.381 09:45:54 -- target/shutdown.sh@28 -- # cat 00:22:31.381 09:45:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.381 09:45:54 -- target/shutdown.sh@28 -- # cat 00:22:31.381 09:45:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.381 09:45:54 -- target/shutdown.sh@28 -- # cat 00:22:31.381 09:45:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.381 09:45:54 -- target/shutdown.sh@28 -- # cat 00:22:31.381 09:45:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.381 09:45:54 -- target/shutdown.sh@28 -- # cat 00:22:31.381 09:45:54 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:31.381 09:45:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.381 09:45:54 -- common/autotest_common.sh@10 -- # set +x 00:22:31.381 Malloc1 00:22:31.381 [2024-11-29 09:45:54.067949] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:31.381 Malloc2 00:22:31.381 Malloc3 00:22:31.381 Malloc4 00:22:31.640 Malloc5 00:22:31.640 Malloc6 00:22:31.640 Malloc7 00:22:31.640 Malloc8 00:22:31.640 Malloc9 00:22:31.899 Malloc10 00:22:31.899 09:45:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.899 09:45:54 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:31.899 09:45:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:31.899 09:45:54 -- common/autotest_common.sh@10 -- # set +x 00:22:31.899 09:45:54 -- target/shutdown.sh@102 -- # perfpid=92418 00:22:31.899 09:45:54 -- target/shutdown.sh@103 -- # waitforlisten 92418 /var/tmp/bdevperf.sock 00:22:31.899 09:45:54 -- common/autotest_common.sh@829 -- # '[' -z 92418 ']' 00:22:31.899 09:45:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:31.899 09:45:54 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:31.899 09:45:54 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:31.899 09:45:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:31.899 09:45:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:31.899 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:31.899 09:45:54 -- nvmf/common.sh@520 -- # config=() 00:22:31.899 09:45:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:31.899 09:45:54 -- nvmf/common.sh@520 -- # local subsystem config 00:22:31.899 09:45:54 -- common/autotest_common.sh@10 -- # set +x 00:22:31.899 09:45:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.899 09:45:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.899 { 00:22:31.899 "params": { 00:22:31.899 "name": "Nvme$subsystem", 00:22:31.899 "trtype": "$TEST_TRANSPORT", 00:22:31.899 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.899 "adrfam": "ipv4", 00:22:31.899 "trsvcid": "$NVMF_PORT", 00:22:31.899 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.900 "hdgst": ${hdgst:-false}, 00:22:31.900 "ddgst": ${ddgst:-false} 00:22:31.900 }, 00:22:31.900 "method": "bdev_nvme_attach_controller" 00:22:31.900 } 00:22:31.900 EOF 00:22:31.900 )") 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # cat 00:22:31.900 09:45:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.900 { 00:22:31.900 "params": { 00:22:31.900 "name": "Nvme$subsystem", 00:22:31.900 "trtype": "$TEST_TRANSPORT", 00:22:31.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.900 "adrfam": "ipv4", 00:22:31.900 "trsvcid": "$NVMF_PORT", 00:22:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.900 "hdgst": ${hdgst:-false}, 00:22:31.900 "ddgst": ${ddgst:-false} 00:22:31.900 }, 00:22:31.900 "method": "bdev_nvme_attach_controller" 00:22:31.900 } 00:22:31.900 EOF 00:22:31.900 )") 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # cat 00:22:31.900 09:45:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.900 { 00:22:31.900 "params": { 00:22:31.900 "name": "Nvme$subsystem", 00:22:31.900 "trtype": "$TEST_TRANSPORT", 00:22:31.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.900 "adrfam": "ipv4", 00:22:31.900 "trsvcid": "$NVMF_PORT", 00:22:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.900 "hdgst": ${hdgst:-false}, 00:22:31.900 "ddgst": ${ddgst:-false} 00:22:31.900 }, 00:22:31.900 "method": "bdev_nvme_attach_controller" 00:22:31.900 } 00:22:31.900 EOF 00:22:31.900 )") 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # cat 00:22:31.900 09:45:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.900 { 00:22:31.900 "params": { 00:22:31.900 "name": "Nvme$subsystem", 00:22:31.900 "trtype": "$TEST_TRANSPORT", 00:22:31.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.900 "adrfam": "ipv4", 00:22:31.900 "trsvcid": "$NVMF_PORT", 00:22:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.900 "hdgst": ${hdgst:-false}, 00:22:31.900 "ddgst": ${ddgst:-false} 00:22:31.900 }, 00:22:31.900 "method": "bdev_nvme_attach_controller" 00:22:31.900 } 00:22:31.900 EOF 00:22:31.900 )") 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # cat 00:22:31.900 09:45:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.900 { 00:22:31.900 "params": { 00:22:31.900 "name": "Nvme$subsystem", 00:22:31.900 "trtype": "$TEST_TRANSPORT", 00:22:31.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.900 "adrfam": "ipv4", 00:22:31.900 "trsvcid": "$NVMF_PORT", 00:22:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.900 "hdgst": ${hdgst:-false}, 00:22:31.900 "ddgst": ${ddgst:-false} 00:22:31.900 }, 00:22:31.900 "method": "bdev_nvme_attach_controller" 00:22:31.900 } 00:22:31.900 EOF 00:22:31.900 )") 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # cat 00:22:31.900 09:45:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.900 { 00:22:31.900 "params": { 00:22:31.900 "name": "Nvme$subsystem", 00:22:31.900 "trtype": "$TEST_TRANSPORT", 00:22:31.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.900 "adrfam": "ipv4", 00:22:31.900 "trsvcid": "$NVMF_PORT", 00:22:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.900 "hdgst": ${hdgst:-false}, 00:22:31.900 "ddgst": ${ddgst:-false} 00:22:31.900 }, 00:22:31.900 "method": "bdev_nvme_attach_controller" 00:22:31.900 } 00:22:31.900 EOF 00:22:31.900 )") 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # cat 00:22:31.900 09:45:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.900 { 00:22:31.900 "params": { 00:22:31.900 "name": "Nvme$subsystem", 00:22:31.900 "trtype": "$TEST_TRANSPORT", 00:22:31.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.900 "adrfam": "ipv4", 00:22:31.900 "trsvcid": "$NVMF_PORT", 00:22:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.900 "hdgst": ${hdgst:-false}, 00:22:31.900 "ddgst": ${ddgst:-false} 00:22:31.900 }, 00:22:31.900 "method": "bdev_nvme_attach_controller" 00:22:31.900 } 00:22:31.900 EOF 00:22:31.900 )") 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # cat 00:22:31.900 09:45:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.900 { 00:22:31.900 "params": { 00:22:31.900 "name": "Nvme$subsystem", 00:22:31.900 "trtype": "$TEST_TRANSPORT", 00:22:31.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.900 "adrfam": "ipv4", 00:22:31.900 "trsvcid": "$NVMF_PORT", 00:22:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.900 "hdgst": ${hdgst:-false}, 00:22:31.900 "ddgst": ${ddgst:-false} 00:22:31.900 }, 00:22:31.900 "method": "bdev_nvme_attach_controller" 00:22:31.900 } 00:22:31.900 EOF 00:22:31.900 )") 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # cat 00:22:31.900 09:45:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.900 { 00:22:31.900 "params": { 00:22:31.900 "name": "Nvme$subsystem", 00:22:31.900 "trtype": "$TEST_TRANSPORT", 00:22:31.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.900 "adrfam": "ipv4", 00:22:31.900 "trsvcid": "$NVMF_PORT", 00:22:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.900 "hdgst": ${hdgst:-false}, 00:22:31.900 "ddgst": ${ddgst:-false} 00:22:31.900 }, 00:22:31.900 "method": "bdev_nvme_attach_controller" 00:22:31.900 } 00:22:31.900 EOF 00:22:31.900 )") 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # cat 00:22:31.900 09:45:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.900 { 00:22:31.900 "params": { 00:22:31.900 "name": "Nvme$subsystem", 00:22:31.900 "trtype": "$TEST_TRANSPORT", 00:22:31.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.900 "adrfam": "ipv4", 00:22:31.900 "trsvcid": "$NVMF_PORT", 00:22:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.900 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.900 "hdgst": ${hdgst:-false}, 00:22:31.900 "ddgst": ${ddgst:-false} 00:22:31.900 }, 00:22:31.900 "method": "bdev_nvme_attach_controller" 00:22:31.900 } 00:22:31.900 EOF 00:22:31.900 )") 00:22:31.900 09:45:54 -- nvmf/common.sh@542 -- # cat 00:22:31.900 09:45:54 -- nvmf/common.sh@544 -- # jq . 00:22:31.900 09:45:54 -- nvmf/common.sh@545 -- # IFS=, 00:22:31.900 09:45:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:31.900 "params": { 00:22:31.900 "name": "Nvme1", 00:22:31.900 "trtype": "tcp", 00:22:31.900 "traddr": "10.0.0.2", 00:22:31.900 "adrfam": "ipv4", 00:22:31.900 "trsvcid": "4420", 00:22:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:31.900 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:31.900 "hdgst": false, 00:22:31.900 "ddgst": false 00:22:31.900 }, 00:22:31.900 "method": "bdev_nvme_attach_controller" 00:22:31.900 },{ 00:22:31.900 "params": { 00:22:31.900 "name": "Nvme2", 00:22:31.900 "trtype": "tcp", 00:22:31.900 "traddr": "10.0.0.2", 00:22:31.900 "adrfam": "ipv4", 00:22:31.900 "trsvcid": "4420", 00:22:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:31.900 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:31.900 "hdgst": false, 00:22:31.900 "ddgst": false 00:22:31.900 }, 00:22:31.900 "method": "bdev_nvme_attach_controller" 00:22:31.900 },{ 00:22:31.900 "params": { 00:22:31.900 "name": "Nvme3", 00:22:31.900 "trtype": "tcp", 00:22:31.900 "traddr": "10.0.0.2", 00:22:31.900 "adrfam": "ipv4", 00:22:31.900 "trsvcid": "4420", 00:22:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:31.900 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:31.900 "hdgst": false, 00:22:31.900 "ddgst": false 00:22:31.900 }, 00:22:31.900 "method": "bdev_nvme_attach_controller" 00:22:31.900 },{ 00:22:31.900 "params": { 00:22:31.900 "name": "Nvme4", 00:22:31.900 "trtype": "tcp", 00:22:31.900 "traddr": "10.0.0.2", 00:22:31.900 "adrfam": "ipv4", 00:22:31.900 "trsvcid": "4420", 00:22:31.900 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:31.900 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:31.900 "hdgst": false, 00:22:31.900 "ddgst": false 00:22:31.900 }, 00:22:31.900 "method": "bdev_nvme_attach_controller" 00:22:31.900 },{ 00:22:31.900 "params": { 00:22:31.900 "name": "Nvme5", 00:22:31.900 "trtype": "tcp", 00:22:31.900 "traddr": "10.0.0.2", 00:22:31.900 "adrfam": "ipv4", 00:22:31.901 "trsvcid": "4420", 00:22:31.901 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:31.901 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:31.901 "hdgst": false, 00:22:31.901 "ddgst": false 00:22:31.901 }, 00:22:31.901 "method": "bdev_nvme_attach_controller" 00:22:31.901 },{ 00:22:31.901 "params": { 00:22:31.901 "name": "Nvme6", 00:22:31.901 "trtype": "tcp", 00:22:31.901 "traddr": "10.0.0.2", 00:22:31.901 "adrfam": "ipv4", 00:22:31.901 "trsvcid": "4420", 00:22:31.901 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:31.901 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:31.901 "hdgst": false, 00:22:31.901 "ddgst": false 00:22:31.901 }, 00:22:31.901 "method": "bdev_nvme_attach_controller" 00:22:31.901 },{ 00:22:31.901 "params": { 00:22:31.901 "name": "Nvme7", 00:22:31.901 "trtype": "tcp", 00:22:31.901 "traddr": "10.0.0.2", 00:22:31.901 "adrfam": "ipv4", 00:22:31.901 "trsvcid": "4420", 00:22:31.901 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:31.901 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:31.901 "hdgst": false, 00:22:31.901 "ddgst": false 00:22:31.901 }, 00:22:31.901 "method": "bdev_nvme_attach_controller" 00:22:31.901 },{ 00:22:31.901 "params": { 00:22:31.901 "name": "Nvme8", 00:22:31.901 "trtype": "tcp", 00:22:31.901 "traddr": "10.0.0.2", 00:22:31.901 "adrfam": "ipv4", 00:22:31.901 "trsvcid": "4420", 00:22:31.901 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:31.901 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:31.901 "hdgst": false, 00:22:31.901 "ddgst": false 00:22:31.901 }, 00:22:31.901 "method": "bdev_nvme_attach_controller" 00:22:31.901 },{ 00:22:31.901 "params": { 00:22:31.901 "name": "Nvme9", 00:22:31.901 "trtype": "tcp", 00:22:31.901 "traddr": "10.0.0.2", 00:22:31.901 "adrfam": "ipv4", 00:22:31.901 "trsvcid": "4420", 00:22:31.901 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:31.901 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:31.901 "hdgst": false, 00:22:31.901 "ddgst": false 00:22:31.901 }, 00:22:31.901 "method": "bdev_nvme_attach_controller" 00:22:31.901 },{ 00:22:31.901 "params": { 00:22:31.901 "name": "Nvme10", 00:22:31.901 "trtype": "tcp", 00:22:31.901 "traddr": "10.0.0.2", 00:22:31.901 "adrfam": "ipv4", 00:22:31.901 "trsvcid": "4420", 00:22:31.901 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:31.901 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:31.901 "hdgst": false, 00:22:31.901 "ddgst": false 00:22:31.901 }, 00:22:31.901 "method": "bdev_nvme_attach_controller" 00:22:31.901 }' 00:22:31.901 [2024-11-29 09:45:54.576499] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:31.901 [2024-11-29 09:45:54.576575] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92418 ] 00:22:31.901 EAL: No free 2048 kB hugepages reported on node 1 00:22:31.901 [2024-11-29 09:45:54.639254] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:32.160 [2024-11-29 09:45:54.747491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:33.551 Running I/O for 10 seconds... 00:22:34.488 09:45:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:34.488 09:45:57 -- common/autotest_common.sh@862 -- # return 0 00:22:34.488 09:45:57 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:34.488 09:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.488 09:45:57 -- common/autotest_common.sh@10 -- # set +x 00:22:34.488 09:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.488 09:45:57 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:34.488 09:45:57 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:34.488 09:45:57 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:34.488 09:45:57 -- target/shutdown.sh@57 -- # local ret=1 00:22:34.488 09:45:57 -- target/shutdown.sh@58 -- # local i 00:22:34.488 09:45:57 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:34.488 09:45:57 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:34.488 09:45:57 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:34.488 09:45:57 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:34.488 09:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.488 09:45:57 -- common/autotest_common.sh@10 -- # set +x 00:22:34.488 09:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.488 09:45:57 -- target/shutdown.sh@60 -- # read_io_count=254 00:22:34.488 09:45:57 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:22:34.488 09:45:57 -- target/shutdown.sh@64 -- # ret=0 00:22:34.488 09:45:57 -- target/shutdown.sh@65 -- # break 00:22:34.488 09:45:57 -- target/shutdown.sh@69 -- # return 0 00:22:34.488 09:45:57 -- target/shutdown.sh@109 -- # killprocess 92418 00:22:34.488 09:45:57 -- common/autotest_common.sh@936 -- # '[' -z 92418 ']' 00:22:34.488 09:45:57 -- common/autotest_common.sh@940 -- # kill -0 92418 00:22:34.488 09:45:57 -- common/autotest_common.sh@941 -- # uname 00:22:34.488 09:45:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:34.488 09:45:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 92418 00:22:34.488 09:45:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:34.488 09:45:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:34.488 09:45:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 92418' 00:22:34.488 killing process with pid 92418 00:22:34.488 09:45:57 -- common/autotest_common.sh@955 -- # kill 92418 00:22:34.488 09:45:57 -- common/autotest_common.sh@960 -- # wait 92418 00:22:34.488 Received shutdown signal, test time was about 0.883186 seconds 00:22:34.488 00:22:34.488 Latency(us) 00:22:34.488 [2024-11-29T08:45:57.331Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:34.488 [2024-11-29T08:45:57.331Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.488 Verification LBA range: start 0x0 length 0x400 00:22:34.488 Nvme1n1 : 0.87 407.22 25.45 0.00 0.00 153679.42 21942.42 121168.78 00:22:34.488 [2024-11-29T08:45:57.331Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.488 Verification LBA range: start 0x0 length 0x400 00:22:34.488 Nvme2n1 : 0.88 405.39 25.34 0.00 0.00 153211.48 20777.34 132819.63 00:22:34.488 [2024-11-29T08:45:57.331Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.488 Verification LBA range: start 0x0 length 0x400 00:22:34.488 Nvme3n1 : 0.87 406.37 25.40 0.00 0.00 151441.97 20194.80 119615.34 00:22:34.488 [2024-11-29T08:45:57.331Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.488 Verification LBA range: start 0x0 length 0x400 00:22:34.488 Nvme4n1 : 0.88 404.31 25.27 0.00 0.00 151077.13 19320.98 118061.89 00:22:34.488 [2024-11-29T08:45:57.331Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.488 Verification LBA range: start 0x0 length 0x400 00:22:34.488 Nvme5n1 : 0.88 403.23 25.20 0.00 0.00 149984.52 18252.99 119615.34 00:22:34.488 [2024-11-29T08:45:57.331Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.488 Verification LBA range: start 0x0 length 0x400 00:22:34.488 Nvme6n1 : 0.88 402.32 25.15 0.00 0.00 149459.96 16893.72 123498.95 00:22:34.488 [2024-11-29T08:45:57.331Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.488 Verification LBA range: start 0x0 length 0x400 00:22:34.488 Nvme7n1 : 0.84 373.40 23.34 0.00 0.00 158586.18 22233.69 124275.67 00:22:34.488 [2024-11-29T08:45:57.331Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.488 Verification LBA range: start 0x0 length 0x400 00:22:34.488 Nvme8n1 : 0.87 368.12 23.01 0.00 0.00 158691.01 29709.65 129712.73 00:22:34.488 [2024-11-29T08:45:57.331Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.488 Verification LBA range: start 0x0 length 0x400 00:22:34.488 Nvme9n1 : 0.86 367.73 22.98 0.00 0.00 157644.56 27379.48 128159.29 00:22:34.488 [2024-11-29T08:45:57.331Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.488 Verification LBA range: start 0x0 length 0x400 00:22:34.488 Nvme10n1 : 0.85 371.35 23.21 0.00 0.00 155003.39 23495.87 123498.95 00:22:34.488 [2024-11-29T08:45:57.331Z] =================================================================================================================== 00:22:34.488 [2024-11-29T08:45:57.331Z] Total : 3909.44 244.34 0.00 0.00 153713.77 16893.72 132819.63 00:22:34.746 09:45:57 -- target/shutdown.sh@112 -- # sleep 1 00:22:36.125 09:45:58 -- target/shutdown.sh@113 -- # kill -0 92105 00:22:36.125 09:45:58 -- target/shutdown.sh@115 -- # stoptarget 00:22:36.125 09:45:58 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:36.125 09:45:58 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:36.125 09:45:58 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:36.125 09:45:58 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:36.125 09:45:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:36.125 09:45:58 -- nvmf/common.sh@116 -- # sync 00:22:36.125 09:45:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:36.125 09:45:58 -- nvmf/common.sh@119 -- # set +e 00:22:36.125 09:45:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:36.125 09:45:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:36.125 rmmod nvme_tcp 00:22:36.125 rmmod nvme_fabrics 00:22:36.125 rmmod nvme_keyring 00:22:36.125 09:45:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:36.125 09:45:58 -- nvmf/common.sh@123 -- # set -e 00:22:36.125 09:45:58 -- nvmf/common.sh@124 -- # return 0 00:22:36.125 09:45:58 -- nvmf/common.sh@477 -- # '[' -n 92105 ']' 00:22:36.125 09:45:58 -- nvmf/common.sh@478 -- # killprocess 92105 00:22:36.125 09:45:58 -- common/autotest_common.sh@936 -- # '[' -z 92105 ']' 00:22:36.125 09:45:58 -- common/autotest_common.sh@940 -- # kill -0 92105 00:22:36.125 09:45:58 -- common/autotest_common.sh@941 -- # uname 00:22:36.125 09:45:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:36.125 09:45:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 92105 00:22:36.125 09:45:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:36.125 09:45:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:36.125 09:45:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 92105' 00:22:36.125 killing process with pid 92105 00:22:36.125 09:45:58 -- common/autotest_common.sh@955 -- # kill 92105 00:22:36.125 09:45:58 -- common/autotest_common.sh@960 -- # wait 92105 00:22:36.391 09:45:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:36.391 09:45:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:36.391 09:45:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:36.391 09:45:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:36.391 09:45:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:36.391 09:45:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:36.391 09:45:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:36.391 09:45:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:38.386 09:46:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:38.386 00:22:38.386 real 0m8.486s 00:22:38.386 user 0m27.127s 00:22:38.386 sys 0m1.572s 00:22:38.386 09:46:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:38.386 09:46:01 -- common/autotest_common.sh@10 -- # set +x 00:22:38.386 ************************************ 00:22:38.386 END TEST nvmf_shutdown_tc2 00:22:38.386 ************************************ 00:22:38.386 09:46:01 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:38.386 09:46:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:38.386 09:46:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:38.386 09:46:01 -- common/autotest_common.sh@10 -- # set +x 00:22:38.386 ************************************ 00:22:38.386 START TEST nvmf_shutdown_tc3 00:22:38.386 ************************************ 00:22:38.386 09:46:01 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:38.386 09:46:01 -- target/shutdown.sh@120 -- # starttarget 00:22:38.386 09:46:01 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:38.386 09:46:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:38.386 09:46:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:38.386 09:46:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:38.386 09:46:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:38.386 09:46:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:38.386 09:46:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:38.386 09:46:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:38.386 09:46:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:38.644 09:46:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:38.644 09:46:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:38.644 09:46:01 -- common/autotest_common.sh@10 -- # set +x 00:22:38.644 09:46:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:38.644 09:46:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:38.644 09:46:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:38.644 09:46:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:38.644 09:46:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:38.644 09:46:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:38.644 09:46:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:38.644 09:46:01 -- nvmf/common.sh@294 -- # net_devs=() 00:22:38.644 09:46:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:38.644 09:46:01 -- nvmf/common.sh@295 -- # e810=() 00:22:38.644 09:46:01 -- nvmf/common.sh@295 -- # local -ga e810 00:22:38.644 09:46:01 -- nvmf/common.sh@296 -- # x722=() 00:22:38.644 09:46:01 -- nvmf/common.sh@296 -- # local -ga x722 00:22:38.644 09:46:01 -- nvmf/common.sh@297 -- # mlx=() 00:22:38.644 09:46:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:38.644 09:46:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:38.644 09:46:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:38.644 09:46:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:38.644 09:46:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:38.644 09:46:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:38.644 09:46:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:38.644 09:46:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:38.644 09:46:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:38.644 09:46:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:38.644 09:46:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:38.644 09:46:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:38.644 09:46:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:38.644 09:46:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:38.644 09:46:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:38.644 09:46:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:38.644 09:46:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:38.644 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:38.644 09:46:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:38.644 09:46:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:38.644 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:38.644 09:46:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:38.644 09:46:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:38.644 09:46:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:38.644 09:46:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:38.644 09:46:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:38.644 09:46:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:38.644 09:46:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:38.644 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:38.644 09:46:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:38.644 09:46:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:38.644 09:46:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:38.645 09:46:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:38.645 09:46:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:38.645 09:46:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:38.645 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:38.645 09:46:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:38.645 09:46:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:38.645 09:46:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:38.645 09:46:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:38.645 09:46:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:38.645 09:46:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:38.645 09:46:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:38.645 09:46:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:38.645 09:46:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:38.645 09:46:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:38.645 09:46:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:38.645 09:46:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:38.645 09:46:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:38.645 09:46:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:38.645 09:46:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:38.645 09:46:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:38.645 09:46:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:38.645 09:46:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:38.645 09:46:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:38.645 09:46:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:38.645 09:46:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:38.645 09:46:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:38.645 09:46:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:38.645 09:46:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:38.645 09:46:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:38.645 09:46:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:38.645 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:38.645 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.213 ms 00:22:38.645 00:22:38.645 --- 10.0.0.2 ping statistics --- 00:22:38.645 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:38.645 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:22:38.645 09:46:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:38.645 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:38.645 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.087 ms 00:22:38.645 00:22:38.645 --- 10.0.0.1 ping statistics --- 00:22:38.645 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:38.645 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:22:38.645 09:46:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:38.645 09:46:01 -- nvmf/common.sh@410 -- # return 0 00:22:38.645 09:46:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:38.645 09:46:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:38.645 09:46:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:38.645 09:46:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:38.645 09:46:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:38.645 09:46:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:38.645 09:46:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:38.645 09:46:01 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:38.645 09:46:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:38.645 09:46:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:38.645 09:46:01 -- common/autotest_common.sh@10 -- # set +x 00:22:38.645 09:46:01 -- nvmf/common.sh@469 -- # nvmfpid=93353 00:22:38.645 09:46:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:38.645 09:46:01 -- nvmf/common.sh@470 -- # waitforlisten 93353 00:22:38.645 09:46:01 -- common/autotest_common.sh@829 -- # '[' -z 93353 ']' 00:22:38.645 09:46:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:38.645 09:46:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:38.645 09:46:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:38.645 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:38.645 09:46:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:38.645 09:46:01 -- common/autotest_common.sh@10 -- # set +x 00:22:38.645 [2024-11-29 09:46:01.441722] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:38.645 [2024-11-29 09:46:01.441814] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:38.645 EAL: No free 2048 kB hugepages reported on node 1 00:22:38.904 [2024-11-29 09:46:01.511231] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:38.904 [2024-11-29 09:46:01.625839] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:38.904 [2024-11-29 09:46:01.626012] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:38.904 [2024-11-29 09:46:01.626032] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:38.904 [2024-11-29 09:46:01.626047] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:38.904 [2024-11-29 09:46:01.626144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:38.904 [2024-11-29 09:46:01.626240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:38.904 [2024-11-29 09:46:01.626310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:38.904 [2024-11-29 09:46:01.626312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:39.840 09:46:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:39.840 09:46:02 -- common/autotest_common.sh@862 -- # return 0 00:22:39.840 09:46:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:39.840 09:46:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:39.840 09:46:02 -- common/autotest_common.sh@10 -- # set +x 00:22:39.840 09:46:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:39.840 09:46:02 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:39.840 09:46:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.840 09:46:02 -- common/autotest_common.sh@10 -- # set +x 00:22:39.840 [2024-11-29 09:46:02.421943] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:39.840 09:46:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.840 09:46:02 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:39.840 09:46:02 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:39.840 09:46:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:39.840 09:46:02 -- common/autotest_common.sh@10 -- # set +x 00:22:39.840 09:46:02 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:39.840 09:46:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.840 09:46:02 -- target/shutdown.sh@28 -- # cat 00:22:39.840 09:46:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.840 09:46:02 -- target/shutdown.sh@28 -- # cat 00:22:39.840 09:46:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.840 09:46:02 -- target/shutdown.sh@28 -- # cat 00:22:39.840 09:46:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.840 09:46:02 -- target/shutdown.sh@28 -- # cat 00:22:39.840 09:46:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.840 09:46:02 -- target/shutdown.sh@28 -- # cat 00:22:39.840 09:46:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.840 09:46:02 -- target/shutdown.sh@28 -- # cat 00:22:39.840 09:46:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.840 09:46:02 -- target/shutdown.sh@28 -- # cat 00:22:39.840 09:46:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.840 09:46:02 -- target/shutdown.sh@28 -- # cat 00:22:39.840 09:46:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.840 09:46:02 -- target/shutdown.sh@28 -- # cat 00:22:39.840 09:46:02 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.840 09:46:02 -- target/shutdown.sh@28 -- # cat 00:22:39.840 09:46:02 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:39.840 09:46:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.840 09:46:02 -- common/autotest_common.sh@10 -- # set +x 00:22:39.840 Malloc1 00:22:39.840 [2024-11-29 09:46:02.497069] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:39.840 Malloc2 00:22:39.840 Malloc3 00:22:39.840 Malloc4 00:22:39.840 Malloc5 00:22:40.099 Malloc6 00:22:40.099 Malloc7 00:22:40.099 Malloc8 00:22:40.099 Malloc9 00:22:40.099 Malloc10 00:22:40.099 09:46:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.099 09:46:02 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:40.099 09:46:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:40.099 09:46:02 -- common/autotest_common.sh@10 -- # set +x 00:22:40.357 09:46:02 -- target/shutdown.sh@124 -- # perfpid=93544 00:22:40.357 09:46:02 -- target/shutdown.sh@125 -- # waitforlisten 93544 /var/tmp/bdevperf.sock 00:22:40.358 09:46:02 -- common/autotest_common.sh@829 -- # '[' -z 93544 ']' 00:22:40.358 09:46:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:40.358 09:46:02 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:40.358 09:46:02 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:40.358 09:46:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:40.358 09:46:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:40.358 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:40.358 09:46:02 -- nvmf/common.sh@520 -- # config=() 00:22:40.358 09:46:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:40.358 09:46:02 -- nvmf/common.sh@520 -- # local subsystem config 00:22:40.358 09:46:02 -- common/autotest_common.sh@10 -- # set +x 00:22:40.358 09:46:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.358 { 00:22:40.358 "params": { 00:22:40.358 "name": "Nvme$subsystem", 00:22:40.358 "trtype": "$TEST_TRANSPORT", 00:22:40.358 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.358 "adrfam": "ipv4", 00:22:40.358 "trsvcid": "$NVMF_PORT", 00:22:40.358 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.358 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.358 "hdgst": ${hdgst:-false}, 00:22:40.358 "ddgst": ${ddgst:-false} 00:22:40.358 }, 00:22:40.358 "method": "bdev_nvme_attach_controller" 00:22:40.358 } 00:22:40.358 EOF 00:22:40.358 )") 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # cat 00:22:40.358 09:46:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.358 { 00:22:40.358 "params": { 00:22:40.358 "name": "Nvme$subsystem", 00:22:40.358 "trtype": "$TEST_TRANSPORT", 00:22:40.358 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.358 "adrfam": "ipv4", 00:22:40.358 "trsvcid": "$NVMF_PORT", 00:22:40.358 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.358 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.358 "hdgst": ${hdgst:-false}, 00:22:40.358 "ddgst": ${ddgst:-false} 00:22:40.358 }, 00:22:40.358 "method": "bdev_nvme_attach_controller" 00:22:40.358 } 00:22:40.358 EOF 00:22:40.358 )") 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # cat 00:22:40.358 09:46:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.358 { 00:22:40.358 "params": { 00:22:40.358 "name": "Nvme$subsystem", 00:22:40.358 "trtype": "$TEST_TRANSPORT", 00:22:40.358 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.358 "adrfam": "ipv4", 00:22:40.358 "trsvcid": "$NVMF_PORT", 00:22:40.358 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.358 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.358 "hdgst": ${hdgst:-false}, 00:22:40.358 "ddgst": ${ddgst:-false} 00:22:40.358 }, 00:22:40.358 "method": "bdev_nvme_attach_controller" 00:22:40.358 } 00:22:40.358 EOF 00:22:40.358 )") 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # cat 00:22:40.358 09:46:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.358 { 00:22:40.358 "params": { 00:22:40.358 "name": "Nvme$subsystem", 00:22:40.358 "trtype": "$TEST_TRANSPORT", 00:22:40.358 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.358 "adrfam": "ipv4", 00:22:40.358 "trsvcid": "$NVMF_PORT", 00:22:40.358 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.358 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.358 "hdgst": ${hdgst:-false}, 00:22:40.358 "ddgst": ${ddgst:-false} 00:22:40.358 }, 00:22:40.358 "method": "bdev_nvme_attach_controller" 00:22:40.358 } 00:22:40.358 EOF 00:22:40.358 )") 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # cat 00:22:40.358 09:46:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.358 { 00:22:40.358 "params": { 00:22:40.358 "name": "Nvme$subsystem", 00:22:40.358 "trtype": "$TEST_TRANSPORT", 00:22:40.358 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.358 "adrfam": "ipv4", 00:22:40.358 "trsvcid": "$NVMF_PORT", 00:22:40.358 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.358 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.358 "hdgst": ${hdgst:-false}, 00:22:40.358 "ddgst": ${ddgst:-false} 00:22:40.358 }, 00:22:40.358 "method": "bdev_nvme_attach_controller" 00:22:40.358 } 00:22:40.358 EOF 00:22:40.358 )") 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # cat 00:22:40.358 09:46:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.358 { 00:22:40.358 "params": { 00:22:40.358 "name": "Nvme$subsystem", 00:22:40.358 "trtype": "$TEST_TRANSPORT", 00:22:40.358 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.358 "adrfam": "ipv4", 00:22:40.358 "trsvcid": "$NVMF_PORT", 00:22:40.358 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.358 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.358 "hdgst": ${hdgst:-false}, 00:22:40.358 "ddgst": ${ddgst:-false} 00:22:40.358 }, 00:22:40.358 "method": "bdev_nvme_attach_controller" 00:22:40.358 } 00:22:40.358 EOF 00:22:40.358 )") 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # cat 00:22:40.358 09:46:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.358 { 00:22:40.358 "params": { 00:22:40.358 "name": "Nvme$subsystem", 00:22:40.358 "trtype": "$TEST_TRANSPORT", 00:22:40.358 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.358 "adrfam": "ipv4", 00:22:40.358 "trsvcid": "$NVMF_PORT", 00:22:40.358 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.358 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.358 "hdgst": ${hdgst:-false}, 00:22:40.358 "ddgst": ${ddgst:-false} 00:22:40.358 }, 00:22:40.358 "method": "bdev_nvme_attach_controller" 00:22:40.358 } 00:22:40.358 EOF 00:22:40.358 )") 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # cat 00:22:40.358 09:46:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.358 09:46:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.358 { 00:22:40.358 "params": { 00:22:40.358 "name": "Nvme$subsystem", 00:22:40.358 "trtype": "$TEST_TRANSPORT", 00:22:40.359 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.359 "adrfam": "ipv4", 00:22:40.359 "trsvcid": "$NVMF_PORT", 00:22:40.359 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.359 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.359 "hdgst": ${hdgst:-false}, 00:22:40.359 "ddgst": ${ddgst:-false} 00:22:40.359 }, 00:22:40.359 "method": "bdev_nvme_attach_controller" 00:22:40.359 } 00:22:40.359 EOF 00:22:40.359 )") 00:22:40.359 09:46:02 -- nvmf/common.sh@542 -- # cat 00:22:40.359 09:46:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.359 09:46:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.359 { 00:22:40.359 "params": { 00:22:40.359 "name": "Nvme$subsystem", 00:22:40.359 "trtype": "$TEST_TRANSPORT", 00:22:40.359 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.359 "adrfam": "ipv4", 00:22:40.359 "trsvcid": "$NVMF_PORT", 00:22:40.359 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.359 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.359 "hdgst": ${hdgst:-false}, 00:22:40.359 "ddgst": ${ddgst:-false} 00:22:40.359 }, 00:22:40.359 "method": "bdev_nvme_attach_controller" 00:22:40.359 } 00:22:40.359 EOF 00:22:40.359 )") 00:22:40.359 09:46:02 -- nvmf/common.sh@542 -- # cat 00:22:40.359 09:46:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.359 09:46:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.359 { 00:22:40.359 "params": { 00:22:40.359 "name": "Nvme$subsystem", 00:22:40.359 "trtype": "$TEST_TRANSPORT", 00:22:40.359 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.359 "adrfam": "ipv4", 00:22:40.359 "trsvcid": "$NVMF_PORT", 00:22:40.359 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.359 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.359 "hdgst": ${hdgst:-false}, 00:22:40.359 "ddgst": ${ddgst:-false} 00:22:40.359 }, 00:22:40.359 "method": "bdev_nvme_attach_controller" 00:22:40.359 } 00:22:40.359 EOF 00:22:40.359 )") 00:22:40.359 09:46:02 -- nvmf/common.sh@542 -- # cat 00:22:40.359 09:46:02 -- nvmf/common.sh@544 -- # jq . 00:22:40.359 09:46:02 -- nvmf/common.sh@545 -- # IFS=, 00:22:40.359 09:46:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:40.359 "params": { 00:22:40.359 "name": "Nvme1", 00:22:40.359 "trtype": "tcp", 00:22:40.359 "traddr": "10.0.0.2", 00:22:40.359 "adrfam": "ipv4", 00:22:40.359 "trsvcid": "4420", 00:22:40.359 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:40.359 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:40.359 "hdgst": false, 00:22:40.359 "ddgst": false 00:22:40.359 }, 00:22:40.359 "method": "bdev_nvme_attach_controller" 00:22:40.359 },{ 00:22:40.359 "params": { 00:22:40.359 "name": "Nvme2", 00:22:40.359 "trtype": "tcp", 00:22:40.359 "traddr": "10.0.0.2", 00:22:40.359 "adrfam": "ipv4", 00:22:40.359 "trsvcid": "4420", 00:22:40.359 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:40.359 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:40.359 "hdgst": false, 00:22:40.359 "ddgst": false 00:22:40.359 }, 00:22:40.359 "method": "bdev_nvme_attach_controller" 00:22:40.359 },{ 00:22:40.359 "params": { 00:22:40.359 "name": "Nvme3", 00:22:40.359 "trtype": "tcp", 00:22:40.359 "traddr": "10.0.0.2", 00:22:40.359 "adrfam": "ipv4", 00:22:40.359 "trsvcid": "4420", 00:22:40.359 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:40.359 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:40.359 "hdgst": false, 00:22:40.359 "ddgst": false 00:22:40.359 }, 00:22:40.359 "method": "bdev_nvme_attach_controller" 00:22:40.359 },{ 00:22:40.359 "params": { 00:22:40.359 "name": "Nvme4", 00:22:40.359 "trtype": "tcp", 00:22:40.359 "traddr": "10.0.0.2", 00:22:40.359 "adrfam": "ipv4", 00:22:40.359 "trsvcid": "4420", 00:22:40.359 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:40.359 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:40.359 "hdgst": false, 00:22:40.359 "ddgst": false 00:22:40.359 }, 00:22:40.359 "method": "bdev_nvme_attach_controller" 00:22:40.359 },{ 00:22:40.359 "params": { 00:22:40.359 "name": "Nvme5", 00:22:40.359 "trtype": "tcp", 00:22:40.359 "traddr": "10.0.0.2", 00:22:40.359 "adrfam": "ipv4", 00:22:40.359 "trsvcid": "4420", 00:22:40.359 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:40.359 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:40.359 "hdgst": false, 00:22:40.359 "ddgst": false 00:22:40.359 }, 00:22:40.359 "method": "bdev_nvme_attach_controller" 00:22:40.359 },{ 00:22:40.359 "params": { 00:22:40.359 "name": "Nvme6", 00:22:40.359 "trtype": "tcp", 00:22:40.359 "traddr": "10.0.0.2", 00:22:40.359 "adrfam": "ipv4", 00:22:40.359 "trsvcid": "4420", 00:22:40.359 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:40.359 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:40.359 "hdgst": false, 00:22:40.359 "ddgst": false 00:22:40.359 }, 00:22:40.359 "method": "bdev_nvme_attach_controller" 00:22:40.359 },{ 00:22:40.359 "params": { 00:22:40.359 "name": "Nvme7", 00:22:40.359 "trtype": "tcp", 00:22:40.359 "traddr": "10.0.0.2", 00:22:40.359 "adrfam": "ipv4", 00:22:40.359 "trsvcid": "4420", 00:22:40.359 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:40.359 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:40.359 "hdgst": false, 00:22:40.359 "ddgst": false 00:22:40.359 }, 00:22:40.359 "method": "bdev_nvme_attach_controller" 00:22:40.359 },{ 00:22:40.359 "params": { 00:22:40.359 "name": "Nvme8", 00:22:40.359 "trtype": "tcp", 00:22:40.359 "traddr": "10.0.0.2", 00:22:40.359 "adrfam": "ipv4", 00:22:40.359 "trsvcid": "4420", 00:22:40.359 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:40.359 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:40.359 "hdgst": false, 00:22:40.359 "ddgst": false 00:22:40.359 }, 00:22:40.359 "method": "bdev_nvme_attach_controller" 00:22:40.359 },{ 00:22:40.359 "params": { 00:22:40.359 "name": "Nvme9", 00:22:40.359 "trtype": "tcp", 00:22:40.359 "traddr": "10.0.0.2", 00:22:40.359 "adrfam": "ipv4", 00:22:40.359 "trsvcid": "4420", 00:22:40.359 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:40.360 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:40.360 "hdgst": false, 00:22:40.360 "ddgst": false 00:22:40.360 }, 00:22:40.360 "method": "bdev_nvme_attach_controller" 00:22:40.360 },{ 00:22:40.360 "params": { 00:22:40.360 "name": "Nvme10", 00:22:40.360 "trtype": "tcp", 00:22:40.360 "traddr": "10.0.0.2", 00:22:40.360 "adrfam": "ipv4", 00:22:40.360 "trsvcid": "4420", 00:22:40.360 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:40.360 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:40.360 "hdgst": false, 00:22:40.360 "ddgst": false 00:22:40.360 }, 00:22:40.360 "method": "bdev_nvme_attach_controller" 00:22:40.360 }' 00:22:40.360 [2024-11-29 09:46:03.001695] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:40.360 [2024-11-29 09:46:03.001794] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid93544 ] 00:22:40.360 EAL: No free 2048 kB hugepages reported on node 1 00:22:40.360 [2024-11-29 09:46:03.064682] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:40.360 [2024-11-29 09:46:03.173595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:42.261 Running I/O for 10 seconds... 00:22:42.261 09:46:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:42.261 09:46:04 -- common/autotest_common.sh@862 -- # return 0 00:22:42.261 09:46:04 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:42.261 09:46:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.261 09:46:04 -- common/autotest_common.sh@10 -- # set +x 00:22:42.261 09:46:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.261 09:46:04 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:42.261 09:46:04 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:42.261 09:46:04 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:42.261 09:46:04 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:42.261 09:46:04 -- target/shutdown.sh@57 -- # local ret=1 00:22:42.261 09:46:04 -- target/shutdown.sh@58 -- # local i 00:22:42.261 09:46:04 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:42.261 09:46:04 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:42.261 09:46:04 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:42.261 09:46:04 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:42.261 09:46:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.261 09:46:04 -- common/autotest_common.sh@10 -- # set +x 00:22:42.261 09:46:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.261 09:46:04 -- target/shutdown.sh@60 -- # read_io_count=42 00:22:42.261 09:46:04 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:22:42.261 09:46:04 -- target/shutdown.sh@67 -- # sleep 0.25 00:22:42.531 09:46:05 -- target/shutdown.sh@59 -- # (( i-- )) 00:22:42.531 09:46:05 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:42.531 09:46:05 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:42.531 09:46:05 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:42.531 09:46:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.531 09:46:05 -- common/autotest_common.sh@10 -- # set +x 00:22:42.531 09:46:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.531 09:46:05 -- target/shutdown.sh@60 -- # read_io_count=167 00:22:42.531 09:46:05 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:22:42.531 09:46:05 -- target/shutdown.sh@64 -- # ret=0 00:22:42.531 09:46:05 -- target/shutdown.sh@65 -- # break 00:22:42.531 09:46:05 -- target/shutdown.sh@69 -- # return 0 00:22:42.531 09:46:05 -- target/shutdown.sh@134 -- # killprocess 93353 00:22:42.531 09:46:05 -- common/autotest_common.sh@936 -- # '[' -z 93353 ']' 00:22:42.531 09:46:05 -- common/autotest_common.sh@940 -- # kill -0 93353 00:22:42.531 09:46:05 -- common/autotest_common.sh@941 -- # uname 00:22:42.531 09:46:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:42.531 09:46:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 93353 00:22:42.531 09:46:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:42.531 09:46:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:42.531 09:46:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 93353' 00:22:42.531 killing process with pid 93353 00:22:42.531 09:46:05 -- common/autotest_common.sh@955 -- # kill 93353 00:22:42.531 09:46:05 -- common/autotest_common.sh@960 -- # wait 93353 00:22:42.531 [2024-11-29 09:46:05.195788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c62e0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.195919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c62e0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.196992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.197003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.197015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.197027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.531 [2024-11-29 09:46:05.197042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.197345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8cb0 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.198374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6790 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.203947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.203982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.203997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.532 [2024-11-29 09:46:05.204637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.204649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.204661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.204673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.204690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.204703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.204730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.204742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.204753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.204765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.204776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.204788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.204799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c6c40 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206685] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206937] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.206993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.207184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7a30 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.208415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.208441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.208454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.208467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.208479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.208492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.208504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.208517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.533 [2024-11-29 09:46:05.208530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208835] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.208990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.209220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c7ee0 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.534 [2024-11-29 09:46:05.210621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.210998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8370 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.211991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.535 [2024-11-29 09:46:05.212266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212278] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.212566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c8820 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.213972] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214033] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214060] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214087] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214113] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c9a60 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.214181] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214224] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214250] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214277] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf66490 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.214352] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214388] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214423] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214450] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf71590 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.214525] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214569] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214598] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214625] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10cec70 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.214703] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214738] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214765] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214791] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10ba0a0 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.214863] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214897] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214923] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214949] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.214961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.214974] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf44690 is same with the state(5) to be set 00:22:42.536 [2024-11-29 09:46:05.215017] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.215038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.215052] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.536 [2024-11-29 09:46:05.215065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.536 [2024-11-29 09:46:05.215078] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.537 [2024-11-29 09:46:05.215092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.215110] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.537 [2024-11-29 09:46:05.215125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.215138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf18f70 is same with the state(5) to be set 00:22:42.537 [2024-11-29 09:46:05.215182] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.537 [2024-11-29 09:46:05.215203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.215218] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.537 [2024-11-29 09:46:05.215232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.215245] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.537 [2024-11-29 09:46:05.215259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.215272] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.537 [2024-11-29 09:46:05.215285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.215298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf3b1b0 is same with the state(5) to be set 00:22:42.537 [2024-11-29 09:46:05.215342] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.537 [2024-11-29 09:46:05.215362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.215377] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.537 [2024-11-29 09:46:05.215390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.215411] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.537 [2024-11-29 09:46:05.215425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.215438] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.537 [2024-11-29 09:46:05.215451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.215463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10df600 is same with the state(5) to be set 00:22:42.537 [2024-11-29 09:46:05.215511] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.537 [2024-11-29 09:46:05.215542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.215561] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.537 [2024-11-29 09:46:05.215574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.215588] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.537 [2024-11-29 09:46:05.215606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.215621] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.537 [2024-11-29 09:46:05.215634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.215647] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10cf150 is same with the state(5) to be set 00:22:42.537 [2024-11-29 09:46:05.224487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.224581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.224616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.224633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.224651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.224666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.224683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.224697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.224714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.224728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.224744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.224758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.224774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.224788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.224804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.224818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.224835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.224849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.224866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.224880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.224899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.224928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.224946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.224959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.224975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.224990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.225006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.225020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.225035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.225049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.225065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.225079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.225096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.225110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.225126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.225140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.225156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.225170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.225187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.225201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.225217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.225231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.225247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.225261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.225277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.225291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.537 [2024-11-29 09:46:05.225311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.537 [2024-11-29 09:46:05.225325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.225983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.225999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.538 [2024-11-29 09:46:05.226558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.538 [2024-11-29 09:46:05.226574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.226588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.226602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a66f0 is same with the state(5) to be set 00:22:42.539 [2024-11-29 09:46:05.226707] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x10a66f0 was disconnected and freed. reset controller. 00:22:42.539 [2024-11-29 09:46:05.226789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.226812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.226842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.226858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.226875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.226889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.226905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.226919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.226935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.226948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.226964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.226978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.226994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.539 [2024-11-29 09:46:05.227966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.539 [2024-11-29 09:46:05.227980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.227996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.228804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.228819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1168950 is same with the state(5) to be set 00:22:42.540 [2024-11-29 09:46:05.228900] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1168950 was disconnected and freed. reset controller. 00:22:42.540 [2024-11-29 09:46:05.229401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10c9a60 (9): Bad file descriptor 00:22:42.540 [2024-11-29 09:46:05.229454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf66490 (9): Bad file descriptor 00:22:42.540 [2024-11-29 09:46:05.229481] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf71590 (9): Bad file descriptor 00:22:42.540 [2024-11-29 09:46:05.229505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10cec70 (9): Bad file descriptor 00:22:42.540 [2024-11-29 09:46:05.229528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10ba0a0 (9): Bad file descriptor 00:22:42.540 [2024-11-29 09:46:05.229557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf44690 (9): Bad file descriptor 00:22:42.540 [2024-11-29 09:46:05.229588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf18f70 (9): Bad file descriptor 00:22:42.540 [2024-11-29 09:46:05.229624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf3b1b0 (9): Bad file descriptor 00:22:42.540 [2024-11-29 09:46:05.229655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10df600 (9): Bad file descriptor 00:22:42.540 [2024-11-29 09:46:05.229684] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10cf150 (9): Bad file descriptor 00:22:42.540 [2024-11-29 09:46:05.229737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.229759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.229781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.229803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.540 [2024-11-29 09:46:05.229820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.540 [2024-11-29 09:46:05.229835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.229858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.229872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.229888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.229901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.229917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.229930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.229945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.229959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.229974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.229987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.230978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.230993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.231008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.231024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.541 [2024-11-29 09:46:05.231038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.541 [2024-11-29 09:46:05.231054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.231555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.231569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.243358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.243424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.243443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.243457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.243474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.243489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.243505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.243519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.243535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.243549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.243699] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x115d260 was disconnected and freed. reset controller. 00:22:42.542 [2024-11-29 09:46:05.243813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.243835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.243862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.243878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.243894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.243911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.243927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.243941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.243957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.243971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.243987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.244001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.244017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.244032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.244047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.244063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.244080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.244095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.244111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.244125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.244141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.244155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.244171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.244185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.244206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.244221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.244237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.244251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.244267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.244280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.244296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.244311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.244327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.542 [2024-11-29 09:46:05.244341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.542 [2024-11-29 09:46:05.244356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.244983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.244997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.543 [2024-11-29 09:46:05.245565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.543 [2024-11-29 09:46:05.245578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.245594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.245609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.245624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.245638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.245654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.245667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.245683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.245697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.245713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.245726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.245746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.245761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.245776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.245790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.245805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf09550 is same with the state(5) to be set 00:22:42.544 [2024-11-29 09:46:05.245879] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xf09550 was disconnected and freed. reset controller. 00:22:42.544 [2024-11-29 09:46:05.248926] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.544 [2024-11-29 09:46:05.248970] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.544 [2024-11-29 09:46:05.248997] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.544 [2024-11-29 09:46:05.249018] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.544 [2024-11-29 09:46:05.251285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.251972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.251990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.252004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.252019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.252034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.252050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.252064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.252080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.544 [2024-11-29 09:46:05.252093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.544 [2024-11-29 09:46:05.252109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.252977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.252991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.253008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.253022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.253038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.253051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.253067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.253081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.253100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.253115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.253131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.253144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.253160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.253175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.253191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.253205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.253220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.253234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.253249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.545 [2024-11-29 09:46:05.253263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.545 [2024-11-29 09:46:05.253399] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x10a51a0 was disconnected and freed. reset controller. 00:22:42.546 [2024-11-29 09:46:05.253422] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.546 [2024-11-29 09:46:05.255378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:42.546 [2024-11-29 09:46:05.255427] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:42.546 [2024-11-29 09:46:05.257272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.257960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.257981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.258003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.258020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.258041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.258057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.258078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.258094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.258115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.258132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.258153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.258169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.259002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1169e00 is same with the state(5) to be set 00:22:42.546 [2024-11-29 09:46:05.259091] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1169e00 was disconnected and freed. reset controller. 00:22:42.546 [2024-11-29 09:46:05.259108] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.546 [2024-11-29 09:46:05.259165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.259186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.259207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.259223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.259240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.259254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.259270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.259284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.259299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.259313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.259328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.259347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.259363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.259377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.259399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.259415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.259431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.259445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.259461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.259474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.259490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.259504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.259519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.259533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.259548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.546 [2024-11-29 09:46:05.259563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.546 [2024-11-29 09:46:05.259579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.259593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.259608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.259622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.259637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.259651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.259666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.259680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.259695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.259708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.259728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.259743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.259758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.259772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.259787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.259801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.259816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.259831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.260891] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:42.547 [2024-11-29 09:46:05.260967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.260990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.547 [2024-11-29 09:46:05.261867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.547 [2024-11-29 09:46:05.261881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.261896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.261910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.261925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.261939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.261954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.261968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.261984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.262899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.548 [2024-11-29 09:46:05.262913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.548 [2024-11-29 09:46:05.264152] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:42.548 [2024-11-29 09:46:05.264218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:42.548 [2024-11-29 09:46:05.264248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:42.548 [2024-11-29 09:46:05.264417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.548 [2024-11-29 09:46:05.264532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.548 [2024-11-29 09:46:05.264558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf44690 with addr=10.0.0.2, port=4420 00:22:42.548 [2024-11-29 09:46:05.264577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf44690 is same with the state(5) to be set 00:22:42.548 [2024-11-29 09:46:05.264679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.548 [2024-11-29 09:46:05.264779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.548 [2024-11-29 09:46:05.264803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10cf150 with addr=10.0.0.2, port=4420 00:22:42.548 [2024-11-29 09:46:05.264819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10cf150 is same with the state(5) to be set 00:22:42.548 [2024-11-29 09:46:05.264844] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.548 [2024-11-29 09:46:05.264869] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.548 [2024-11-29 09:46:05.264891] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.549 [2024-11-29 09:46:05.264911] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.549 [2024-11-29 09:46:05.264935] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.549 [2024-11-29 09:46:05.264957] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.549 [2024-11-29 09:46:05.265658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.265684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.265707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.265723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.265739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.265754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.265770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.265785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.265801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.265815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.265830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.265844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.265860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.265874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.265889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.265903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.265919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.265933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.265948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.265962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.265979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.265992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.549 [2024-11-29 09:46:05.266689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.549 [2024-11-29 09:46:05.266703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.266718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.266732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.266748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.266761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.266777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.266791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.266806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.266824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.266840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.266855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.266870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.266884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.266901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.266915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.266931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.266945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.266960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.266974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.266989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.267613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.267628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x116c9c0 is same with the state(5) to be set 00:22:42.550 [2024-11-29 09:46:05.269286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.269313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.269333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.269349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.269364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.269378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.269401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.269417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.269433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.269446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.269462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.269476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.269491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.269504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.269521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.269535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.550 [2024-11-29 09:46:05.269550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.550 [2024-11-29 09:46:05.269565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.269595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.269623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.269659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.269688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.269717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.269745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.269774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.269805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.269835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.269864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.269893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.269923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.269952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.269982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.269997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.551 [2024-11-29 09:46:05.270726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.551 [2024-11-29 09:46:05.270740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.270755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.270772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.270788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.270802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.270817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.270831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.270846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.270860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.270875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.270889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.270904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.270917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.270934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.270948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.270963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.270977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.270992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.271006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.271021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.271035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.271051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.271065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.271080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.271094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.271109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.271123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.271142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.271156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.271171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.271184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.271200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.552 [2024-11-29 09:46:05.271213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.552 [2024-11-29 09:46:05.271227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x116f580 is same with the state(5) to be set 00:22:42.552 [2024-11-29 09:46:05.272819] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:42.552 [2024-11-29 09:46:05.272852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:42.552 [2024-11-29 09:46:05.272871] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:42.552 [2024-11-29 09:46:05.272894] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:42.552 [2024-11-29 09:46:05.273112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.552 [2024-11-29 09:46:05.273218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.552 [2024-11-29 09:46:05.273244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf18f70 with addr=10.0.0.2, port=4420 00:22:42.552 [2024-11-29 09:46:05.273262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf18f70 is same with the state(5) to be set 00:22:42.552 [2024-11-29 09:46:05.273387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.552 [2024-11-29 09:46:05.273494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.552 [2024-11-29 09:46:05.273519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10df600 with addr=10.0.0.2, port=4420 00:22:42.552 [2024-11-29 09:46:05.273537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10df600 is same with the state(5) to be set 00:22:42.552 [2024-11-29 09:46:05.273563] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf44690 (9): Bad file descriptor 00:22:42.552 [2024-11-29 09:46:05.273585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10cf150 (9): Bad file descriptor 00:22:42.552 [2024-11-29 09:46:05.273611] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.552 [2024-11-29 09:46:05.273632] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.552 [2024-11-29 09:46:05.274827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:42.552 task offset: 29184 on job bdev=Nvme4n1 fails 00:22:42.552 00:22:42.552 Latency(us) 00:22:42.552 [2024-11-29T08:46:05.395Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme1n1 ended in about 0.61 seconds with error 00:22:42.552 Verification LBA range: start 0x0 length 0x400 00:22:42.552 Nvme1n1 : 0.61 341.63 21.35 105.12 0.00 142101.39 32622.36 130489.46 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme2n1 ended in about 0.61 seconds with error 00:22:42.552 Verification LBA range: start 0x0 length 0x400 00:22:42.552 Nvme2n1 : 0.61 341.02 21.31 104.93 0.00 140574.72 26408.58 132819.63 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme3n1 ended in about 0.62 seconds with error 00:22:42.552 Verification LBA range: start 0x0 length 0x400 00:22:42.552 Nvme3n1 : 0.62 338.04 21.13 104.01 0.00 140037.87 57477.50 118061.89 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme4n1 ended in about 0.61 seconds with error 00:22:42.552 Verification LBA range: start 0x0 length 0x400 00:22:42.552 Nvme4n1 : 0.61 343.17 21.45 105.59 0.00 136125.70 40583.77 118061.89 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme5n1 ended in about 0.61 seconds with error 00:22:42.552 Verification LBA range: start 0x0 length 0x400 00:22:42.552 Nvme5n1 : 0.61 342.55 21.41 105.40 0.00 134620.80 33981.63 118838.61 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme6n1 ended in about 0.62 seconds with error 00:22:42.552 Verification LBA range: start 0x0 length 0x400 00:22:42.552 Nvme6n1 : 0.62 331.88 20.74 37.24 0.00 160763.56 3859.34 137479.96 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme7n1 ended in about 0.62 seconds with error 00:22:42.552 Verification LBA range: start 0x0 length 0x400 00:22:42.552 Nvme7n1 : 0.62 332.56 20.78 35.52 0.00 159032.54 5048.70 128936.01 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme8n1 ended in about 0.63 seconds with error 00:22:42.552 Verification LBA range: start 0x0 length 0x400 00:22:42.552 Nvme8n1 : 0.63 261.40 16.34 102.01 0.00 160052.62 99420.54 132042.90 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme9n1 ended in about 0.62 seconds with error 00:22:42.552 Verification LBA range: start 0x0 length 0x400 00:22:42.552 Nvme9n1 : 0.62 263.37 16.46 102.78 0.00 156693.64 101750.71 128159.29 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.552 [2024-11-29T08:46:05.395Z] Job: Nvme10n1 ended in about 0.63 seconds with error 00:22:42.552 Verification LBA range: start 0x0 length 0x400 00:22:42.552 Nvme10n1 : 0.63 259.90 16.24 101.43 0.00 157000.24 100197.26 125829.12 00:22:42.552 [2024-11-29T08:46:05.395Z] =================================================================================================================== 00:22:42.552 [2024-11-29T08:46:05.395Z] Total : 3155.52 197.22 904.01 0.00 147819.58 3859.34 137479.96 00:22:42.552 [2024-11-29 09:46:05.302267] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:42.552 [2024-11-29 09:46:05.302362] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:42.552 [2024-11-29 09:46:05.302673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.553 [2024-11-29 09:46:05.302795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.553 [2024-11-29 09:46:05.302824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10c9a60 with addr=10.0.0.2, port=4420 00:22:42.553 [2024-11-29 09:46:05.302848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c9a60 is same with the state(5) to be set 00:22:42.553 [2024-11-29 09:46:05.302942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.553 [2024-11-29 09:46:05.303057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.553 [2024-11-29 09:46:05.303082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf66490 with addr=10.0.0.2, port=4420 00:22:42.553 [2024-11-29 09:46:05.303099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf66490 is same with the state(5) to be set 00:22:42.553 [2024-11-29 09:46:05.303186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.553 [2024-11-29 09:46:05.303289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.553 [2024-11-29 09:46:05.303315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf3b1b0 with addr=10.0.0.2, port=4420 00:22:42.553 [2024-11-29 09:46:05.303331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf3b1b0 is same with the state(5) to be set 00:22:42.553 [2024-11-29 09:46:05.303434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.553 [2024-11-29 09:46:05.303539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.553 [2024-11-29 09:46:05.303564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10ba0a0 with addr=10.0.0.2, port=4420 00:22:42.553 [2024-11-29 09:46:05.303581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10ba0a0 is same with the state(5) to be set 00:22:42.553 [2024-11-29 09:46:05.303609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf18f70 (9): Bad file descriptor 00:22:42.553 [2024-11-29 09:46:05.303633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10df600 (9): Bad file descriptor 00:22:42.553 [2024-11-29 09:46:05.303651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:42.553 [2024-11-29 09:46:05.303666] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:42.553 [2024-11-29 09:46:05.303684] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:42.553 [2024-11-29 09:46:05.303711] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:42.553 [2024-11-29 09:46:05.303726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:42.553 [2024-11-29 09:46:05.303740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:42.553 [2024-11-29 09:46:05.303778] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.553 [2024-11-29 09:46:05.303805] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.553 [2024-11-29 09:46:05.304506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.553 [2024-11-29 09:46:05.304540] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.553 [2024-11-29 09:46:05.304686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.553 [2024-11-29 09:46:05.304778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.553 [2024-11-29 09:46:05.304804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10cec70 with addr=10.0.0.2, port=4420 00:22:42.553 [2024-11-29 09:46:05.304821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10cec70 is same with the state(5) to be set 00:22:42.553 [2024-11-29 09:46:05.304905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.553 [2024-11-29 09:46:05.304996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.553 [2024-11-29 09:46:05.305021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf71590 with addr=10.0.0.2, port=4420 00:22:42.553 [2024-11-29 09:46:05.305038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf71590 is same with the state(5) to be set 00:22:42.553 [2024-11-29 09:46:05.305058] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10c9a60 (9): Bad file descriptor 00:22:42.553 [2024-11-29 09:46:05.305077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf66490 (9): Bad file descriptor 00:22:42.553 [2024-11-29 09:46:05.305095] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf3b1b0 (9): Bad file descriptor 00:22:42.553 [2024-11-29 09:46:05.305112] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10ba0a0 (9): Bad file descriptor 00:22:42.553 [2024-11-29 09:46:05.305133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:42.553 [2024-11-29 09:46:05.305147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:42.553 [2024-11-29 09:46:05.305161] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:42.553 [2024-11-29 09:46:05.305180] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:42.553 [2024-11-29 09:46:05.305194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:42.553 [2024-11-29 09:46:05.305207] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:42.553 [2024-11-29 09:46:05.305262] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.553 [2024-11-29 09:46:05.305287] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.553 [2024-11-29 09:46:05.305307] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.553 [2024-11-29 09:46:05.305326] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.553 [2024-11-29 09:46:05.305344] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.553 [2024-11-29 09:46:05.305361] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.553 [2024-11-29 09:46:05.305460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.553 [2024-11-29 09:46:05.305482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.553 [2024-11-29 09:46:05.305507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10cec70 (9): Bad file descriptor 00:22:42.553 [2024-11-29 09:46:05.305529] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf71590 (9): Bad file descriptor 00:22:42.553 [2024-11-29 09:46:05.305546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:42.553 [2024-11-29 09:46:05.305559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:42.553 [2024-11-29 09:46:05.305572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:42.553 [2024-11-29 09:46:05.305588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:42.553 [2024-11-29 09:46:05.305602] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:42.553 [2024-11-29 09:46:05.305616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:42.553 [2024-11-29 09:46:05.305632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:42.553 [2024-11-29 09:46:05.305647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:42.553 [2024-11-29 09:46:05.305659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:42.553 [2024-11-29 09:46:05.305675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:42.553 [2024-11-29 09:46:05.305689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:42.553 [2024-11-29 09:46:05.305702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:42.553 [2024-11-29 09:46:05.305759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:42.553 [2024-11-29 09:46:05.305783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:42.553 [2024-11-29 09:46:05.305806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.553 [2024-11-29 09:46:05.305820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.553 [2024-11-29 09:46:05.305832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.553 [2024-11-29 09:46:05.305844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.553 [2024-11-29 09:46:05.305871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:42.553 [2024-11-29 09:46:05.305887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:42.553 [2024-11-29 09:46:05.305901] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:42.553 [2024-11-29 09:46:05.305917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:42.553 [2024-11-29 09:46:05.305932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:42.553 [2024-11-29 09:46:05.305946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:42.553 [2024-11-29 09:46:05.305986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.553 [2024-11-29 09:46:05.306005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.553 [2024-11-29 09:46:05.306085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.553 [2024-11-29 09:46:05.306174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.553 [2024-11-29 09:46:05.306200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x10cf150 with addr=10.0.0.2, port=4420 00:22:42.554 [2024-11-29 09:46:05.306216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10cf150 is same with the state(5) to be set 00:22:42.554 [2024-11-29 09:46:05.306293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.554 [2024-11-29 09:46:05.306375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.554 [2024-11-29 09:46:05.306405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf44690 with addr=10.0.0.2, port=4420 00:22:42.554 [2024-11-29 09:46:05.306423] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf44690 is same with the state(5) to be set 00:22:42.554 [2024-11-29 09:46:05.306467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10cf150 (9): Bad file descriptor 00:22:42.554 [2024-11-29 09:46:05.306492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf44690 (9): Bad file descriptor 00:22:42.554 [2024-11-29 09:46:05.306531] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:42.554 [2024-11-29 09:46:05.306550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:42.554 [2024-11-29 09:46:05.306565] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:42.554 [2024-11-29 09:46:05.306582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:42.554 [2024-11-29 09:46:05.306596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:42.554 [2024-11-29 09:46:05.306611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:42.554 [2024-11-29 09:46:05.306647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.554 [2024-11-29 09:46:05.306666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:43.117 09:46:05 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:43.117 09:46:05 -- target/shutdown.sh@138 -- # sleep 1 00:22:44.050 09:46:06 -- target/shutdown.sh@141 -- # kill -9 93544 00:22:44.051 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (93544) - No such process 00:22:44.051 09:46:06 -- target/shutdown.sh@141 -- # true 00:22:44.051 09:46:06 -- target/shutdown.sh@143 -- # stoptarget 00:22:44.051 09:46:06 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:44.051 09:46:06 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:44.051 09:46:06 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:44.051 09:46:06 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:44.051 09:46:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:44.051 09:46:06 -- nvmf/common.sh@116 -- # sync 00:22:44.051 09:46:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:44.051 09:46:06 -- nvmf/common.sh@119 -- # set +e 00:22:44.051 09:46:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:44.051 09:46:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:44.051 rmmod nvme_tcp 00:22:44.051 rmmod nvme_fabrics 00:22:44.051 rmmod nvme_keyring 00:22:44.051 09:46:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:44.051 09:46:06 -- nvmf/common.sh@123 -- # set -e 00:22:44.051 09:46:06 -- nvmf/common.sh@124 -- # return 0 00:22:44.051 09:46:06 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:44.051 09:46:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:44.051 09:46:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:44.051 09:46:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:44.051 09:46:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:44.051 09:46:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:44.051 09:46:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:44.051 09:46:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:44.051 09:46:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:46.579 09:46:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:46.579 00:22:46.579 real 0m7.641s 00:22:46.579 user 0m18.915s 00:22:46.579 sys 0m1.397s 00:22:46.579 09:46:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:46.579 09:46:08 -- common/autotest_common.sh@10 -- # set +x 00:22:46.579 ************************************ 00:22:46.579 END TEST nvmf_shutdown_tc3 00:22:46.579 ************************************ 00:22:46.579 09:46:08 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:46.579 00:22:46.579 real 0m28.986s 00:22:46.579 user 1m23.560s 00:22:46.579 sys 0m6.488s 00:22:46.579 09:46:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:46.579 09:46:08 -- common/autotest_common.sh@10 -- # set +x 00:22:46.579 ************************************ 00:22:46.579 END TEST nvmf_shutdown 00:22:46.579 ************************************ 00:22:46.579 09:46:08 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:46.579 09:46:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:46.579 09:46:08 -- common/autotest_common.sh@10 -- # set +x 00:22:46.579 09:46:08 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:46.579 09:46:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:46.579 09:46:08 -- common/autotest_common.sh@10 -- # set +x 00:22:46.579 09:46:08 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:46.579 09:46:08 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:46.579 09:46:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:46.579 09:46:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:46.579 09:46:08 -- common/autotest_common.sh@10 -- # set +x 00:22:46.579 ************************************ 00:22:46.579 START TEST nvmf_multicontroller 00:22:46.579 ************************************ 00:22:46.579 09:46:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:46.579 * Looking for test storage... 00:22:46.579 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:46.579 09:46:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:46.579 09:46:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:46.580 09:46:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:46.580 09:46:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:46.580 09:46:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:46.580 09:46:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:46.580 09:46:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:46.580 09:46:09 -- scripts/common.sh@335 -- # IFS=.-: 00:22:46.580 09:46:09 -- scripts/common.sh@335 -- # read -ra ver1 00:22:46.580 09:46:09 -- scripts/common.sh@336 -- # IFS=.-: 00:22:46.580 09:46:09 -- scripts/common.sh@336 -- # read -ra ver2 00:22:46.580 09:46:09 -- scripts/common.sh@337 -- # local 'op=<' 00:22:46.580 09:46:09 -- scripts/common.sh@339 -- # ver1_l=2 00:22:46.580 09:46:09 -- scripts/common.sh@340 -- # ver2_l=1 00:22:46.580 09:46:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:46.580 09:46:09 -- scripts/common.sh@343 -- # case "$op" in 00:22:46.580 09:46:09 -- scripts/common.sh@344 -- # : 1 00:22:46.580 09:46:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:46.580 09:46:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:46.580 09:46:09 -- scripts/common.sh@364 -- # decimal 1 00:22:46.580 09:46:09 -- scripts/common.sh@352 -- # local d=1 00:22:46.580 09:46:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:46.580 09:46:09 -- scripts/common.sh@354 -- # echo 1 00:22:46.580 09:46:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:46.580 09:46:09 -- scripts/common.sh@365 -- # decimal 2 00:22:46.580 09:46:09 -- scripts/common.sh@352 -- # local d=2 00:22:46.580 09:46:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:46.580 09:46:09 -- scripts/common.sh@354 -- # echo 2 00:22:46.580 09:46:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:46.580 09:46:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:46.580 09:46:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:46.580 09:46:09 -- scripts/common.sh@367 -- # return 0 00:22:46.580 09:46:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:46.580 09:46:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:46.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:46.580 --rc genhtml_branch_coverage=1 00:22:46.580 --rc genhtml_function_coverage=1 00:22:46.580 --rc genhtml_legend=1 00:22:46.580 --rc geninfo_all_blocks=1 00:22:46.580 --rc geninfo_unexecuted_blocks=1 00:22:46.580 00:22:46.580 ' 00:22:46.580 09:46:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:46.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:46.580 --rc genhtml_branch_coverage=1 00:22:46.580 --rc genhtml_function_coverage=1 00:22:46.580 --rc genhtml_legend=1 00:22:46.580 --rc geninfo_all_blocks=1 00:22:46.580 --rc geninfo_unexecuted_blocks=1 00:22:46.580 00:22:46.580 ' 00:22:46.580 09:46:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:46.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:46.580 --rc genhtml_branch_coverage=1 00:22:46.580 --rc genhtml_function_coverage=1 00:22:46.580 --rc genhtml_legend=1 00:22:46.580 --rc geninfo_all_blocks=1 00:22:46.580 --rc geninfo_unexecuted_blocks=1 00:22:46.580 00:22:46.580 ' 00:22:46.580 09:46:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:46.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:46.580 --rc genhtml_branch_coverage=1 00:22:46.580 --rc genhtml_function_coverage=1 00:22:46.580 --rc genhtml_legend=1 00:22:46.580 --rc geninfo_all_blocks=1 00:22:46.580 --rc geninfo_unexecuted_blocks=1 00:22:46.580 00:22:46.580 ' 00:22:46.580 09:46:09 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:46.580 09:46:09 -- nvmf/common.sh@7 -- # uname -s 00:22:46.580 09:46:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:46.580 09:46:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:46.580 09:46:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:46.580 09:46:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:46.580 09:46:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:46.580 09:46:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:46.580 09:46:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:46.580 09:46:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:46.580 09:46:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:46.580 09:46:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:46.580 09:46:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:46.580 09:46:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:46.580 09:46:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:46.580 09:46:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:46.580 09:46:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:46.580 09:46:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:46.580 09:46:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:46.580 09:46:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:46.580 09:46:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:46.580 09:46:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.580 09:46:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.580 09:46:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.580 09:46:09 -- paths/export.sh@5 -- # export PATH 00:22:46.580 09:46:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.580 09:46:09 -- nvmf/common.sh@46 -- # : 0 00:22:46.580 09:46:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:46.580 09:46:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:46.580 09:46:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:46.580 09:46:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:46.580 09:46:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:46.580 09:46:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:46.580 09:46:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:46.580 09:46:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:46.580 09:46:09 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:46.580 09:46:09 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:46.580 09:46:09 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:46.580 09:46:09 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:46.580 09:46:09 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:46.580 09:46:09 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:46.580 09:46:09 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:46.580 09:46:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:46.580 09:46:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:46.580 09:46:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:46.580 09:46:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:46.580 09:46:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:46.580 09:46:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:46.580 09:46:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:46.580 09:46:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:46.580 09:46:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:46.580 09:46:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:46.580 09:46:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:46.580 09:46:09 -- common/autotest_common.sh@10 -- # set +x 00:22:48.482 09:46:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:48.482 09:46:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:48.482 09:46:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:48.482 09:46:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:48.482 09:46:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:48.482 09:46:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:48.482 09:46:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:48.482 09:46:11 -- nvmf/common.sh@294 -- # net_devs=() 00:22:48.482 09:46:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:48.482 09:46:11 -- nvmf/common.sh@295 -- # e810=() 00:22:48.482 09:46:11 -- nvmf/common.sh@295 -- # local -ga e810 00:22:48.482 09:46:11 -- nvmf/common.sh@296 -- # x722=() 00:22:48.482 09:46:11 -- nvmf/common.sh@296 -- # local -ga x722 00:22:48.482 09:46:11 -- nvmf/common.sh@297 -- # mlx=() 00:22:48.482 09:46:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:48.482 09:46:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:48.482 09:46:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:48.482 09:46:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:48.482 09:46:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:48.482 09:46:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:48.482 09:46:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:48.482 09:46:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:48.482 09:46:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:48.482 09:46:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:48.482 09:46:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:48.482 09:46:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:48.482 09:46:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:48.482 09:46:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:48.482 09:46:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:48.482 09:46:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:48.482 09:46:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:48.482 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:48.482 09:46:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:48.482 09:46:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:48.482 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:48.482 09:46:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:48.482 09:46:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:48.482 09:46:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:48.482 09:46:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:48.482 09:46:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:48.482 09:46:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:48.482 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:48.482 09:46:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:48.482 09:46:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:48.482 09:46:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:48.482 09:46:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:48.482 09:46:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:48.482 09:46:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:48.482 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:48.482 09:46:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:48.482 09:46:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:48.482 09:46:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:48.482 09:46:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:48.482 09:46:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:48.482 09:46:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:48.482 09:46:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:48.482 09:46:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:48.482 09:46:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:48.482 09:46:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:48.483 09:46:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:48.483 09:46:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:48.483 09:46:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:48.483 09:46:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:48.483 09:46:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:48.483 09:46:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:48.483 09:46:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:48.483 09:46:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:48.483 09:46:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:48.483 09:46:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:48.483 09:46:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:48.483 09:46:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:48.483 09:46:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:48.483 09:46:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:48.483 09:46:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:48.483 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:48.483 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.120 ms 00:22:48.483 00:22:48.483 --- 10.0.0.2 ping statistics --- 00:22:48.483 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:48.483 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:22:48.483 09:46:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:48.483 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:48.483 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:22:48.483 00:22:48.483 --- 10.0.0.1 ping statistics --- 00:22:48.483 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:48.483 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:22:48.483 09:46:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:48.483 09:46:11 -- nvmf/common.sh@410 -- # return 0 00:22:48.483 09:46:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:48.483 09:46:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:48.483 09:46:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:48.483 09:46:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:48.483 09:46:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:48.483 09:46:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:48.483 09:46:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:48.483 09:46:11 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:48.483 09:46:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:48.483 09:46:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:48.483 09:46:11 -- common/autotest_common.sh@10 -- # set +x 00:22:48.483 09:46:11 -- nvmf/common.sh@469 -- # nvmfpid=96094 00:22:48.483 09:46:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:48.483 09:46:11 -- nvmf/common.sh@470 -- # waitforlisten 96094 00:22:48.483 09:46:11 -- common/autotest_common.sh@829 -- # '[' -z 96094 ']' 00:22:48.483 09:46:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:48.483 09:46:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:48.483 09:46:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:48.483 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:48.483 09:46:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:48.483 09:46:11 -- common/autotest_common.sh@10 -- # set +x 00:22:48.483 [2024-11-29 09:46:11.260468] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:48.483 [2024-11-29 09:46:11.260549] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:48.483 EAL: No free 2048 kB hugepages reported on node 1 00:22:48.483 [2024-11-29 09:46:11.323908] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:48.742 [2024-11-29 09:46:11.432795] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:48.742 [2024-11-29 09:46:11.432954] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:48.742 [2024-11-29 09:46:11.432972] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:48.742 [2024-11-29 09:46:11.432983] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:48.742 [2024-11-29 09:46:11.436418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:48.742 [2024-11-29 09:46:11.436552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:48.742 [2024-11-29 09:46:11.436557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:49.677 09:46:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:49.677 09:46:12 -- common/autotest_common.sh@862 -- # return 0 00:22:49.677 09:46:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:49.677 09:46:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:49.677 09:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:49.677 09:46:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:49.677 09:46:12 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:49.677 09:46:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.677 09:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:49.678 [2024-11-29 09:46:12.318537] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:49.678 09:46:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.678 09:46:12 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:49.678 09:46:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.678 09:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:49.678 Malloc0 00:22:49.678 09:46:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.678 09:46:12 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:49.678 09:46:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.678 09:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:49.678 09:46:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.678 09:46:12 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:49.678 09:46:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.678 09:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:49.678 09:46:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.678 09:46:12 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:49.678 09:46:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.678 09:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:49.678 [2024-11-29 09:46:12.383309] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:49.678 09:46:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.678 09:46:12 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:49.678 09:46:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.678 09:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:49.678 [2024-11-29 09:46:12.391199] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:49.678 09:46:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.678 09:46:12 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:49.678 09:46:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.678 09:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:49.678 Malloc1 00:22:49.678 09:46:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.678 09:46:12 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:49.678 09:46:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.678 09:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:49.678 09:46:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.678 09:46:12 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:49.678 09:46:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.678 09:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:49.678 09:46:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.678 09:46:12 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:49.678 09:46:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.678 09:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:49.678 09:46:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.678 09:46:12 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:49.678 09:46:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.678 09:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:49.678 09:46:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.678 09:46:12 -- host/multicontroller.sh@44 -- # bdevperf_pid=96253 00:22:49.678 09:46:12 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:49.678 09:46:12 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:49.678 09:46:12 -- host/multicontroller.sh@47 -- # waitforlisten 96253 /var/tmp/bdevperf.sock 00:22:49.678 09:46:12 -- common/autotest_common.sh@829 -- # '[' -z 96253 ']' 00:22:49.678 09:46:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:49.678 09:46:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:49.678 09:46:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:49.678 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:49.678 09:46:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:49.678 09:46:12 -- common/autotest_common.sh@10 -- # set +x 00:22:51.058 09:46:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:51.058 09:46:13 -- common/autotest_common.sh@862 -- # return 0 00:22:51.058 09:46:13 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:51.058 09:46:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.058 09:46:13 -- common/autotest_common.sh@10 -- # set +x 00:22:51.058 NVMe0n1 00:22:51.058 09:46:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.058 09:46:13 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:51.058 09:46:13 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:22:51.058 09:46:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.058 09:46:13 -- common/autotest_common.sh@10 -- # set +x 00:22:51.058 09:46:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.058 1 00:22:51.058 09:46:13 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:51.058 09:46:13 -- common/autotest_common.sh@650 -- # local es=0 00:22:51.058 09:46:13 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:51.058 09:46:13 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:51.058 09:46:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.058 09:46:13 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:51.058 09:46:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.058 09:46:13 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:51.058 09:46:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.058 09:46:13 -- common/autotest_common.sh@10 -- # set +x 00:22:51.058 request: 00:22:51.058 { 00:22:51.058 "name": "NVMe0", 00:22:51.058 "trtype": "tcp", 00:22:51.058 "traddr": "10.0.0.2", 00:22:51.058 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:22:51.058 "hostaddr": "10.0.0.2", 00:22:51.058 "hostsvcid": "60000", 00:22:51.058 "adrfam": "ipv4", 00:22:51.058 "trsvcid": "4420", 00:22:51.058 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:51.058 "method": "bdev_nvme_attach_controller", 00:22:51.058 "req_id": 1 00:22:51.058 } 00:22:51.058 Got JSON-RPC error response 00:22:51.059 response: 00:22:51.059 { 00:22:51.059 "code": -114, 00:22:51.059 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:51.059 } 00:22:51.059 09:46:13 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:51.059 09:46:13 -- common/autotest_common.sh@653 -- # es=1 00:22:51.059 09:46:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:51.059 09:46:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:51.059 09:46:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:51.059 09:46:13 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:51.059 09:46:13 -- common/autotest_common.sh@650 -- # local es=0 00:22:51.059 09:46:13 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:51.059 09:46:13 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:51.059 09:46:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.059 09:46:13 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:51.059 09:46:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.059 09:46:13 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:51.059 09:46:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.059 09:46:13 -- common/autotest_common.sh@10 -- # set +x 00:22:51.059 request: 00:22:51.059 { 00:22:51.059 "name": "NVMe0", 00:22:51.059 "trtype": "tcp", 00:22:51.059 "traddr": "10.0.0.2", 00:22:51.059 "hostaddr": "10.0.0.2", 00:22:51.059 "hostsvcid": "60000", 00:22:51.059 "adrfam": "ipv4", 00:22:51.059 "trsvcid": "4420", 00:22:51.059 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:51.059 "method": "bdev_nvme_attach_controller", 00:22:51.059 "req_id": 1 00:22:51.059 } 00:22:51.059 Got JSON-RPC error response 00:22:51.059 response: 00:22:51.059 { 00:22:51.059 "code": -114, 00:22:51.059 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:51.059 } 00:22:51.059 09:46:13 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:51.059 09:46:13 -- common/autotest_common.sh@653 -- # es=1 00:22:51.059 09:46:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:51.059 09:46:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:51.059 09:46:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:51.059 09:46:13 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:51.059 09:46:13 -- common/autotest_common.sh@650 -- # local es=0 00:22:51.059 09:46:13 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:51.059 09:46:13 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:51.059 09:46:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.059 09:46:13 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:51.059 09:46:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.059 09:46:13 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:51.059 09:46:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.059 09:46:13 -- common/autotest_common.sh@10 -- # set +x 00:22:51.059 request: 00:22:51.059 { 00:22:51.059 "name": "NVMe0", 00:22:51.059 "trtype": "tcp", 00:22:51.059 "traddr": "10.0.0.2", 00:22:51.059 "hostaddr": "10.0.0.2", 00:22:51.059 "hostsvcid": "60000", 00:22:51.059 "adrfam": "ipv4", 00:22:51.059 "trsvcid": "4420", 00:22:51.059 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:51.059 "multipath": "disable", 00:22:51.059 "method": "bdev_nvme_attach_controller", 00:22:51.059 "req_id": 1 00:22:51.059 } 00:22:51.059 Got JSON-RPC error response 00:22:51.059 response: 00:22:51.059 { 00:22:51.059 "code": -114, 00:22:51.059 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:22:51.059 } 00:22:51.059 09:46:13 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:51.059 09:46:13 -- common/autotest_common.sh@653 -- # es=1 00:22:51.059 09:46:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:51.059 09:46:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:51.059 09:46:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:51.059 09:46:13 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:51.059 09:46:13 -- common/autotest_common.sh@650 -- # local es=0 00:22:51.059 09:46:13 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:51.059 09:46:13 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:51.059 09:46:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.059 09:46:13 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:51.059 09:46:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.059 09:46:13 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:51.059 09:46:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.059 09:46:13 -- common/autotest_common.sh@10 -- # set +x 00:22:51.059 request: 00:22:51.059 { 00:22:51.059 "name": "NVMe0", 00:22:51.059 "trtype": "tcp", 00:22:51.059 "traddr": "10.0.0.2", 00:22:51.059 "hostaddr": "10.0.0.2", 00:22:51.059 "hostsvcid": "60000", 00:22:51.059 "adrfam": "ipv4", 00:22:51.059 "trsvcid": "4420", 00:22:51.059 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:51.059 "multipath": "failover", 00:22:51.059 "method": "bdev_nvme_attach_controller", 00:22:51.059 "req_id": 1 00:22:51.059 } 00:22:51.059 Got JSON-RPC error response 00:22:51.059 response: 00:22:51.059 { 00:22:51.059 "code": -114, 00:22:51.059 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:51.059 } 00:22:51.059 09:46:13 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:51.059 09:46:13 -- common/autotest_common.sh@653 -- # es=1 00:22:51.059 09:46:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:51.059 09:46:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:51.059 09:46:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:51.059 09:46:13 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:51.059 09:46:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.059 09:46:13 -- common/autotest_common.sh@10 -- # set +x 00:22:51.059 00:22:51.059 09:46:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.059 09:46:13 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:51.059 09:46:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.059 09:46:13 -- common/autotest_common.sh@10 -- # set +x 00:22:51.059 09:46:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.059 09:46:13 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:51.059 09:46:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.059 09:46:13 -- common/autotest_common.sh@10 -- # set +x 00:22:51.317 00:22:51.317 09:46:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.317 09:46:13 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:51.317 09:46:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.317 09:46:13 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:22:51.317 09:46:13 -- common/autotest_common.sh@10 -- # set +x 00:22:51.317 09:46:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.317 09:46:14 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:22:51.317 09:46:14 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:52.698 0 00:22:52.698 09:46:15 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:22:52.698 09:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.698 09:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:52.698 09:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.698 09:46:15 -- host/multicontroller.sh@100 -- # killprocess 96253 00:22:52.698 09:46:15 -- common/autotest_common.sh@936 -- # '[' -z 96253 ']' 00:22:52.698 09:46:15 -- common/autotest_common.sh@940 -- # kill -0 96253 00:22:52.698 09:46:15 -- common/autotest_common.sh@941 -- # uname 00:22:52.698 09:46:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:52.698 09:46:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 96253 00:22:52.698 09:46:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:52.698 09:46:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:52.698 09:46:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 96253' 00:22:52.698 killing process with pid 96253 00:22:52.698 09:46:15 -- common/autotest_common.sh@955 -- # kill 96253 00:22:52.698 09:46:15 -- common/autotest_common.sh@960 -- # wait 96253 00:22:52.698 09:46:15 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:52.698 09:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.698 09:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:52.698 09:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.698 09:46:15 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:52.698 09:46:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.698 09:46:15 -- common/autotest_common.sh@10 -- # set +x 00:22:52.698 09:46:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.698 09:46:15 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:22:52.698 09:46:15 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:52.698 09:46:15 -- common/autotest_common.sh@1607 -- # read -r file 00:22:52.698 09:46:15 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:22:52.698 09:46:15 -- common/autotest_common.sh@1606 -- # sort -u 00:22:52.698 09:46:15 -- common/autotest_common.sh@1608 -- # cat 00:22:52.698 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:52.698 [2024-11-29 09:46:12.487218] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:52.698 [2024-11-29 09:46:12.487317] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96253 ] 00:22:52.698 EAL: No free 2048 kB hugepages reported on node 1 00:22:52.698 [2024-11-29 09:46:12.548996] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:52.698 [2024-11-29 09:46:12.656173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:52.698 [2024-11-29 09:46:13.993492] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 3899da5f-7472-475b-aed5-48f83abf1973 already exists 00:22:52.698 [2024-11-29 09:46:13.993539] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:3899da5f-7472-475b-aed5-48f83abf1973 alias for bdev NVMe1n1 00:22:52.698 [2024-11-29 09:46:13.993558] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:22:52.698 Running I/O for 1 seconds... 00:22:52.698 00:22:52.698 Latency(us) 00:22:52.698 [2024-11-29T08:46:15.541Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:52.698 [2024-11-29T08:46:15.541Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:22:52.698 NVMe0n1 : 1.00 20177.99 78.82 0.00 0.00 6335.16 2609.30 11408.12 00:22:52.698 [2024-11-29T08:46:15.541Z] =================================================================================================================== 00:22:52.698 [2024-11-29T08:46:15.541Z] Total : 20177.99 78.82 0.00 0.00 6335.16 2609.30 11408.12 00:22:52.698 Received shutdown signal, test time was about 1.000000 seconds 00:22:52.698 00:22:52.698 Latency(us) 00:22:52.698 [2024-11-29T08:46:15.541Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:52.698 [2024-11-29T08:46:15.541Z] =================================================================================================================== 00:22:52.698 [2024-11-29T08:46:15.541Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:52.698 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:52.698 09:46:15 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:52.698 09:46:15 -- common/autotest_common.sh@1607 -- # read -r file 00:22:52.698 09:46:15 -- host/multicontroller.sh@108 -- # nvmftestfini 00:22:52.698 09:46:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:52.698 09:46:15 -- nvmf/common.sh@116 -- # sync 00:22:52.698 09:46:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:52.698 09:46:15 -- nvmf/common.sh@119 -- # set +e 00:22:52.698 09:46:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:52.698 09:46:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:52.698 rmmod nvme_tcp 00:22:52.698 rmmod nvme_fabrics 00:22:52.698 rmmod nvme_keyring 00:22:52.956 09:46:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:52.956 09:46:15 -- nvmf/common.sh@123 -- # set -e 00:22:52.956 09:46:15 -- nvmf/common.sh@124 -- # return 0 00:22:52.956 09:46:15 -- nvmf/common.sh@477 -- # '[' -n 96094 ']' 00:22:52.956 09:46:15 -- nvmf/common.sh@478 -- # killprocess 96094 00:22:52.956 09:46:15 -- common/autotest_common.sh@936 -- # '[' -z 96094 ']' 00:22:52.956 09:46:15 -- common/autotest_common.sh@940 -- # kill -0 96094 00:22:52.956 09:46:15 -- common/autotest_common.sh@941 -- # uname 00:22:52.956 09:46:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:52.956 09:46:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 96094 00:22:52.956 09:46:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:52.956 09:46:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:52.956 09:46:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 96094' 00:22:52.956 killing process with pid 96094 00:22:52.956 09:46:15 -- common/autotest_common.sh@955 -- # kill 96094 00:22:52.956 09:46:15 -- common/autotest_common.sh@960 -- # wait 96094 00:22:53.214 09:46:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:53.214 09:46:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:53.214 09:46:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:53.214 09:46:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:53.214 09:46:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:53.214 09:46:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:53.214 09:46:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:53.214 09:46:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:55.116 09:46:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:55.116 00:22:55.116 real 0m9.001s 00:22:55.116 user 0m17.578s 00:22:55.116 sys 0m2.306s 00:22:55.116 09:46:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:55.116 09:46:17 -- common/autotest_common.sh@10 -- # set +x 00:22:55.116 ************************************ 00:22:55.116 END TEST nvmf_multicontroller 00:22:55.116 ************************************ 00:22:55.377 09:46:17 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:55.377 09:46:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:55.377 09:46:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:55.377 09:46:17 -- common/autotest_common.sh@10 -- # set +x 00:22:55.377 ************************************ 00:22:55.377 START TEST nvmf_aer 00:22:55.377 ************************************ 00:22:55.377 09:46:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:55.377 * Looking for test storage... 00:22:55.377 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:55.377 09:46:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:55.377 09:46:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:55.377 09:46:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:55.377 09:46:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:55.377 09:46:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:55.377 09:46:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:55.377 09:46:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:55.377 09:46:18 -- scripts/common.sh@335 -- # IFS=.-: 00:22:55.377 09:46:18 -- scripts/common.sh@335 -- # read -ra ver1 00:22:55.377 09:46:18 -- scripts/common.sh@336 -- # IFS=.-: 00:22:55.377 09:46:18 -- scripts/common.sh@336 -- # read -ra ver2 00:22:55.377 09:46:18 -- scripts/common.sh@337 -- # local 'op=<' 00:22:55.377 09:46:18 -- scripts/common.sh@339 -- # ver1_l=2 00:22:55.377 09:46:18 -- scripts/common.sh@340 -- # ver2_l=1 00:22:55.377 09:46:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:55.377 09:46:18 -- scripts/common.sh@343 -- # case "$op" in 00:22:55.377 09:46:18 -- scripts/common.sh@344 -- # : 1 00:22:55.377 09:46:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:55.377 09:46:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:55.377 09:46:18 -- scripts/common.sh@364 -- # decimal 1 00:22:55.377 09:46:18 -- scripts/common.sh@352 -- # local d=1 00:22:55.377 09:46:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:55.377 09:46:18 -- scripts/common.sh@354 -- # echo 1 00:22:55.377 09:46:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:55.377 09:46:18 -- scripts/common.sh@365 -- # decimal 2 00:22:55.377 09:46:18 -- scripts/common.sh@352 -- # local d=2 00:22:55.377 09:46:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:55.377 09:46:18 -- scripts/common.sh@354 -- # echo 2 00:22:55.377 09:46:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:55.378 09:46:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:55.378 09:46:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:55.378 09:46:18 -- scripts/common.sh@367 -- # return 0 00:22:55.378 09:46:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:55.378 09:46:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:55.378 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.378 --rc genhtml_branch_coverage=1 00:22:55.378 --rc genhtml_function_coverage=1 00:22:55.378 --rc genhtml_legend=1 00:22:55.378 --rc geninfo_all_blocks=1 00:22:55.378 --rc geninfo_unexecuted_blocks=1 00:22:55.378 00:22:55.378 ' 00:22:55.378 09:46:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:55.378 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.378 --rc genhtml_branch_coverage=1 00:22:55.378 --rc genhtml_function_coverage=1 00:22:55.378 --rc genhtml_legend=1 00:22:55.378 --rc geninfo_all_blocks=1 00:22:55.378 --rc geninfo_unexecuted_blocks=1 00:22:55.378 00:22:55.378 ' 00:22:55.378 09:46:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:55.378 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.378 --rc genhtml_branch_coverage=1 00:22:55.378 --rc genhtml_function_coverage=1 00:22:55.378 --rc genhtml_legend=1 00:22:55.378 --rc geninfo_all_blocks=1 00:22:55.378 --rc geninfo_unexecuted_blocks=1 00:22:55.378 00:22:55.378 ' 00:22:55.378 09:46:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:55.378 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.378 --rc genhtml_branch_coverage=1 00:22:55.378 --rc genhtml_function_coverage=1 00:22:55.378 --rc genhtml_legend=1 00:22:55.378 --rc geninfo_all_blocks=1 00:22:55.378 --rc geninfo_unexecuted_blocks=1 00:22:55.378 00:22:55.378 ' 00:22:55.378 09:46:18 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:55.378 09:46:18 -- nvmf/common.sh@7 -- # uname -s 00:22:55.378 09:46:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:55.378 09:46:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:55.378 09:46:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:55.378 09:46:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:55.378 09:46:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:55.378 09:46:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:55.378 09:46:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:55.378 09:46:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:55.378 09:46:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:55.378 09:46:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:55.378 09:46:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:55.378 09:46:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:55.378 09:46:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:55.378 09:46:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:55.378 09:46:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:55.378 09:46:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:55.378 09:46:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:55.378 09:46:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:55.378 09:46:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:55.378 09:46:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.378 09:46:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.378 09:46:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.378 09:46:18 -- paths/export.sh@5 -- # export PATH 00:22:55.378 09:46:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.378 09:46:18 -- nvmf/common.sh@46 -- # : 0 00:22:55.378 09:46:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:55.378 09:46:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:55.378 09:46:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:55.378 09:46:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:55.378 09:46:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:55.378 09:46:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:55.378 09:46:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:55.378 09:46:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:55.378 09:46:18 -- host/aer.sh@11 -- # nvmftestinit 00:22:55.378 09:46:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:55.378 09:46:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:55.378 09:46:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:55.378 09:46:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:55.378 09:46:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:55.378 09:46:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:55.378 09:46:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:55.378 09:46:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:55.378 09:46:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:55.378 09:46:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:55.378 09:46:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:55.378 09:46:18 -- common/autotest_common.sh@10 -- # set +x 00:22:57.283 09:46:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:57.283 09:46:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:57.283 09:46:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:57.283 09:46:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:57.283 09:46:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:57.283 09:46:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:57.283 09:46:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:57.283 09:46:20 -- nvmf/common.sh@294 -- # net_devs=() 00:22:57.283 09:46:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:57.283 09:46:20 -- nvmf/common.sh@295 -- # e810=() 00:22:57.283 09:46:20 -- nvmf/common.sh@295 -- # local -ga e810 00:22:57.283 09:46:20 -- nvmf/common.sh@296 -- # x722=() 00:22:57.283 09:46:20 -- nvmf/common.sh@296 -- # local -ga x722 00:22:57.283 09:46:20 -- nvmf/common.sh@297 -- # mlx=() 00:22:57.283 09:46:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:57.283 09:46:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:57.283 09:46:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:57.283 09:46:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:57.283 09:46:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:57.283 09:46:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:57.283 09:46:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:57.283 09:46:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:57.283 09:46:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:57.283 09:46:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:57.283 09:46:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:57.283 09:46:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:57.283 09:46:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:57.283 09:46:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:57.283 09:46:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:57.283 09:46:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:57.283 09:46:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:57.283 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:57.283 09:46:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:57.283 09:46:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:57.283 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:57.283 09:46:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:57.283 09:46:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:57.283 09:46:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:57.283 09:46:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:57.283 09:46:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:57.283 09:46:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:57.283 09:46:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:57.283 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:57.283 09:46:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:57.283 09:46:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:57.283 09:46:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:57.283 09:46:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:57.283 09:46:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:57.283 09:46:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:57.283 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:57.283 09:46:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:57.283 09:46:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:57.283 09:46:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:57.283 09:46:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:57.284 09:46:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:57.284 09:46:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:57.284 09:46:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:57.284 09:46:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:57.284 09:46:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:57.284 09:46:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:57.284 09:46:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:57.284 09:46:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:57.284 09:46:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:57.284 09:46:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:57.284 09:46:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:57.284 09:46:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:57.284 09:46:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:57.284 09:46:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:57.284 09:46:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:57.284 09:46:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:57.284 09:46:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:57.284 09:46:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:57.284 09:46:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:57.543 09:46:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:57.543 09:46:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:57.543 09:46:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:57.543 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:57.543 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:22:57.543 00:22:57.543 --- 10.0.0.2 ping statistics --- 00:22:57.543 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:57.543 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:22:57.543 09:46:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:57.543 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:57.543 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:22:57.543 00:22:57.543 --- 10.0.0.1 ping statistics --- 00:22:57.543 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:57.543 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:22:57.543 09:46:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:57.543 09:46:20 -- nvmf/common.sh@410 -- # return 0 00:22:57.543 09:46:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:57.543 09:46:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:57.543 09:46:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:57.543 09:46:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:57.543 09:46:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:57.543 09:46:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:57.543 09:46:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:57.543 09:46:20 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:22:57.543 09:46:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:57.543 09:46:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:57.543 09:46:20 -- common/autotest_common.sh@10 -- # set +x 00:22:57.543 09:46:20 -- nvmf/common.sh@469 -- # nvmfpid=98618 00:22:57.543 09:46:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:57.543 09:46:20 -- nvmf/common.sh@470 -- # waitforlisten 98618 00:22:57.543 09:46:20 -- common/autotest_common.sh@829 -- # '[' -z 98618 ']' 00:22:57.544 09:46:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:57.544 09:46:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:57.544 09:46:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:57.544 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:57.544 09:46:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:57.544 09:46:20 -- common/autotest_common.sh@10 -- # set +x 00:22:57.544 [2024-11-29 09:46:20.225278] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:57.544 [2024-11-29 09:46:20.225357] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:57.544 EAL: No free 2048 kB hugepages reported on node 1 00:22:57.544 [2024-11-29 09:46:20.294050] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:57.802 [2024-11-29 09:46:20.409932] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:57.802 [2024-11-29 09:46:20.410081] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:57.802 [2024-11-29 09:46:20.410099] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:57.802 [2024-11-29 09:46:20.410111] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:57.802 [2024-11-29 09:46:20.410166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:57.802 [2024-11-29 09:46:20.410225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:57.802 [2024-11-29 09:46:20.410292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:57.802 [2024-11-29 09:46:20.410295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:58.740 09:46:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:58.740 09:46:21 -- common/autotest_common.sh@862 -- # return 0 00:22:58.740 09:46:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:58.740 09:46:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:58.740 09:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:58.740 09:46:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:58.740 09:46:21 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:58.740 09:46:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.740 09:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:58.740 [2024-11-29 09:46:21.234959] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:58.740 09:46:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.740 09:46:21 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:22:58.740 09:46:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.740 09:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:58.740 Malloc0 00:22:58.740 09:46:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.740 09:46:21 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:22:58.740 09:46:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.740 09:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:58.740 09:46:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.740 09:46:21 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:58.740 09:46:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.740 09:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:58.740 09:46:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.740 09:46:21 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:58.740 09:46:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.740 09:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:58.740 [2024-11-29 09:46:21.286991] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:58.740 09:46:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.740 09:46:21 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:22:58.740 09:46:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.740 09:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:58.740 [2024-11-29 09:46:21.294724] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:58.740 [ 00:22:58.740 { 00:22:58.740 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:58.740 "subtype": "Discovery", 00:22:58.740 "listen_addresses": [], 00:22:58.740 "allow_any_host": true, 00:22:58.740 "hosts": [] 00:22:58.740 }, 00:22:58.740 { 00:22:58.740 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:58.740 "subtype": "NVMe", 00:22:58.740 "listen_addresses": [ 00:22:58.740 { 00:22:58.740 "transport": "TCP", 00:22:58.740 "trtype": "TCP", 00:22:58.740 "adrfam": "IPv4", 00:22:58.740 "traddr": "10.0.0.2", 00:22:58.740 "trsvcid": "4420" 00:22:58.740 } 00:22:58.740 ], 00:22:58.740 "allow_any_host": true, 00:22:58.740 "hosts": [], 00:22:58.740 "serial_number": "SPDK00000000000001", 00:22:58.740 "model_number": "SPDK bdev Controller", 00:22:58.740 "max_namespaces": 2, 00:22:58.740 "min_cntlid": 1, 00:22:58.740 "max_cntlid": 65519, 00:22:58.740 "namespaces": [ 00:22:58.740 { 00:22:58.740 "nsid": 1, 00:22:58.740 "bdev_name": "Malloc0", 00:22:58.740 "name": "Malloc0", 00:22:58.740 "nguid": "1931F6041C904062B2CE1F02174770A5", 00:22:58.740 "uuid": "1931f604-1c90-4062-b2ce-1f02174770a5" 00:22:58.740 } 00:22:58.740 ] 00:22:58.740 } 00:22:58.740 ] 00:22:58.740 09:46:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.740 09:46:21 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:22:58.740 09:46:21 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:22:58.740 09:46:21 -- host/aer.sh@33 -- # aerpid=98779 00:22:58.740 09:46:21 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:22:58.740 09:46:21 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:22:58.740 09:46:21 -- common/autotest_common.sh@1254 -- # local i=0 00:22:58.740 09:46:21 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:58.740 09:46:21 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:22:58.740 09:46:21 -- common/autotest_common.sh@1257 -- # i=1 00:22:58.740 09:46:21 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:58.740 EAL: No free 2048 kB hugepages reported on node 1 00:22:58.740 09:46:21 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:58.740 09:46:21 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:22:58.740 09:46:21 -- common/autotest_common.sh@1257 -- # i=2 00:22:58.740 09:46:21 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:58.740 09:46:21 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:58.740 09:46:21 -- common/autotest_common.sh@1256 -- # '[' 2 -lt 200 ']' 00:22:58.740 09:46:21 -- common/autotest_common.sh@1257 -- # i=3 00:22:58.740 09:46:21 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:58.999 09:46:21 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:58.999 09:46:21 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:58.999 09:46:21 -- common/autotest_common.sh@1265 -- # return 0 00:22:58.999 09:46:21 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:22:58.999 09:46:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.999 09:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:58.999 Malloc1 00:22:58.999 09:46:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.999 09:46:21 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:22:59.000 09:46:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.000 09:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:59.000 09:46:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.000 09:46:21 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:22:59.000 09:46:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.000 09:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:59.000 Asynchronous Event Request test 00:22:59.000 Attaching to 10.0.0.2 00:22:59.000 Attached to 10.0.0.2 00:22:59.000 Registering asynchronous event callbacks... 00:22:59.000 Starting namespace attribute notice tests for all controllers... 00:22:59.000 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:22:59.000 aer_cb - Changed Namespace 00:22:59.000 Cleaning up... 00:22:59.000 [ 00:22:59.000 { 00:22:59.000 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:59.000 "subtype": "Discovery", 00:22:59.000 "listen_addresses": [], 00:22:59.000 "allow_any_host": true, 00:22:59.000 "hosts": [] 00:22:59.000 }, 00:22:59.000 { 00:22:59.000 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:59.000 "subtype": "NVMe", 00:22:59.000 "listen_addresses": [ 00:22:59.000 { 00:22:59.000 "transport": "TCP", 00:22:59.000 "trtype": "TCP", 00:22:59.000 "adrfam": "IPv4", 00:22:59.000 "traddr": "10.0.0.2", 00:22:59.000 "trsvcid": "4420" 00:22:59.000 } 00:22:59.000 ], 00:22:59.000 "allow_any_host": true, 00:22:59.000 "hosts": [], 00:22:59.000 "serial_number": "SPDK00000000000001", 00:22:59.000 "model_number": "SPDK bdev Controller", 00:22:59.000 "max_namespaces": 2, 00:22:59.000 "min_cntlid": 1, 00:22:59.000 "max_cntlid": 65519, 00:22:59.000 "namespaces": [ 00:22:59.000 { 00:22:59.000 "nsid": 1, 00:22:59.000 "bdev_name": "Malloc0", 00:22:59.000 "name": "Malloc0", 00:22:59.000 "nguid": "1931F6041C904062B2CE1F02174770A5", 00:22:59.000 "uuid": "1931f604-1c90-4062-b2ce-1f02174770a5" 00:22:59.000 }, 00:22:59.000 { 00:22:59.000 "nsid": 2, 00:22:59.000 "bdev_name": "Malloc1", 00:22:59.000 "name": "Malloc1", 00:22:59.000 "nguid": "BD989DD253E5491D869A8461CDC47B1D", 00:22:59.000 "uuid": "bd989dd2-53e5-491d-869a-8461cdc47b1d" 00:22:59.000 } 00:22:59.000 ] 00:22:59.000 } 00:22:59.000 ] 00:22:59.000 09:46:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.000 09:46:21 -- host/aer.sh@43 -- # wait 98779 00:22:59.000 09:46:21 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:22:59.000 09:46:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.000 09:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:59.000 09:46:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.000 09:46:21 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:22:59.000 09:46:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.000 09:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:59.000 09:46:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.000 09:46:21 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:59.000 09:46:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.000 09:46:21 -- common/autotest_common.sh@10 -- # set +x 00:22:59.000 09:46:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.000 09:46:21 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:22:59.000 09:46:21 -- host/aer.sh@51 -- # nvmftestfini 00:22:59.000 09:46:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:59.000 09:46:21 -- nvmf/common.sh@116 -- # sync 00:22:59.000 09:46:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:59.000 09:46:21 -- nvmf/common.sh@119 -- # set +e 00:22:59.000 09:46:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:59.000 09:46:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:59.000 rmmod nvme_tcp 00:22:59.000 rmmod nvme_fabrics 00:22:59.000 rmmod nvme_keyring 00:22:59.000 09:46:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:59.000 09:46:21 -- nvmf/common.sh@123 -- # set -e 00:22:59.000 09:46:21 -- nvmf/common.sh@124 -- # return 0 00:22:59.000 09:46:21 -- nvmf/common.sh@477 -- # '[' -n 98618 ']' 00:22:59.000 09:46:21 -- nvmf/common.sh@478 -- # killprocess 98618 00:22:59.000 09:46:21 -- common/autotest_common.sh@936 -- # '[' -z 98618 ']' 00:22:59.000 09:46:21 -- common/autotest_common.sh@940 -- # kill -0 98618 00:22:59.000 09:46:21 -- common/autotest_common.sh@941 -- # uname 00:22:59.000 09:46:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:59.000 09:46:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 98618 00:22:59.259 09:46:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:59.259 09:46:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:59.259 09:46:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 98618' 00:22:59.259 killing process with pid 98618 00:22:59.259 09:46:21 -- common/autotest_common.sh@955 -- # kill 98618 00:22:59.259 [2024-11-29 09:46:21.845313] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:59.259 09:46:21 -- common/autotest_common.sh@960 -- # wait 98618 00:22:59.519 09:46:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:59.519 09:46:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:59.519 09:46:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:59.519 09:46:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:59.519 09:46:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:59.519 09:46:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:59.519 09:46:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:59.519 09:46:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:01.425 09:46:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:01.425 00:23:01.425 real 0m6.203s 00:23:01.425 user 0m7.617s 00:23:01.425 sys 0m1.891s 00:23:01.425 09:46:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:01.425 09:46:24 -- common/autotest_common.sh@10 -- # set +x 00:23:01.425 ************************************ 00:23:01.425 END TEST nvmf_aer 00:23:01.425 ************************************ 00:23:01.425 09:46:24 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:01.425 09:46:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:01.425 09:46:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:01.425 09:46:24 -- common/autotest_common.sh@10 -- # set +x 00:23:01.425 ************************************ 00:23:01.425 START TEST nvmf_async_init 00:23:01.425 ************************************ 00:23:01.425 09:46:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:01.425 * Looking for test storage... 00:23:01.425 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:01.425 09:46:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:01.425 09:46:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:01.425 09:46:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:01.685 09:46:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:01.685 09:46:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:01.685 09:46:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:01.685 09:46:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:01.685 09:46:24 -- scripts/common.sh@335 -- # IFS=.-: 00:23:01.685 09:46:24 -- scripts/common.sh@335 -- # read -ra ver1 00:23:01.685 09:46:24 -- scripts/common.sh@336 -- # IFS=.-: 00:23:01.685 09:46:24 -- scripts/common.sh@336 -- # read -ra ver2 00:23:01.685 09:46:24 -- scripts/common.sh@337 -- # local 'op=<' 00:23:01.685 09:46:24 -- scripts/common.sh@339 -- # ver1_l=2 00:23:01.685 09:46:24 -- scripts/common.sh@340 -- # ver2_l=1 00:23:01.685 09:46:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:01.685 09:46:24 -- scripts/common.sh@343 -- # case "$op" in 00:23:01.685 09:46:24 -- scripts/common.sh@344 -- # : 1 00:23:01.685 09:46:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:01.685 09:46:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:01.685 09:46:24 -- scripts/common.sh@364 -- # decimal 1 00:23:01.685 09:46:24 -- scripts/common.sh@352 -- # local d=1 00:23:01.685 09:46:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:01.685 09:46:24 -- scripts/common.sh@354 -- # echo 1 00:23:01.685 09:46:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:01.685 09:46:24 -- scripts/common.sh@365 -- # decimal 2 00:23:01.685 09:46:24 -- scripts/common.sh@352 -- # local d=2 00:23:01.685 09:46:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:01.685 09:46:24 -- scripts/common.sh@354 -- # echo 2 00:23:01.685 09:46:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:01.685 09:46:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:01.685 09:46:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:01.685 09:46:24 -- scripts/common.sh@367 -- # return 0 00:23:01.685 09:46:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:01.685 09:46:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:01.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.685 --rc genhtml_branch_coverage=1 00:23:01.685 --rc genhtml_function_coverage=1 00:23:01.685 --rc genhtml_legend=1 00:23:01.685 --rc geninfo_all_blocks=1 00:23:01.685 --rc geninfo_unexecuted_blocks=1 00:23:01.685 00:23:01.685 ' 00:23:01.685 09:46:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:01.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.685 --rc genhtml_branch_coverage=1 00:23:01.685 --rc genhtml_function_coverage=1 00:23:01.685 --rc genhtml_legend=1 00:23:01.685 --rc geninfo_all_blocks=1 00:23:01.685 --rc geninfo_unexecuted_blocks=1 00:23:01.685 00:23:01.685 ' 00:23:01.685 09:46:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:01.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.685 --rc genhtml_branch_coverage=1 00:23:01.685 --rc genhtml_function_coverage=1 00:23:01.685 --rc genhtml_legend=1 00:23:01.685 --rc geninfo_all_blocks=1 00:23:01.685 --rc geninfo_unexecuted_blocks=1 00:23:01.685 00:23:01.685 ' 00:23:01.685 09:46:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:01.685 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.685 --rc genhtml_branch_coverage=1 00:23:01.685 --rc genhtml_function_coverage=1 00:23:01.685 --rc genhtml_legend=1 00:23:01.685 --rc geninfo_all_blocks=1 00:23:01.685 --rc geninfo_unexecuted_blocks=1 00:23:01.685 00:23:01.685 ' 00:23:01.685 09:46:24 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:01.685 09:46:24 -- nvmf/common.sh@7 -- # uname -s 00:23:01.685 09:46:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:01.685 09:46:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:01.685 09:46:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:01.685 09:46:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:01.685 09:46:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:01.685 09:46:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:01.685 09:46:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:01.685 09:46:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:01.685 09:46:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:01.685 09:46:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:01.685 09:46:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:01.685 09:46:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:01.685 09:46:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:01.685 09:46:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:01.685 09:46:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:01.685 09:46:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:01.685 09:46:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:01.685 09:46:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:01.685 09:46:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:01.685 09:46:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.686 09:46:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.686 09:46:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.686 09:46:24 -- paths/export.sh@5 -- # export PATH 00:23:01.686 09:46:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.686 09:46:24 -- nvmf/common.sh@46 -- # : 0 00:23:01.686 09:46:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:01.686 09:46:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:01.686 09:46:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:01.686 09:46:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:01.686 09:46:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:01.686 09:46:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:01.686 09:46:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:01.686 09:46:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:01.686 09:46:24 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:01.686 09:46:24 -- host/async_init.sh@14 -- # null_block_size=512 00:23:01.686 09:46:24 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:01.686 09:46:24 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:01.686 09:46:24 -- host/async_init.sh@20 -- # uuidgen 00:23:01.686 09:46:24 -- host/async_init.sh@20 -- # tr -d - 00:23:01.686 09:46:24 -- host/async_init.sh@20 -- # nguid=ae828a9c96bc448699c2faff547f0947 00:23:01.686 09:46:24 -- host/async_init.sh@22 -- # nvmftestinit 00:23:01.686 09:46:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:01.686 09:46:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:01.686 09:46:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:01.686 09:46:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:01.686 09:46:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:01.686 09:46:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:01.686 09:46:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:01.686 09:46:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:01.686 09:46:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:01.686 09:46:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:01.686 09:46:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:01.686 09:46:24 -- common/autotest_common.sh@10 -- # set +x 00:23:03.587 09:46:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:03.587 09:46:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:03.587 09:46:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:03.587 09:46:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:03.587 09:46:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:03.587 09:46:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:03.587 09:46:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:03.587 09:46:26 -- nvmf/common.sh@294 -- # net_devs=() 00:23:03.587 09:46:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:03.587 09:46:26 -- nvmf/common.sh@295 -- # e810=() 00:23:03.587 09:46:26 -- nvmf/common.sh@295 -- # local -ga e810 00:23:03.587 09:46:26 -- nvmf/common.sh@296 -- # x722=() 00:23:03.587 09:46:26 -- nvmf/common.sh@296 -- # local -ga x722 00:23:03.587 09:46:26 -- nvmf/common.sh@297 -- # mlx=() 00:23:03.587 09:46:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:03.587 09:46:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:03.587 09:46:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:03.587 09:46:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:03.587 09:46:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:03.587 09:46:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:03.587 09:46:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:03.587 09:46:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:03.587 09:46:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:03.587 09:46:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:03.587 09:46:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:03.587 09:46:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:03.587 09:46:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:03.587 09:46:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:03.587 09:46:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:03.587 09:46:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:03.587 09:46:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:03.587 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:03.587 09:46:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:03.587 09:46:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:03.587 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:03.587 09:46:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:03.587 09:46:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:03.587 09:46:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:03.587 09:46:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:03.587 09:46:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:03.587 09:46:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:03.587 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:03.587 09:46:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:03.587 09:46:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:03.587 09:46:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:03.587 09:46:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:03.587 09:46:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:03.587 09:46:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:03.587 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:03.587 09:46:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:03.587 09:46:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:03.587 09:46:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:03.587 09:46:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:03.587 09:46:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:03.587 09:46:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:03.587 09:46:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:03.587 09:46:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:03.587 09:46:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:03.587 09:46:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:03.587 09:46:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:03.587 09:46:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:03.587 09:46:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:03.587 09:46:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:03.587 09:46:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:03.587 09:46:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:03.587 09:46:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:03.587 09:46:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:03.845 09:46:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:03.845 09:46:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:03.845 09:46:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:03.845 09:46:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:03.845 09:46:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:03.845 09:46:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:03.845 09:46:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:03.845 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:03.846 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:23:03.846 00:23:03.846 --- 10.0.0.2 ping statistics --- 00:23:03.846 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:03.846 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:23:03.846 09:46:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:03.846 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:03.846 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:23:03.846 00:23:03.846 --- 10.0.0.1 ping statistics --- 00:23:03.846 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:03.846 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:23:03.846 09:46:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:03.846 09:46:26 -- nvmf/common.sh@410 -- # return 0 00:23:03.846 09:46:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:03.846 09:46:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:03.846 09:46:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:03.846 09:46:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:03.846 09:46:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:03.846 09:46:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:03.846 09:46:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:03.846 09:46:26 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:03.846 09:46:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:03.846 09:46:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:03.846 09:46:26 -- common/autotest_common.sh@10 -- # set +x 00:23:03.846 09:46:26 -- nvmf/common.sh@469 -- # nvmfpid=100745 00:23:03.846 09:46:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:03.846 09:46:26 -- nvmf/common.sh@470 -- # waitforlisten 100745 00:23:03.846 09:46:26 -- common/autotest_common.sh@829 -- # '[' -z 100745 ']' 00:23:03.846 09:46:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:03.846 09:46:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:03.846 09:46:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:03.846 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:03.846 09:46:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:03.846 09:46:26 -- common/autotest_common.sh@10 -- # set +x 00:23:03.846 [2024-11-29 09:46:26.655796] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:03.846 [2024-11-29 09:46:26.655879] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:04.103 EAL: No free 2048 kB hugepages reported on node 1 00:23:04.103 [2024-11-29 09:46:26.729157] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:04.103 [2024-11-29 09:46:26.845502] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:04.103 [2024-11-29 09:46:26.845660] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:04.103 [2024-11-29 09:46:26.845681] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:04.103 [2024-11-29 09:46:26.845697] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:04.103 [2024-11-29 09:46:26.845735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:05.067 09:46:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:05.067 09:46:27 -- common/autotest_common.sh@862 -- # return 0 00:23:05.067 09:46:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:05.067 09:46:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:05.067 09:46:27 -- common/autotest_common.sh@10 -- # set +x 00:23:05.067 09:46:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:05.067 09:46:27 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:05.067 09:46:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.067 09:46:27 -- common/autotest_common.sh@10 -- # set +x 00:23:05.067 [2024-11-29 09:46:27.710579] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:05.067 09:46:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.067 09:46:27 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:05.067 09:46:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.067 09:46:27 -- common/autotest_common.sh@10 -- # set +x 00:23:05.067 null0 00:23:05.067 09:46:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.067 09:46:27 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:05.067 09:46:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.067 09:46:27 -- common/autotest_common.sh@10 -- # set +x 00:23:05.067 09:46:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.067 09:46:27 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:05.067 09:46:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.067 09:46:27 -- common/autotest_common.sh@10 -- # set +x 00:23:05.067 09:46:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.067 09:46:27 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g ae828a9c96bc448699c2faff547f0947 00:23:05.067 09:46:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.067 09:46:27 -- common/autotest_common.sh@10 -- # set +x 00:23:05.067 09:46:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.067 09:46:27 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:05.067 09:46:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.067 09:46:27 -- common/autotest_common.sh@10 -- # set +x 00:23:05.067 [2024-11-29 09:46:27.750863] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:05.067 09:46:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.067 09:46:27 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:05.067 09:46:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.067 09:46:27 -- common/autotest_common.sh@10 -- # set +x 00:23:05.327 nvme0n1 00:23:05.327 09:46:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.327 09:46:27 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:05.327 09:46:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.327 09:46:27 -- common/autotest_common.sh@10 -- # set +x 00:23:05.327 [ 00:23:05.327 { 00:23:05.327 "name": "nvme0n1", 00:23:05.327 "aliases": [ 00:23:05.327 "ae828a9c-96bc-4486-99c2-faff547f0947" 00:23:05.327 ], 00:23:05.327 "product_name": "NVMe disk", 00:23:05.327 "block_size": 512, 00:23:05.327 "num_blocks": 2097152, 00:23:05.327 "uuid": "ae828a9c-96bc-4486-99c2-faff547f0947", 00:23:05.327 "assigned_rate_limits": { 00:23:05.327 "rw_ios_per_sec": 0, 00:23:05.327 "rw_mbytes_per_sec": 0, 00:23:05.327 "r_mbytes_per_sec": 0, 00:23:05.327 "w_mbytes_per_sec": 0 00:23:05.327 }, 00:23:05.327 "claimed": false, 00:23:05.327 "zoned": false, 00:23:05.327 "supported_io_types": { 00:23:05.327 "read": true, 00:23:05.327 "write": true, 00:23:05.327 "unmap": false, 00:23:05.327 "write_zeroes": true, 00:23:05.327 "flush": true, 00:23:05.327 "reset": true, 00:23:05.327 "compare": true, 00:23:05.327 "compare_and_write": true, 00:23:05.327 "abort": true, 00:23:05.327 "nvme_admin": true, 00:23:05.327 "nvme_io": true 00:23:05.327 }, 00:23:05.327 "driver_specific": { 00:23:05.327 "nvme": [ 00:23:05.327 { 00:23:05.327 "trid": { 00:23:05.327 "trtype": "TCP", 00:23:05.327 "adrfam": "IPv4", 00:23:05.327 "traddr": "10.0.0.2", 00:23:05.327 "trsvcid": "4420", 00:23:05.327 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:05.327 }, 00:23:05.327 "ctrlr_data": { 00:23:05.327 "cntlid": 1, 00:23:05.327 "vendor_id": "0x8086", 00:23:05.327 "model_number": "SPDK bdev Controller", 00:23:05.327 "serial_number": "00000000000000000000", 00:23:05.327 "firmware_revision": "24.01.1", 00:23:05.327 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:05.327 "oacs": { 00:23:05.327 "security": 0, 00:23:05.327 "format": 0, 00:23:05.327 "firmware": 0, 00:23:05.327 "ns_manage": 0 00:23:05.327 }, 00:23:05.327 "multi_ctrlr": true, 00:23:05.327 "ana_reporting": false 00:23:05.327 }, 00:23:05.327 "vs": { 00:23:05.327 "nvme_version": "1.3" 00:23:05.327 }, 00:23:05.327 "ns_data": { 00:23:05.327 "id": 1, 00:23:05.327 "can_share": true 00:23:05.327 } 00:23:05.327 } 00:23:05.327 ], 00:23:05.327 "mp_policy": "active_passive" 00:23:05.327 } 00:23:05.327 } 00:23:05.327 ] 00:23:05.327 09:46:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.327 09:46:27 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:05.327 09:46:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.327 09:46:27 -- common/autotest_common.sh@10 -- # set +x 00:23:05.327 [2024-11-29 09:46:27.999458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:05.327 [2024-11-29 09:46:27.999532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13b5ba0 (9): Bad file descriptor 00:23:05.327 [2024-11-29 09:46:28.131552] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:05.327 09:46:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.327 09:46:28 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:05.327 09:46:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.327 09:46:28 -- common/autotest_common.sh@10 -- # set +x 00:23:05.327 [ 00:23:05.327 { 00:23:05.327 "name": "nvme0n1", 00:23:05.327 "aliases": [ 00:23:05.327 "ae828a9c-96bc-4486-99c2-faff547f0947" 00:23:05.327 ], 00:23:05.327 "product_name": "NVMe disk", 00:23:05.327 "block_size": 512, 00:23:05.327 "num_blocks": 2097152, 00:23:05.327 "uuid": "ae828a9c-96bc-4486-99c2-faff547f0947", 00:23:05.327 "assigned_rate_limits": { 00:23:05.327 "rw_ios_per_sec": 0, 00:23:05.327 "rw_mbytes_per_sec": 0, 00:23:05.328 "r_mbytes_per_sec": 0, 00:23:05.328 "w_mbytes_per_sec": 0 00:23:05.328 }, 00:23:05.328 "claimed": false, 00:23:05.328 "zoned": false, 00:23:05.328 "supported_io_types": { 00:23:05.328 "read": true, 00:23:05.328 "write": true, 00:23:05.328 "unmap": false, 00:23:05.328 "write_zeroes": true, 00:23:05.328 "flush": true, 00:23:05.328 "reset": true, 00:23:05.328 "compare": true, 00:23:05.328 "compare_and_write": true, 00:23:05.328 "abort": true, 00:23:05.328 "nvme_admin": true, 00:23:05.328 "nvme_io": true 00:23:05.328 }, 00:23:05.328 "driver_specific": { 00:23:05.328 "nvme": [ 00:23:05.328 { 00:23:05.328 "trid": { 00:23:05.328 "trtype": "TCP", 00:23:05.328 "adrfam": "IPv4", 00:23:05.328 "traddr": "10.0.0.2", 00:23:05.328 "trsvcid": "4420", 00:23:05.328 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:05.328 }, 00:23:05.328 "ctrlr_data": { 00:23:05.328 "cntlid": 2, 00:23:05.328 "vendor_id": "0x8086", 00:23:05.328 "model_number": "SPDK bdev Controller", 00:23:05.328 "serial_number": "00000000000000000000", 00:23:05.328 "firmware_revision": "24.01.1", 00:23:05.328 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:05.328 "oacs": { 00:23:05.328 "security": 0, 00:23:05.328 "format": 0, 00:23:05.328 "firmware": 0, 00:23:05.328 "ns_manage": 0 00:23:05.328 }, 00:23:05.328 "multi_ctrlr": true, 00:23:05.328 "ana_reporting": false 00:23:05.328 }, 00:23:05.328 "vs": { 00:23:05.328 "nvme_version": "1.3" 00:23:05.328 }, 00:23:05.328 "ns_data": { 00:23:05.328 "id": 1, 00:23:05.328 "can_share": true 00:23:05.328 } 00:23:05.328 } 00:23:05.328 ], 00:23:05.328 "mp_policy": "active_passive" 00:23:05.328 } 00:23:05.328 } 00:23:05.328 ] 00:23:05.328 09:46:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.328 09:46:28 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:05.328 09:46:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.328 09:46:28 -- common/autotest_common.sh@10 -- # set +x 00:23:05.328 09:46:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.328 09:46:28 -- host/async_init.sh@53 -- # mktemp 00:23:05.328 09:46:28 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.UMvMowOwVe 00:23:05.328 09:46:28 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:05.328 09:46:28 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.UMvMowOwVe 00:23:05.328 09:46:28 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:05.328 09:46:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.328 09:46:28 -- common/autotest_common.sh@10 -- # set +x 00:23:05.587 09:46:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.587 09:46:28 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:05.587 09:46:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.587 09:46:28 -- common/autotest_common.sh@10 -- # set +x 00:23:05.587 [2024-11-29 09:46:28.180049] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:05.587 [2024-11-29 09:46:28.180229] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:05.587 09:46:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.587 09:46:28 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.UMvMowOwVe 00:23:05.587 09:46:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.587 09:46:28 -- common/autotest_common.sh@10 -- # set +x 00:23:05.587 09:46:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.587 09:46:28 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.UMvMowOwVe 00:23:05.587 09:46:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.587 09:46:28 -- common/autotest_common.sh@10 -- # set +x 00:23:05.587 [2024-11-29 09:46:28.196088] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:05.587 nvme0n1 00:23:05.587 09:46:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.587 09:46:28 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:05.587 09:46:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.587 09:46:28 -- common/autotest_common.sh@10 -- # set +x 00:23:05.587 [ 00:23:05.587 { 00:23:05.587 "name": "nvme0n1", 00:23:05.587 "aliases": [ 00:23:05.587 "ae828a9c-96bc-4486-99c2-faff547f0947" 00:23:05.587 ], 00:23:05.587 "product_name": "NVMe disk", 00:23:05.587 "block_size": 512, 00:23:05.587 "num_blocks": 2097152, 00:23:05.587 "uuid": "ae828a9c-96bc-4486-99c2-faff547f0947", 00:23:05.587 "assigned_rate_limits": { 00:23:05.587 "rw_ios_per_sec": 0, 00:23:05.587 "rw_mbytes_per_sec": 0, 00:23:05.587 "r_mbytes_per_sec": 0, 00:23:05.587 "w_mbytes_per_sec": 0 00:23:05.587 }, 00:23:05.587 "claimed": false, 00:23:05.587 "zoned": false, 00:23:05.587 "supported_io_types": { 00:23:05.587 "read": true, 00:23:05.587 "write": true, 00:23:05.587 "unmap": false, 00:23:05.587 "write_zeroes": true, 00:23:05.587 "flush": true, 00:23:05.587 "reset": true, 00:23:05.587 "compare": true, 00:23:05.587 "compare_and_write": true, 00:23:05.587 "abort": true, 00:23:05.587 "nvme_admin": true, 00:23:05.587 "nvme_io": true 00:23:05.587 }, 00:23:05.587 "driver_specific": { 00:23:05.587 "nvme": [ 00:23:05.587 { 00:23:05.587 "trid": { 00:23:05.587 "trtype": "TCP", 00:23:05.587 "adrfam": "IPv4", 00:23:05.587 "traddr": "10.0.0.2", 00:23:05.587 "trsvcid": "4421", 00:23:05.587 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:05.587 }, 00:23:05.587 "ctrlr_data": { 00:23:05.587 "cntlid": 3, 00:23:05.587 "vendor_id": "0x8086", 00:23:05.587 "model_number": "SPDK bdev Controller", 00:23:05.587 "serial_number": "00000000000000000000", 00:23:05.587 "firmware_revision": "24.01.1", 00:23:05.587 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:05.587 "oacs": { 00:23:05.587 "security": 0, 00:23:05.587 "format": 0, 00:23:05.587 "firmware": 0, 00:23:05.587 "ns_manage": 0 00:23:05.587 }, 00:23:05.587 "multi_ctrlr": true, 00:23:05.587 "ana_reporting": false 00:23:05.587 }, 00:23:05.587 "vs": { 00:23:05.587 "nvme_version": "1.3" 00:23:05.587 }, 00:23:05.587 "ns_data": { 00:23:05.587 "id": 1, 00:23:05.587 "can_share": true 00:23:05.587 } 00:23:05.587 } 00:23:05.587 ], 00:23:05.587 "mp_policy": "active_passive" 00:23:05.587 } 00:23:05.587 } 00:23:05.587 ] 00:23:05.587 09:46:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.587 09:46:28 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:05.587 09:46:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.587 09:46:28 -- common/autotest_common.sh@10 -- # set +x 00:23:05.587 09:46:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.587 09:46:28 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.UMvMowOwVe 00:23:05.587 09:46:28 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:05.587 09:46:28 -- host/async_init.sh@78 -- # nvmftestfini 00:23:05.587 09:46:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:05.587 09:46:28 -- nvmf/common.sh@116 -- # sync 00:23:05.587 09:46:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:05.587 09:46:28 -- nvmf/common.sh@119 -- # set +e 00:23:05.587 09:46:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:05.587 09:46:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:05.587 rmmod nvme_tcp 00:23:05.587 rmmod nvme_fabrics 00:23:05.587 rmmod nvme_keyring 00:23:05.587 09:46:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:05.587 09:46:28 -- nvmf/common.sh@123 -- # set -e 00:23:05.587 09:46:28 -- nvmf/common.sh@124 -- # return 0 00:23:05.587 09:46:28 -- nvmf/common.sh@477 -- # '[' -n 100745 ']' 00:23:05.587 09:46:28 -- nvmf/common.sh@478 -- # killprocess 100745 00:23:05.587 09:46:28 -- common/autotest_common.sh@936 -- # '[' -z 100745 ']' 00:23:05.587 09:46:28 -- common/autotest_common.sh@940 -- # kill -0 100745 00:23:05.587 09:46:28 -- common/autotest_common.sh@941 -- # uname 00:23:05.588 09:46:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:05.588 09:46:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 100745 00:23:05.588 09:46:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:05.588 09:46:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:05.588 09:46:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 100745' 00:23:05.588 killing process with pid 100745 00:23:05.588 09:46:28 -- common/autotest_common.sh@955 -- # kill 100745 00:23:05.588 09:46:28 -- common/autotest_common.sh@960 -- # wait 100745 00:23:05.846 09:46:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:05.846 09:46:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:05.846 09:46:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:05.846 09:46:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:05.846 09:46:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:05.846 09:46:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:05.846 09:46:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:05.846 09:46:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:08.381 09:46:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:08.381 00:23:08.381 real 0m6.497s 00:23:08.381 user 0m3.220s 00:23:08.381 sys 0m1.919s 00:23:08.381 09:46:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:08.381 09:46:30 -- common/autotest_common.sh@10 -- # set +x 00:23:08.381 ************************************ 00:23:08.381 END TEST nvmf_async_init 00:23:08.381 ************************************ 00:23:08.381 09:46:30 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:08.381 09:46:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:08.381 09:46:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:08.381 09:46:30 -- common/autotest_common.sh@10 -- # set +x 00:23:08.381 ************************************ 00:23:08.381 START TEST dma 00:23:08.381 ************************************ 00:23:08.381 09:46:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:08.381 * Looking for test storage... 00:23:08.381 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:08.381 09:46:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:08.381 09:46:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:08.381 09:46:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:08.381 09:46:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:08.381 09:46:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:08.381 09:46:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:08.381 09:46:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:08.381 09:46:30 -- scripts/common.sh@335 -- # IFS=.-: 00:23:08.381 09:46:30 -- scripts/common.sh@335 -- # read -ra ver1 00:23:08.381 09:46:30 -- scripts/common.sh@336 -- # IFS=.-: 00:23:08.381 09:46:30 -- scripts/common.sh@336 -- # read -ra ver2 00:23:08.381 09:46:30 -- scripts/common.sh@337 -- # local 'op=<' 00:23:08.381 09:46:30 -- scripts/common.sh@339 -- # ver1_l=2 00:23:08.381 09:46:30 -- scripts/common.sh@340 -- # ver2_l=1 00:23:08.381 09:46:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:08.381 09:46:30 -- scripts/common.sh@343 -- # case "$op" in 00:23:08.381 09:46:30 -- scripts/common.sh@344 -- # : 1 00:23:08.381 09:46:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:08.381 09:46:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:08.381 09:46:30 -- scripts/common.sh@364 -- # decimal 1 00:23:08.381 09:46:30 -- scripts/common.sh@352 -- # local d=1 00:23:08.381 09:46:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:08.381 09:46:30 -- scripts/common.sh@354 -- # echo 1 00:23:08.381 09:46:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:08.381 09:46:30 -- scripts/common.sh@365 -- # decimal 2 00:23:08.381 09:46:30 -- scripts/common.sh@352 -- # local d=2 00:23:08.381 09:46:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:08.381 09:46:30 -- scripts/common.sh@354 -- # echo 2 00:23:08.381 09:46:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:08.381 09:46:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:08.381 09:46:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:08.381 09:46:30 -- scripts/common.sh@367 -- # return 0 00:23:08.381 09:46:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:08.381 09:46:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:08.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.381 --rc genhtml_branch_coverage=1 00:23:08.381 --rc genhtml_function_coverage=1 00:23:08.382 --rc genhtml_legend=1 00:23:08.382 --rc geninfo_all_blocks=1 00:23:08.382 --rc geninfo_unexecuted_blocks=1 00:23:08.382 00:23:08.382 ' 00:23:08.382 09:46:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:08.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.382 --rc genhtml_branch_coverage=1 00:23:08.382 --rc genhtml_function_coverage=1 00:23:08.382 --rc genhtml_legend=1 00:23:08.382 --rc geninfo_all_blocks=1 00:23:08.382 --rc geninfo_unexecuted_blocks=1 00:23:08.382 00:23:08.382 ' 00:23:08.382 09:46:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:08.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.382 --rc genhtml_branch_coverage=1 00:23:08.382 --rc genhtml_function_coverage=1 00:23:08.382 --rc genhtml_legend=1 00:23:08.382 --rc geninfo_all_blocks=1 00:23:08.382 --rc geninfo_unexecuted_blocks=1 00:23:08.382 00:23:08.382 ' 00:23:08.382 09:46:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:08.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.382 --rc genhtml_branch_coverage=1 00:23:08.382 --rc genhtml_function_coverage=1 00:23:08.382 --rc genhtml_legend=1 00:23:08.382 --rc geninfo_all_blocks=1 00:23:08.382 --rc geninfo_unexecuted_blocks=1 00:23:08.382 00:23:08.382 ' 00:23:08.382 09:46:30 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:08.382 09:46:30 -- nvmf/common.sh@7 -- # uname -s 00:23:08.382 09:46:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:08.382 09:46:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:08.382 09:46:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:08.382 09:46:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:08.382 09:46:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:08.382 09:46:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:08.382 09:46:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:08.382 09:46:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:08.382 09:46:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:08.382 09:46:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:08.382 09:46:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:08.382 09:46:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:08.382 09:46:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:08.382 09:46:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:08.382 09:46:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:08.382 09:46:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:08.382 09:46:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:08.382 09:46:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:08.382 09:46:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:08.382 09:46:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.382 09:46:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.382 09:46:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.382 09:46:30 -- paths/export.sh@5 -- # export PATH 00:23:08.382 09:46:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.382 09:46:30 -- nvmf/common.sh@46 -- # : 0 00:23:08.382 09:46:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:08.382 09:46:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:08.382 09:46:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:08.382 09:46:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:08.382 09:46:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:08.382 09:46:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:08.382 09:46:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:08.382 09:46:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:08.382 09:46:30 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:08.382 09:46:30 -- host/dma.sh@13 -- # exit 0 00:23:08.382 00:23:08.382 real 0m0.145s 00:23:08.382 user 0m0.100s 00:23:08.382 sys 0m0.053s 00:23:08.382 09:46:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:08.382 09:46:30 -- common/autotest_common.sh@10 -- # set +x 00:23:08.382 ************************************ 00:23:08.382 END TEST dma 00:23:08.382 ************************************ 00:23:08.382 09:46:30 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:08.382 09:46:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:08.382 09:46:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:08.382 09:46:30 -- common/autotest_common.sh@10 -- # set +x 00:23:08.382 ************************************ 00:23:08.382 START TEST nvmf_identify 00:23:08.382 ************************************ 00:23:08.382 09:46:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:08.382 * Looking for test storage... 00:23:08.382 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:08.382 09:46:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:08.382 09:46:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:08.382 09:46:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:08.382 09:46:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:08.382 09:46:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:08.382 09:46:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:08.382 09:46:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:08.382 09:46:31 -- scripts/common.sh@335 -- # IFS=.-: 00:23:08.382 09:46:31 -- scripts/common.sh@335 -- # read -ra ver1 00:23:08.382 09:46:31 -- scripts/common.sh@336 -- # IFS=.-: 00:23:08.382 09:46:31 -- scripts/common.sh@336 -- # read -ra ver2 00:23:08.382 09:46:31 -- scripts/common.sh@337 -- # local 'op=<' 00:23:08.382 09:46:31 -- scripts/common.sh@339 -- # ver1_l=2 00:23:08.382 09:46:31 -- scripts/common.sh@340 -- # ver2_l=1 00:23:08.382 09:46:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:08.382 09:46:31 -- scripts/common.sh@343 -- # case "$op" in 00:23:08.382 09:46:31 -- scripts/common.sh@344 -- # : 1 00:23:08.382 09:46:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:08.382 09:46:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:08.382 09:46:31 -- scripts/common.sh@364 -- # decimal 1 00:23:08.382 09:46:31 -- scripts/common.sh@352 -- # local d=1 00:23:08.382 09:46:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:08.382 09:46:31 -- scripts/common.sh@354 -- # echo 1 00:23:08.382 09:46:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:08.382 09:46:31 -- scripts/common.sh@365 -- # decimal 2 00:23:08.382 09:46:31 -- scripts/common.sh@352 -- # local d=2 00:23:08.382 09:46:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:08.382 09:46:31 -- scripts/common.sh@354 -- # echo 2 00:23:08.382 09:46:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:08.382 09:46:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:08.382 09:46:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:08.382 09:46:31 -- scripts/common.sh@367 -- # return 0 00:23:08.382 09:46:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:08.382 09:46:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:08.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.382 --rc genhtml_branch_coverage=1 00:23:08.382 --rc genhtml_function_coverage=1 00:23:08.382 --rc genhtml_legend=1 00:23:08.382 --rc geninfo_all_blocks=1 00:23:08.382 --rc geninfo_unexecuted_blocks=1 00:23:08.382 00:23:08.382 ' 00:23:08.382 09:46:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:08.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.382 --rc genhtml_branch_coverage=1 00:23:08.382 --rc genhtml_function_coverage=1 00:23:08.382 --rc genhtml_legend=1 00:23:08.382 --rc geninfo_all_blocks=1 00:23:08.382 --rc geninfo_unexecuted_blocks=1 00:23:08.382 00:23:08.382 ' 00:23:08.382 09:46:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:08.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.382 --rc genhtml_branch_coverage=1 00:23:08.382 --rc genhtml_function_coverage=1 00:23:08.382 --rc genhtml_legend=1 00:23:08.382 --rc geninfo_all_blocks=1 00:23:08.382 --rc geninfo_unexecuted_blocks=1 00:23:08.382 00:23:08.382 ' 00:23:08.382 09:46:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:08.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.382 --rc genhtml_branch_coverage=1 00:23:08.382 --rc genhtml_function_coverage=1 00:23:08.382 --rc genhtml_legend=1 00:23:08.382 --rc geninfo_all_blocks=1 00:23:08.382 --rc geninfo_unexecuted_blocks=1 00:23:08.382 00:23:08.382 ' 00:23:08.382 09:46:31 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:08.382 09:46:31 -- nvmf/common.sh@7 -- # uname -s 00:23:08.382 09:46:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:08.382 09:46:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:08.383 09:46:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:08.383 09:46:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:08.383 09:46:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:08.383 09:46:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:08.383 09:46:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:08.383 09:46:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:08.383 09:46:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:08.383 09:46:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:08.383 09:46:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:08.383 09:46:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:08.383 09:46:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:08.383 09:46:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:08.383 09:46:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:08.383 09:46:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:08.383 09:46:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:08.383 09:46:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:08.383 09:46:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:08.383 09:46:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.383 09:46:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.383 09:46:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.383 09:46:31 -- paths/export.sh@5 -- # export PATH 00:23:08.383 09:46:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.383 09:46:31 -- nvmf/common.sh@46 -- # : 0 00:23:08.383 09:46:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:08.383 09:46:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:08.383 09:46:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:08.383 09:46:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:08.383 09:46:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:08.383 09:46:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:08.383 09:46:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:08.383 09:46:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:08.383 09:46:31 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:08.383 09:46:31 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:08.383 09:46:31 -- host/identify.sh@14 -- # nvmftestinit 00:23:08.383 09:46:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:08.383 09:46:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:08.383 09:46:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:08.383 09:46:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:08.383 09:46:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:08.383 09:46:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:08.383 09:46:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:08.383 09:46:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:08.383 09:46:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:08.383 09:46:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:08.383 09:46:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:08.383 09:46:31 -- common/autotest_common.sh@10 -- # set +x 00:23:10.283 09:46:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:10.283 09:46:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:10.283 09:46:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:10.283 09:46:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:10.283 09:46:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:10.283 09:46:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:10.283 09:46:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:10.283 09:46:33 -- nvmf/common.sh@294 -- # net_devs=() 00:23:10.283 09:46:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:10.283 09:46:33 -- nvmf/common.sh@295 -- # e810=() 00:23:10.283 09:46:33 -- nvmf/common.sh@295 -- # local -ga e810 00:23:10.283 09:46:33 -- nvmf/common.sh@296 -- # x722=() 00:23:10.283 09:46:33 -- nvmf/common.sh@296 -- # local -ga x722 00:23:10.283 09:46:33 -- nvmf/common.sh@297 -- # mlx=() 00:23:10.283 09:46:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:10.283 09:46:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:10.283 09:46:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:10.283 09:46:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:10.283 09:46:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:10.283 09:46:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:10.283 09:46:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:10.283 09:46:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:10.283 09:46:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:10.283 09:46:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:10.283 09:46:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:10.283 09:46:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:10.283 09:46:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:10.283 09:46:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:10.283 09:46:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:10.283 09:46:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:10.283 09:46:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:10.283 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:10.283 09:46:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:10.283 09:46:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:10.283 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:10.283 09:46:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:10.283 09:46:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:10.283 09:46:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:10.283 09:46:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:10.283 09:46:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:10.283 09:46:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:10.283 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:10.283 09:46:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:10.283 09:46:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:10.283 09:46:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:10.283 09:46:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:10.283 09:46:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:10.283 09:46:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:10.283 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:10.283 09:46:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:10.283 09:46:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:10.283 09:46:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:10.283 09:46:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:10.283 09:46:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:10.283 09:46:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:10.283 09:46:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:10.283 09:46:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:10.283 09:46:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:10.283 09:46:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:10.284 09:46:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:10.284 09:46:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:10.284 09:46:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:10.284 09:46:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:10.284 09:46:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:10.284 09:46:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:10.284 09:46:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:10.284 09:46:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:10.544 09:46:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:10.544 09:46:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:10.544 09:46:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:10.544 09:46:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:10.544 09:46:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:10.544 09:46:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:10.544 09:46:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:10.544 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:10.544 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.287 ms 00:23:10.544 00:23:10.544 --- 10.0.0.2 ping statistics --- 00:23:10.544 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:10.544 rtt min/avg/max/mdev = 0.287/0.287/0.287/0.000 ms 00:23:10.544 09:46:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:10.544 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:10.544 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:23:10.544 00:23:10.544 --- 10.0.0.1 ping statistics --- 00:23:10.544 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:10.544 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:23:10.544 09:46:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:10.544 09:46:33 -- nvmf/common.sh@410 -- # return 0 00:23:10.544 09:46:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:10.544 09:46:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:10.544 09:46:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:10.544 09:46:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:10.544 09:46:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:10.544 09:46:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:10.544 09:46:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:10.544 09:46:33 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:10.544 09:46:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:10.544 09:46:33 -- common/autotest_common.sh@10 -- # set +x 00:23:10.544 09:46:33 -- host/identify.sh@19 -- # nvmfpid=103023 00:23:10.544 09:46:33 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:10.544 09:46:33 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:10.544 09:46:33 -- host/identify.sh@23 -- # waitforlisten 103023 00:23:10.544 09:46:33 -- common/autotest_common.sh@829 -- # '[' -z 103023 ']' 00:23:10.544 09:46:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:10.544 09:46:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:10.544 09:46:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:10.544 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:10.544 09:46:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:10.544 09:46:33 -- common/autotest_common.sh@10 -- # set +x 00:23:10.544 [2024-11-29 09:46:33.269192] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:10.544 [2024-11-29 09:46:33.269275] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:10.544 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.544 [2024-11-29 09:46:33.336549] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:10.802 [2024-11-29 09:46:33.448570] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:10.802 [2024-11-29 09:46:33.448720] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:10.802 [2024-11-29 09:46:33.448736] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:10.802 [2024-11-29 09:46:33.448748] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:10.802 [2024-11-29 09:46:33.448807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:10.802 [2024-11-29 09:46:33.448865] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:10.802 [2024-11-29 09:46:33.448930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:10.802 [2024-11-29 09:46:33.448933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:11.737 09:46:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:11.737 09:46:34 -- common/autotest_common.sh@862 -- # return 0 00:23:11.737 09:46:34 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:11.737 09:46:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.737 09:46:34 -- common/autotest_common.sh@10 -- # set +x 00:23:11.737 [2024-11-29 09:46:34.245931] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:11.737 09:46:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.737 09:46:34 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:11.737 09:46:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:11.737 09:46:34 -- common/autotest_common.sh@10 -- # set +x 00:23:11.737 09:46:34 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:11.737 09:46:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.737 09:46:34 -- common/autotest_common.sh@10 -- # set +x 00:23:11.737 Malloc0 00:23:11.737 09:46:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.737 09:46:34 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:11.737 09:46:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.737 09:46:34 -- common/autotest_common.sh@10 -- # set +x 00:23:11.737 09:46:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.737 09:46:34 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:11.737 09:46:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.737 09:46:34 -- common/autotest_common.sh@10 -- # set +x 00:23:11.737 09:46:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.737 09:46:34 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:11.737 09:46:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.737 09:46:34 -- common/autotest_common.sh@10 -- # set +x 00:23:11.737 [2024-11-29 09:46:34.316987] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:11.737 09:46:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.737 09:46:34 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:11.737 09:46:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.737 09:46:34 -- common/autotest_common.sh@10 -- # set +x 00:23:11.737 09:46:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.737 09:46:34 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:11.737 09:46:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.737 09:46:34 -- common/autotest_common.sh@10 -- # set +x 00:23:11.737 [2024-11-29 09:46:34.332772] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:11.737 [ 00:23:11.737 { 00:23:11.737 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:11.737 "subtype": "Discovery", 00:23:11.737 "listen_addresses": [ 00:23:11.737 { 00:23:11.737 "transport": "TCP", 00:23:11.737 "trtype": "TCP", 00:23:11.737 "adrfam": "IPv4", 00:23:11.737 "traddr": "10.0.0.2", 00:23:11.737 "trsvcid": "4420" 00:23:11.737 } 00:23:11.737 ], 00:23:11.738 "allow_any_host": true, 00:23:11.738 "hosts": [] 00:23:11.738 }, 00:23:11.738 { 00:23:11.738 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:11.738 "subtype": "NVMe", 00:23:11.738 "listen_addresses": [ 00:23:11.738 { 00:23:11.738 "transport": "TCP", 00:23:11.738 "trtype": "TCP", 00:23:11.738 "adrfam": "IPv4", 00:23:11.738 "traddr": "10.0.0.2", 00:23:11.738 "trsvcid": "4420" 00:23:11.738 } 00:23:11.738 ], 00:23:11.738 "allow_any_host": true, 00:23:11.738 "hosts": [], 00:23:11.738 "serial_number": "SPDK00000000000001", 00:23:11.738 "model_number": "SPDK bdev Controller", 00:23:11.738 "max_namespaces": 32, 00:23:11.738 "min_cntlid": 1, 00:23:11.738 "max_cntlid": 65519, 00:23:11.738 "namespaces": [ 00:23:11.738 { 00:23:11.738 "nsid": 1, 00:23:11.738 "bdev_name": "Malloc0", 00:23:11.738 "name": "Malloc0", 00:23:11.738 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:11.738 "eui64": "ABCDEF0123456789", 00:23:11.738 "uuid": "6e3bcb51-968f-4383-9f76-06f590b958d7" 00:23:11.738 } 00:23:11.738 ] 00:23:11.738 } 00:23:11.738 ] 00:23:11.738 09:46:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.738 09:46:34 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:11.738 [2024-11-29 09:46:34.355388] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:11.738 [2024-11-29 09:46:34.355468] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid103179 ] 00:23:11.738 EAL: No free 2048 kB hugepages reported on node 1 00:23:11.738 [2024-11-29 09:46:34.388646] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:11.738 [2024-11-29 09:46:34.388736] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:11.738 [2024-11-29 09:46:34.388747] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:11.738 [2024-11-29 09:46:34.388765] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:11.738 [2024-11-29 09:46:34.388779] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:11.738 [2024-11-29 09:46:34.392469] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:11.738 [2024-11-29 09:46:34.392550] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x11e6e10 0 00:23:11.738 [2024-11-29 09:46:34.400408] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:11.738 [2024-11-29 09:46:34.400430] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:11.738 [2024-11-29 09:46:34.400439] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:11.738 [2024-11-29 09:46:34.400445] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:11.738 [2024-11-29 09:46:34.400501] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.400519] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.400528] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11e6e10) 00:23:11.738 [2024-11-29 09:46:34.400549] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:11.738 [2024-11-29 09:46:34.400577] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266b30, cid 0, qid 0 00:23:11.738 [2024-11-29 09:46:34.407462] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.738 [2024-11-29 09:46:34.407480] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.738 [2024-11-29 09:46:34.407487] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.407495] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1266b30) on tqpair=0x11e6e10 00:23:11.738 [2024-11-29 09:46:34.407512] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:11.738 [2024-11-29 09:46:34.407522] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:11.738 [2024-11-29 09:46:34.407531] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:11.738 [2024-11-29 09:46:34.407550] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.407559] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.407565] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11e6e10) 00:23:11.738 [2024-11-29 09:46:34.407576] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.738 [2024-11-29 09:46:34.407600] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266b30, cid 0, qid 0 00:23:11.738 [2024-11-29 09:46:34.407734] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.738 [2024-11-29 09:46:34.407749] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.738 [2024-11-29 09:46:34.407756] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.407763] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1266b30) on tqpair=0x11e6e10 00:23:11.738 [2024-11-29 09:46:34.407774] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:11.738 [2024-11-29 09:46:34.407786] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:11.738 [2024-11-29 09:46:34.407799] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.407807] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.407813] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11e6e10) 00:23:11.738 [2024-11-29 09:46:34.407824] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.738 [2024-11-29 09:46:34.407845] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266b30, cid 0, qid 0 00:23:11.738 [2024-11-29 09:46:34.407937] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.738 [2024-11-29 09:46:34.407951] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.738 [2024-11-29 09:46:34.407958] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.407964] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1266b30) on tqpair=0x11e6e10 00:23:11.738 [2024-11-29 09:46:34.407974] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:11.738 [2024-11-29 09:46:34.407989] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:11.738 [2024-11-29 09:46:34.408001] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.408013] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.408020] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11e6e10) 00:23:11.738 [2024-11-29 09:46:34.408031] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.738 [2024-11-29 09:46:34.408052] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266b30, cid 0, qid 0 00:23:11.738 [2024-11-29 09:46:34.408135] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.738 [2024-11-29 09:46:34.408149] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.738 [2024-11-29 09:46:34.408156] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.408162] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1266b30) on tqpair=0x11e6e10 00:23:11.738 [2024-11-29 09:46:34.408172] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:11.738 [2024-11-29 09:46:34.408190] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.408198] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.408205] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11e6e10) 00:23:11.738 [2024-11-29 09:46:34.408215] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.738 [2024-11-29 09:46:34.408236] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266b30, cid 0, qid 0 00:23:11.738 [2024-11-29 09:46:34.408322] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.738 [2024-11-29 09:46:34.408336] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.738 [2024-11-29 09:46:34.408343] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.408349] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1266b30) on tqpair=0x11e6e10 00:23:11.738 [2024-11-29 09:46:34.408359] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:11.738 [2024-11-29 09:46:34.408368] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:11.738 [2024-11-29 09:46:34.408380] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:11.738 [2024-11-29 09:46:34.408491] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:11.738 [2024-11-29 09:46:34.408502] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:11.738 [2024-11-29 09:46:34.408518] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.408526] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.408532] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11e6e10) 00:23:11.738 [2024-11-29 09:46:34.408542] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.738 [2024-11-29 09:46:34.408564] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266b30, cid 0, qid 0 00:23:11.738 [2024-11-29 09:46:34.408700] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.738 [2024-11-29 09:46:34.408713] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.738 [2024-11-29 09:46:34.408719] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.408725] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1266b30) on tqpair=0x11e6e10 00:23:11.738 [2024-11-29 09:46:34.408735] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:11.738 [2024-11-29 09:46:34.408756] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.738 [2024-11-29 09:46:34.408766] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.408772] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11e6e10) 00:23:11.739 [2024-11-29 09:46:34.408782] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.739 [2024-11-29 09:46:34.408804] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266b30, cid 0, qid 0 00:23:11.739 [2024-11-29 09:46:34.408893] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.739 [2024-11-29 09:46:34.408908] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.739 [2024-11-29 09:46:34.408914] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.408921] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1266b30) on tqpair=0x11e6e10 00:23:11.739 [2024-11-29 09:46:34.408929] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:11.739 [2024-11-29 09:46:34.408938] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:11.739 [2024-11-29 09:46:34.408950] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:11.739 [2024-11-29 09:46:34.408965] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:11.739 [2024-11-29 09:46:34.408982] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.408989] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.408996] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11e6e10) 00:23:11.739 [2024-11-29 09:46:34.409007] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.739 [2024-11-29 09:46:34.409028] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266b30, cid 0, qid 0 00:23:11.739 [2024-11-29 09:46:34.409154] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:11.739 [2024-11-29 09:46:34.409169] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:11.739 [2024-11-29 09:46:34.409176] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.409182] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11e6e10): datao=0, datal=4096, cccid=0 00:23:11.739 [2024-11-29 09:46:34.409191] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1266b30) on tqpair(0x11e6e10): expected_datao=0, payload_size=4096 00:23:11.739 [2024-11-29 09:46:34.409210] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.409221] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449486] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.739 [2024-11-29 09:46:34.449506] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.739 [2024-11-29 09:46:34.449514] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449521] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1266b30) on tqpair=0x11e6e10 00:23:11.739 [2024-11-29 09:46:34.449536] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:11.739 [2024-11-29 09:46:34.449545] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:11.739 [2024-11-29 09:46:34.449552] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:11.739 [2024-11-29 09:46:34.449562] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:11.739 [2024-11-29 09:46:34.449575] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:11.739 [2024-11-29 09:46:34.449584] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:11.739 [2024-11-29 09:46:34.449605] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:11.739 [2024-11-29 09:46:34.449619] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449627] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449634] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11e6e10) 00:23:11.739 [2024-11-29 09:46:34.449646] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:11.739 [2024-11-29 09:46:34.449669] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266b30, cid 0, qid 0 00:23:11.739 [2024-11-29 09:46:34.449757] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.739 [2024-11-29 09:46:34.449772] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.739 [2024-11-29 09:46:34.449778] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449785] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1266b30) on tqpair=0x11e6e10 00:23:11.739 [2024-11-29 09:46:34.449800] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449807] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449813] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x11e6e10) 00:23:11.739 [2024-11-29 09:46:34.449823] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:11.739 [2024-11-29 09:46:34.449834] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449841] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449847] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x11e6e10) 00:23:11.739 [2024-11-29 09:46:34.449856] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:11.739 [2024-11-29 09:46:34.449865] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449872] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449878] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x11e6e10) 00:23:11.739 [2024-11-29 09:46:34.449887] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:11.739 [2024-11-29 09:46:34.449897] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449903] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449909] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11e6e10) 00:23:11.739 [2024-11-29 09:46:34.449918] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:11.739 [2024-11-29 09:46:34.449927] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:11.739 [2024-11-29 09:46:34.449947] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:11.739 [2024-11-29 09:46:34.449960] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449967] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.449974] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11e6e10) 00:23:11.739 [2024-11-29 09:46:34.449988] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.739 [2024-11-29 09:46:34.450026] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266b30, cid 0, qid 0 00:23:11.739 [2024-11-29 09:46:34.450038] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266c90, cid 1, qid 0 00:23:11.739 [2024-11-29 09:46:34.450046] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266df0, cid 2, qid 0 00:23:11.739 [2024-11-29 09:46:34.450053] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266f50, cid 3, qid 0 00:23:11.739 [2024-11-29 09:46:34.450060] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12670b0, cid 4, qid 0 00:23:11.739 [2024-11-29 09:46:34.450197] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.739 [2024-11-29 09:46:34.450212] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.739 [2024-11-29 09:46:34.450219] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.450226] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12670b0) on tqpair=0x11e6e10 00:23:11.739 [2024-11-29 09:46:34.450237] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:11.739 [2024-11-29 09:46:34.450246] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:11.739 [2024-11-29 09:46:34.450264] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.450273] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.450280] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11e6e10) 00:23:11.739 [2024-11-29 09:46:34.450291] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.739 [2024-11-29 09:46:34.450312] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12670b0, cid 4, qid 0 00:23:11.739 [2024-11-29 09:46:34.454420] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:11.739 [2024-11-29 09:46:34.454437] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:11.739 [2024-11-29 09:46:34.454444] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.454450] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11e6e10): datao=0, datal=4096, cccid=4 00:23:11.739 [2024-11-29 09:46:34.454457] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12670b0) on tqpair(0x11e6e10): expected_datao=0, payload_size=4096 00:23:11.739 [2024-11-29 09:46:34.454468] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.454475] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.454484] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.739 [2024-11-29 09:46:34.454492] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.739 [2024-11-29 09:46:34.454498] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.454505] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12670b0) on tqpair=0x11e6e10 00:23:11.739 [2024-11-29 09:46:34.454525] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:11.739 [2024-11-29 09:46:34.454563] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.454574] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.454580] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11e6e10) 00:23:11.739 [2024-11-29 09:46:34.454591] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.739 [2024-11-29 09:46:34.454602] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.454613] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.739 [2024-11-29 09:46:34.454619] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x11e6e10) 00:23:11.740 [2024-11-29 09:46:34.454628] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:11.740 [2024-11-29 09:46:34.454655] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12670b0, cid 4, qid 0 00:23:11.740 [2024-11-29 09:46:34.454682] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1267210, cid 5, qid 0 00:23:11.740 [2024-11-29 09:46:34.454903] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:11.740 [2024-11-29 09:46:34.454915] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:11.740 [2024-11-29 09:46:34.454922] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.454928] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11e6e10): datao=0, datal=1024, cccid=4 00:23:11.740 [2024-11-29 09:46:34.454935] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12670b0) on tqpair(0x11e6e10): expected_datao=0, payload_size=1024 00:23:11.740 [2024-11-29 09:46:34.454946] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.454953] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.454962] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.740 [2024-11-29 09:46:34.454970] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.740 [2024-11-29 09:46:34.454977] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.454983] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1267210) on tqpair=0x11e6e10 00:23:11.740 [2024-11-29 09:46:34.495522] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.740 [2024-11-29 09:46:34.495541] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.740 [2024-11-29 09:46:34.495549] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.495557] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12670b0) on tqpair=0x11e6e10 00:23:11.740 [2024-11-29 09:46:34.495577] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.495586] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.495593] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11e6e10) 00:23:11.740 [2024-11-29 09:46:34.495605] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.740 [2024-11-29 09:46:34.495636] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12670b0, cid 4, qid 0 00:23:11.740 [2024-11-29 09:46:34.495769] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:11.740 [2024-11-29 09:46:34.495784] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:11.740 [2024-11-29 09:46:34.495792] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.495798] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11e6e10): datao=0, datal=3072, cccid=4 00:23:11.740 [2024-11-29 09:46:34.495806] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12670b0) on tqpair(0x11e6e10): expected_datao=0, payload_size=3072 00:23:11.740 [2024-11-29 09:46:34.495817] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.495825] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.495837] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.740 [2024-11-29 09:46:34.495847] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.740 [2024-11-29 09:46:34.495854] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.495860] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12670b0) on tqpair=0x11e6e10 00:23:11.740 [2024-11-29 09:46:34.495877] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.495890] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.495899] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x11e6e10) 00:23:11.740 [2024-11-29 09:46:34.495910] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.740 [2024-11-29 09:46:34.495939] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12670b0, cid 4, qid 0 00:23:11.740 [2024-11-29 09:46:34.496037] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:11.740 [2024-11-29 09:46:34.496050] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:11.740 [2024-11-29 09:46:34.496057] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.496063] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x11e6e10): datao=0, datal=8, cccid=4 00:23:11.740 [2024-11-29 09:46:34.496070] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12670b0) on tqpair(0x11e6e10): expected_datao=0, payload_size=8 00:23:11.740 [2024-11-29 09:46:34.496081] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.496089] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.536494] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.740 [2024-11-29 09:46:34.536513] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.740 [2024-11-29 09:46:34.536521] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.740 [2024-11-29 09:46:34.536527] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12670b0) on tqpair=0x11e6e10 00:23:11.740 ===================================================== 00:23:11.740 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:11.740 ===================================================== 00:23:11.740 Controller Capabilities/Features 00:23:11.740 ================================ 00:23:11.740 Vendor ID: 0000 00:23:11.740 Subsystem Vendor ID: 0000 00:23:11.740 Serial Number: .................... 00:23:11.740 Model Number: ........................................ 00:23:11.740 Firmware Version: 24.01.1 00:23:11.740 Recommended Arb Burst: 0 00:23:11.740 IEEE OUI Identifier: 00 00 00 00:23:11.740 Multi-path I/O 00:23:11.740 May have multiple subsystem ports: No 00:23:11.740 May have multiple controllers: No 00:23:11.740 Associated with SR-IOV VF: No 00:23:11.740 Max Data Transfer Size: 131072 00:23:11.740 Max Number of Namespaces: 0 00:23:11.740 Max Number of I/O Queues: 1024 00:23:11.740 NVMe Specification Version (VS): 1.3 00:23:11.740 NVMe Specification Version (Identify): 1.3 00:23:11.740 Maximum Queue Entries: 128 00:23:11.740 Contiguous Queues Required: Yes 00:23:11.740 Arbitration Mechanisms Supported 00:23:11.740 Weighted Round Robin: Not Supported 00:23:11.740 Vendor Specific: Not Supported 00:23:11.740 Reset Timeout: 15000 ms 00:23:11.740 Doorbell Stride: 4 bytes 00:23:11.740 NVM Subsystem Reset: Not Supported 00:23:11.740 Command Sets Supported 00:23:11.740 NVM Command Set: Supported 00:23:11.740 Boot Partition: Not Supported 00:23:11.740 Memory Page Size Minimum: 4096 bytes 00:23:11.740 Memory Page Size Maximum: 4096 bytes 00:23:11.740 Persistent Memory Region: Not Supported 00:23:11.740 Optional Asynchronous Events Supported 00:23:11.740 Namespace Attribute Notices: Not Supported 00:23:11.740 Firmware Activation Notices: Not Supported 00:23:11.740 ANA Change Notices: Not Supported 00:23:11.740 PLE Aggregate Log Change Notices: Not Supported 00:23:11.740 LBA Status Info Alert Notices: Not Supported 00:23:11.740 EGE Aggregate Log Change Notices: Not Supported 00:23:11.740 Normal NVM Subsystem Shutdown event: Not Supported 00:23:11.740 Zone Descriptor Change Notices: Not Supported 00:23:11.740 Discovery Log Change Notices: Supported 00:23:11.740 Controller Attributes 00:23:11.740 128-bit Host Identifier: Not Supported 00:23:11.740 Non-Operational Permissive Mode: Not Supported 00:23:11.740 NVM Sets: Not Supported 00:23:11.740 Read Recovery Levels: Not Supported 00:23:11.740 Endurance Groups: Not Supported 00:23:11.740 Predictable Latency Mode: Not Supported 00:23:11.740 Traffic Based Keep ALive: Not Supported 00:23:11.740 Namespace Granularity: Not Supported 00:23:11.740 SQ Associations: Not Supported 00:23:11.740 UUID List: Not Supported 00:23:11.740 Multi-Domain Subsystem: Not Supported 00:23:11.740 Fixed Capacity Management: Not Supported 00:23:11.740 Variable Capacity Management: Not Supported 00:23:11.740 Delete Endurance Group: Not Supported 00:23:11.740 Delete NVM Set: Not Supported 00:23:11.740 Extended LBA Formats Supported: Not Supported 00:23:11.740 Flexible Data Placement Supported: Not Supported 00:23:11.740 00:23:11.740 Controller Memory Buffer Support 00:23:11.740 ================================ 00:23:11.740 Supported: No 00:23:11.740 00:23:11.740 Persistent Memory Region Support 00:23:11.740 ================================ 00:23:11.740 Supported: No 00:23:11.740 00:23:11.740 Admin Command Set Attributes 00:23:11.740 ============================ 00:23:11.740 Security Send/Receive: Not Supported 00:23:11.740 Format NVM: Not Supported 00:23:11.740 Firmware Activate/Download: Not Supported 00:23:11.740 Namespace Management: Not Supported 00:23:11.740 Device Self-Test: Not Supported 00:23:11.740 Directives: Not Supported 00:23:11.740 NVMe-MI: Not Supported 00:23:11.740 Virtualization Management: Not Supported 00:23:11.740 Doorbell Buffer Config: Not Supported 00:23:11.740 Get LBA Status Capability: Not Supported 00:23:11.740 Command & Feature Lockdown Capability: Not Supported 00:23:11.740 Abort Command Limit: 1 00:23:11.740 Async Event Request Limit: 4 00:23:11.740 Number of Firmware Slots: N/A 00:23:11.740 Firmware Slot 1 Read-Only: N/A 00:23:11.740 Firmware Activation Without Reset: N/A 00:23:11.740 Multiple Update Detection Support: N/A 00:23:11.740 Firmware Update Granularity: No Information Provided 00:23:11.740 Per-Namespace SMART Log: No 00:23:11.740 Asymmetric Namespace Access Log Page: Not Supported 00:23:11.740 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:11.740 Command Effects Log Page: Not Supported 00:23:11.740 Get Log Page Extended Data: Supported 00:23:11.740 Telemetry Log Pages: Not Supported 00:23:11.740 Persistent Event Log Pages: Not Supported 00:23:11.741 Supported Log Pages Log Page: May Support 00:23:11.741 Commands Supported & Effects Log Page: Not Supported 00:23:11.741 Feature Identifiers & Effects Log Page:May Support 00:23:11.741 NVMe-MI Commands & Effects Log Page: May Support 00:23:11.741 Data Area 4 for Telemetry Log: Not Supported 00:23:11.741 Error Log Page Entries Supported: 128 00:23:11.741 Keep Alive: Not Supported 00:23:11.741 00:23:11.741 NVM Command Set Attributes 00:23:11.741 ========================== 00:23:11.741 Submission Queue Entry Size 00:23:11.741 Max: 1 00:23:11.741 Min: 1 00:23:11.741 Completion Queue Entry Size 00:23:11.741 Max: 1 00:23:11.741 Min: 1 00:23:11.741 Number of Namespaces: 0 00:23:11.741 Compare Command: Not Supported 00:23:11.741 Write Uncorrectable Command: Not Supported 00:23:11.741 Dataset Management Command: Not Supported 00:23:11.741 Write Zeroes Command: Not Supported 00:23:11.741 Set Features Save Field: Not Supported 00:23:11.741 Reservations: Not Supported 00:23:11.741 Timestamp: Not Supported 00:23:11.741 Copy: Not Supported 00:23:11.741 Volatile Write Cache: Not Present 00:23:11.741 Atomic Write Unit (Normal): 1 00:23:11.741 Atomic Write Unit (PFail): 1 00:23:11.741 Atomic Compare & Write Unit: 1 00:23:11.741 Fused Compare & Write: Supported 00:23:11.741 Scatter-Gather List 00:23:11.741 SGL Command Set: Supported 00:23:11.741 SGL Keyed: Supported 00:23:11.741 SGL Bit Bucket Descriptor: Not Supported 00:23:11.741 SGL Metadata Pointer: Not Supported 00:23:11.741 Oversized SGL: Not Supported 00:23:11.741 SGL Metadata Address: Not Supported 00:23:11.741 SGL Offset: Supported 00:23:11.741 Transport SGL Data Block: Not Supported 00:23:11.741 Replay Protected Memory Block: Not Supported 00:23:11.741 00:23:11.741 Firmware Slot Information 00:23:11.741 ========================= 00:23:11.741 Active slot: 0 00:23:11.741 00:23:11.741 00:23:11.741 Error Log 00:23:11.741 ========= 00:23:11.741 00:23:11.741 Active Namespaces 00:23:11.741 ================= 00:23:11.741 Discovery Log Page 00:23:11.741 ================== 00:23:11.741 Generation Counter: 2 00:23:11.741 Number of Records: 2 00:23:11.741 Record Format: 0 00:23:11.741 00:23:11.741 Discovery Log Entry 0 00:23:11.741 ---------------------- 00:23:11.741 Transport Type: 3 (TCP) 00:23:11.741 Address Family: 1 (IPv4) 00:23:11.741 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:11.741 Entry Flags: 00:23:11.741 Duplicate Returned Information: 1 00:23:11.741 Explicit Persistent Connection Support for Discovery: 1 00:23:11.741 Transport Requirements: 00:23:11.741 Secure Channel: Not Required 00:23:11.741 Port ID: 0 (0x0000) 00:23:11.741 Controller ID: 65535 (0xffff) 00:23:11.741 Admin Max SQ Size: 128 00:23:11.741 Transport Service Identifier: 4420 00:23:11.741 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:11.741 Transport Address: 10.0.0.2 00:23:11.741 Discovery Log Entry 1 00:23:11.741 ---------------------- 00:23:11.741 Transport Type: 3 (TCP) 00:23:11.741 Address Family: 1 (IPv4) 00:23:11.741 Subsystem Type: 2 (NVM Subsystem) 00:23:11.741 Entry Flags: 00:23:11.741 Duplicate Returned Information: 0 00:23:11.741 Explicit Persistent Connection Support for Discovery: 0 00:23:11.741 Transport Requirements: 00:23:11.741 Secure Channel: Not Required 00:23:11.741 Port ID: 0 (0x0000) 00:23:11.741 Controller ID: 65535 (0xffff) 00:23:11.741 Admin Max SQ Size: 128 00:23:11.741 Transport Service Identifier: 4420 00:23:11.741 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:11.741 Transport Address: 10.0.0.2 [2024-11-29 09:46:34.536642] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:11.741 [2024-11-29 09:46:34.536670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:11.741 [2024-11-29 09:46:34.536683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:11.741 [2024-11-29 09:46:34.536692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:11.741 [2024-11-29 09:46:34.536702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:11.741 [2024-11-29 09:46:34.536715] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.536723] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.536729] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11e6e10) 00:23:11.741 [2024-11-29 09:46:34.536741] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.741 [2024-11-29 09:46:34.536781] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266f50, cid 3, qid 0 00:23:11.741 [2024-11-29 09:46:34.536886] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.741 [2024-11-29 09:46:34.536902] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.741 [2024-11-29 09:46:34.536909] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.536915] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1266f50) on tqpair=0x11e6e10 00:23:11.741 [2024-11-29 09:46:34.536929] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.536936] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.536942] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11e6e10) 00:23:11.741 [2024-11-29 09:46:34.536953] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.741 [2024-11-29 09:46:34.536980] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266f50, cid 3, qid 0 00:23:11.741 [2024-11-29 09:46:34.537105] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.741 [2024-11-29 09:46:34.537120] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.741 [2024-11-29 09:46:34.537127] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.537133] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1266f50) on tqpair=0x11e6e10 00:23:11.741 [2024-11-29 09:46:34.537143] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:11.741 [2024-11-29 09:46:34.537151] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:11.741 [2024-11-29 09:46:34.537167] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.537176] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.537183] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11e6e10) 00:23:11.741 [2024-11-29 09:46:34.537193] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.741 [2024-11-29 09:46:34.537214] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266f50, cid 3, qid 0 00:23:11.741 [2024-11-29 09:46:34.537310] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.741 [2024-11-29 09:46:34.537322] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.741 [2024-11-29 09:46:34.537329] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.537335] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1266f50) on tqpair=0x11e6e10 00:23:11.741 [2024-11-29 09:46:34.537353] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.537362] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.537368] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11e6e10) 00:23:11.741 [2024-11-29 09:46:34.537379] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.741 [2024-11-29 09:46:34.541401] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266f50, cid 3, qid 0 00:23:11.741 [2024-11-29 09:46:34.541422] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.741 [2024-11-29 09:46:34.541432] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.741 [2024-11-29 09:46:34.541439] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.541445] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1266f50) on tqpair=0x11e6e10 00:23:11.741 [2024-11-29 09:46:34.541463] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.541472] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.541478] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x11e6e10) 00:23:11.741 [2024-11-29 09:46:34.541488] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.741 [2024-11-29 09:46:34.541509] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1266f50, cid 3, qid 0 00:23:11.741 [2024-11-29 09:46:34.541614] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.741 [2024-11-29 09:46:34.541626] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.741 [2024-11-29 09:46:34.541633] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.741 [2024-11-29 09:46:34.541639] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1266f50) on tqpair=0x11e6e10 00:23:11.741 [2024-11-29 09:46:34.541653] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 4 milliseconds 00:23:11.741 00:23:11.742 09:46:34 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:11.742 [2024-11-29 09:46:34.575616] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:11.742 [2024-11-29 09:46:34.575658] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid103193 ] 00:23:12.003 EAL: No free 2048 kB hugepages reported on node 1 00:23:12.003 [2024-11-29 09:46:34.606272] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:12.003 [2024-11-29 09:46:34.606319] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:12.003 [2024-11-29 09:46:34.606329] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:12.003 [2024-11-29 09:46:34.606344] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:12.003 [2024-11-29 09:46:34.606355] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:12.003 [2024-11-29 09:46:34.610453] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:12.003 [2024-11-29 09:46:34.610495] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1404e10 0 00:23:12.003 [2024-11-29 09:46:34.618410] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:12.003 [2024-11-29 09:46:34.618429] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:12.003 [2024-11-29 09:46:34.618436] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:12.003 [2024-11-29 09:46:34.618442] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:12.003 [2024-11-29 09:46:34.618494] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.003 [2024-11-29 09:46:34.618507] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.003 [2024-11-29 09:46:34.618513] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404e10) 00:23:12.003 [2024-11-29 09:46:34.618527] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:12.003 [2024-11-29 09:46:34.618553] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484b30, cid 0, qid 0 00:23:12.003 [2024-11-29 09:46:34.626430] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.003 [2024-11-29 09:46:34.626448] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.003 [2024-11-29 09:46:34.626455] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.003 [2024-11-29 09:46:34.626462] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484b30) on tqpair=0x1404e10 00:23:12.003 [2024-11-29 09:46:34.626481] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:12.003 [2024-11-29 09:46:34.626492] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:12.003 [2024-11-29 09:46:34.626501] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:12.003 [2024-11-29 09:46:34.626517] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.003 [2024-11-29 09:46:34.626526] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.003 [2024-11-29 09:46:34.626532] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404e10) 00:23:12.003 [2024-11-29 09:46:34.626544] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.003 [2024-11-29 09:46:34.626567] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484b30, cid 0, qid 0 00:23:12.003 [2024-11-29 09:46:34.626705] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.003 [2024-11-29 09:46:34.626724] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.003 [2024-11-29 09:46:34.626732] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.003 [2024-11-29 09:46:34.626739] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484b30) on tqpair=0x1404e10 00:23:12.003 [2024-11-29 09:46:34.626748] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:12.003 [2024-11-29 09:46:34.626762] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:12.003 [2024-11-29 09:46:34.626775] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.003 [2024-11-29 09:46:34.626782] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.003 [2024-11-29 09:46:34.626788] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404e10) 00:23:12.003 [2024-11-29 09:46:34.626799] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.003 [2024-11-29 09:46:34.626820] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484b30, cid 0, qid 0 00:23:12.003 [2024-11-29 09:46:34.626906] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.003 [2024-11-29 09:46:34.626921] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.003 [2024-11-29 09:46:34.626927] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.003 [2024-11-29 09:46:34.626934] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484b30) on tqpair=0x1404e10 00:23:12.003 [2024-11-29 09:46:34.626943] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:12.004 [2024-11-29 09:46:34.626957] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:12.004 [2024-11-29 09:46:34.626969] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.626976] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.626982] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404e10) 00:23:12.004 [2024-11-29 09:46:34.626993] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.004 [2024-11-29 09:46:34.627014] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484b30, cid 0, qid 0 00:23:12.004 [2024-11-29 09:46:34.627099] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.004 [2024-11-29 09:46:34.627113] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.004 [2024-11-29 09:46:34.627120] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.627126] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484b30) on tqpair=0x1404e10 00:23:12.004 [2024-11-29 09:46:34.627136] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:12.004 [2024-11-29 09:46:34.627152] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.627161] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.627168] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404e10) 00:23:12.004 [2024-11-29 09:46:34.627178] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.004 [2024-11-29 09:46:34.627199] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484b30, cid 0, qid 0 00:23:12.004 [2024-11-29 09:46:34.627283] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.004 [2024-11-29 09:46:34.627298] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.004 [2024-11-29 09:46:34.627304] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.627311] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484b30) on tqpair=0x1404e10 00:23:12.004 [2024-11-29 09:46:34.627324] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:12.004 [2024-11-29 09:46:34.627333] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:12.004 [2024-11-29 09:46:34.627346] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:12.004 [2024-11-29 09:46:34.627456] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:12.004 [2024-11-29 09:46:34.627465] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:12.004 [2024-11-29 09:46:34.627477] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.627485] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.627491] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404e10) 00:23:12.004 [2024-11-29 09:46:34.627502] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.004 [2024-11-29 09:46:34.627523] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484b30, cid 0, qid 0 00:23:12.004 [2024-11-29 09:46:34.627646] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.004 [2024-11-29 09:46:34.627660] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.004 [2024-11-29 09:46:34.627667] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.627673] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484b30) on tqpair=0x1404e10 00:23:12.004 [2024-11-29 09:46:34.627683] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:12.004 [2024-11-29 09:46:34.627699] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.627708] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.627714] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404e10) 00:23:12.004 [2024-11-29 09:46:34.627725] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.004 [2024-11-29 09:46:34.627746] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484b30, cid 0, qid 0 00:23:12.004 [2024-11-29 09:46:34.627834] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.004 [2024-11-29 09:46:34.627846] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.004 [2024-11-29 09:46:34.627853] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.627859] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484b30) on tqpair=0x1404e10 00:23:12.004 [2024-11-29 09:46:34.627868] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:12.004 [2024-11-29 09:46:34.627876] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:12.004 [2024-11-29 09:46:34.627888] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:12.004 [2024-11-29 09:46:34.627903] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:12.004 [2024-11-29 09:46:34.627917] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.627924] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.627931] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404e10) 00:23:12.004 [2024-11-29 09:46:34.627941] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.004 [2024-11-29 09:46:34.627966] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484b30, cid 0, qid 0 00:23:12.004 [2024-11-29 09:46:34.628102] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.004 [2024-11-29 09:46:34.628117] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.004 [2024-11-29 09:46:34.628124] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.628130] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1404e10): datao=0, datal=4096, cccid=0 00:23:12.004 [2024-11-29 09:46:34.628137] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1484b30) on tqpair(0x1404e10): expected_datao=0, payload_size=4096 00:23:12.004 [2024-11-29 09:46:34.628157] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.628166] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.668503] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.004 [2024-11-29 09:46:34.668523] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.004 [2024-11-29 09:46:34.668531] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.668538] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484b30) on tqpair=0x1404e10 00:23:12.004 [2024-11-29 09:46:34.668551] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:12.004 [2024-11-29 09:46:34.668559] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:12.004 [2024-11-29 09:46:34.668567] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:12.004 [2024-11-29 09:46:34.668574] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:12.004 [2024-11-29 09:46:34.668581] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:12.004 [2024-11-29 09:46:34.668589] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:12.004 [2024-11-29 09:46:34.668609] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:12.004 [2024-11-29 09:46:34.668623] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.668631] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.668637] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404e10) 00:23:12.004 [2024-11-29 09:46:34.668649] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:12.004 [2024-11-29 09:46:34.668673] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484b30, cid 0, qid 0 00:23:12.004 [2024-11-29 09:46:34.668767] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.004 [2024-11-29 09:46:34.668782] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.004 [2024-11-29 09:46:34.668789] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.668796] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484b30) on tqpair=0x1404e10 00:23:12.004 [2024-11-29 09:46:34.668807] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.668815] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.668821] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1404e10) 00:23:12.004 [2024-11-29 09:46:34.668831] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:12.004 [2024-11-29 09:46:34.668841] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.668848] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.668858] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1404e10) 00:23:12.004 [2024-11-29 09:46:34.668868] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:12.004 [2024-11-29 09:46:34.668878] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.668885] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.668891] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1404e10) 00:23:12.004 [2024-11-29 09:46:34.668900] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:12.004 [2024-11-29 09:46:34.668910] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.668917] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.004 [2024-11-29 09:46:34.668923] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.004 [2024-11-29 09:46:34.668931] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:12.004 [2024-11-29 09:46:34.668940] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:12.004 [2024-11-29 09:46:34.668959] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:12.004 [2024-11-29 09:46:34.668972] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.668979] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.668985] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1404e10) 00:23:12.005 [2024-11-29 09:46:34.668995] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.005 [2024-11-29 09:46:34.669033] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484b30, cid 0, qid 0 00:23:12.005 [2024-11-29 09:46:34.669044] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484c90, cid 1, qid 0 00:23:12.005 [2024-11-29 09:46:34.669051] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484df0, cid 2, qid 0 00:23:12.005 [2024-11-29 09:46:34.669059] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.005 [2024-11-29 09:46:34.669066] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14850b0, cid 4, qid 0 00:23:12.005 [2024-11-29 09:46:34.669260] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.005 [2024-11-29 09:46:34.669273] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.005 [2024-11-29 09:46:34.669279] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.669286] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14850b0) on tqpair=0x1404e10 00:23:12.005 [2024-11-29 09:46:34.669295] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:12.005 [2024-11-29 09:46:34.669304] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.669317] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.669334] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.669346] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.669353] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.669359] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1404e10) 00:23:12.005 [2024-11-29 09:46:34.669370] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:12.005 [2024-11-29 09:46:34.673402] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14850b0, cid 4, qid 0 00:23:12.005 [2024-11-29 09:46:34.673438] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.005 [2024-11-29 09:46:34.673449] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.005 [2024-11-29 09:46:34.673456] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.673462] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14850b0) on tqpair=0x1404e10 00:23:12.005 [2024-11-29 09:46:34.673529] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.673550] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.673566] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.673574] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.673580] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1404e10) 00:23:12.005 [2024-11-29 09:46:34.673591] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.005 [2024-11-29 09:46:34.673613] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14850b0, cid 4, qid 0 00:23:12.005 [2024-11-29 09:46:34.673748] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.005 [2024-11-29 09:46:34.673760] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.005 [2024-11-29 09:46:34.673767] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.673773] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1404e10): datao=0, datal=4096, cccid=4 00:23:12.005 [2024-11-29 09:46:34.673782] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14850b0) on tqpair(0x1404e10): expected_datao=0, payload_size=4096 00:23:12.005 [2024-11-29 09:46:34.673799] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.673808] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.714498] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.005 [2024-11-29 09:46:34.714517] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.005 [2024-11-29 09:46:34.714524] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.714531] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14850b0) on tqpair=0x1404e10 00:23:12.005 [2024-11-29 09:46:34.714558] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:12.005 [2024-11-29 09:46:34.714581] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.714601] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.714615] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.714623] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.714629] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1404e10) 00:23:12.005 [2024-11-29 09:46:34.714640] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.005 [2024-11-29 09:46:34.714663] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14850b0, cid 4, qid 0 00:23:12.005 [2024-11-29 09:46:34.714779] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.005 [2024-11-29 09:46:34.714791] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.005 [2024-11-29 09:46:34.714798] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.714808] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1404e10): datao=0, datal=4096, cccid=4 00:23:12.005 [2024-11-29 09:46:34.714816] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14850b0) on tqpair(0x1404e10): expected_datao=0, payload_size=4096 00:23:12.005 [2024-11-29 09:46:34.714834] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.714843] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.755508] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.005 [2024-11-29 09:46:34.755526] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.005 [2024-11-29 09:46:34.755533] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.755540] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14850b0) on tqpair=0x1404e10 00:23:12.005 [2024-11-29 09:46:34.755568] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.755589] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.755604] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.755612] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.755618] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1404e10) 00:23:12.005 [2024-11-29 09:46:34.755629] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.005 [2024-11-29 09:46:34.755653] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14850b0, cid 4, qid 0 00:23:12.005 [2024-11-29 09:46:34.755757] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.005 [2024-11-29 09:46:34.755772] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.005 [2024-11-29 09:46:34.755779] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.755785] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1404e10): datao=0, datal=4096, cccid=4 00:23:12.005 [2024-11-29 09:46:34.755793] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14850b0) on tqpair(0x1404e10): expected_datao=0, payload_size=4096 00:23:12.005 [2024-11-29 09:46:34.755804] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.755811] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.755823] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.005 [2024-11-29 09:46:34.755832] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.005 [2024-11-29 09:46:34.755839] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.755845] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14850b0) on tqpair=0x1404e10 00:23:12.005 [2024-11-29 09:46:34.755861] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.755876] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.755893] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.755906] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.755915] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.755925] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:12.005 [2024-11-29 09:46:34.755936] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:12.005 [2024-11-29 09:46:34.755945] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:12.005 [2024-11-29 09:46:34.755964] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.755973] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.755979] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1404e10) 00:23:12.005 [2024-11-29 09:46:34.755990] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.005 [2024-11-29 09:46:34.756002] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.756009] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.005 [2024-11-29 09:46:34.756015] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1404e10) 00:23:12.005 [2024-11-29 09:46:34.756024] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:12.005 [2024-11-29 09:46:34.756050] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14850b0, cid 4, qid 0 00:23:12.005 [2024-11-29 09:46:34.756076] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1485210, cid 5, qid 0 00:23:12.005 [2024-11-29 09:46:34.756260] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.006 [2024-11-29 09:46:34.756275] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.006 [2024-11-29 09:46:34.756281] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756288] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14850b0) on tqpair=0x1404e10 00:23:12.006 [2024-11-29 09:46:34.756299] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.006 [2024-11-29 09:46:34.756308] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.006 [2024-11-29 09:46:34.756315] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756321] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1485210) on tqpair=0x1404e10 00:23:12.006 [2024-11-29 09:46:34.756338] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756347] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756353] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1404e10) 00:23:12.006 [2024-11-29 09:46:34.756364] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.006 [2024-11-29 09:46:34.756385] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1485210, cid 5, qid 0 00:23:12.006 [2024-11-29 09:46:34.756488] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.006 [2024-11-29 09:46:34.756503] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.006 [2024-11-29 09:46:34.756510] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756516] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1485210) on tqpair=0x1404e10 00:23:12.006 [2024-11-29 09:46:34.756533] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756543] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756549] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1404e10) 00:23:12.006 [2024-11-29 09:46:34.756559] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.006 [2024-11-29 09:46:34.756580] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1485210, cid 5, qid 0 00:23:12.006 [2024-11-29 09:46:34.756663] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.006 [2024-11-29 09:46:34.756679] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.006 [2024-11-29 09:46:34.756686] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756693] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1485210) on tqpair=0x1404e10 00:23:12.006 [2024-11-29 09:46:34.756710] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756719] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756725] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1404e10) 00:23:12.006 [2024-11-29 09:46:34.756735] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.006 [2024-11-29 09:46:34.756756] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1485210, cid 5, qid 0 00:23:12.006 [2024-11-29 09:46:34.756835] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.006 [2024-11-29 09:46:34.756848] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.006 [2024-11-29 09:46:34.756854] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756861] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1485210) on tqpair=0x1404e10 00:23:12.006 [2024-11-29 09:46:34.756881] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756891] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756898] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1404e10) 00:23:12.006 [2024-11-29 09:46:34.756908] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.006 [2024-11-29 09:46:34.756920] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756928] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756934] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1404e10) 00:23:12.006 [2024-11-29 09:46:34.756943] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.006 [2024-11-29 09:46:34.756955] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756962] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756968] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x1404e10) 00:23:12.006 [2024-11-29 09:46:34.756978] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.006 [2024-11-29 09:46:34.756990] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.756997] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.757004] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1404e10) 00:23:12.006 [2024-11-29 09:46:34.757013] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.006 [2024-11-29 09:46:34.757035] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1485210, cid 5, qid 0 00:23:12.006 [2024-11-29 09:46:34.757046] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14850b0, cid 4, qid 0 00:23:12.006 [2024-11-29 09:46:34.757054] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1485370, cid 6, qid 0 00:23:12.006 [2024-11-29 09:46:34.757061] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14854d0, cid 7, qid 0 00:23:12.006 [2024-11-29 09:46:34.757253] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.006 [2024-11-29 09:46:34.757268] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.006 [2024-11-29 09:46:34.757275] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.757285] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1404e10): datao=0, datal=8192, cccid=5 00:23:12.006 [2024-11-29 09:46:34.757293] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1485210) on tqpair(0x1404e10): expected_datao=0, payload_size=8192 00:23:12.006 [2024-11-29 09:46:34.757313] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.757322] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.757335] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.006 [2024-11-29 09:46:34.757345] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.006 [2024-11-29 09:46:34.757351] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.757357] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1404e10): datao=0, datal=512, cccid=4 00:23:12.006 [2024-11-29 09:46:34.757365] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14850b0) on tqpair(0x1404e10): expected_datao=0, payload_size=512 00:23:12.006 [2024-11-29 09:46:34.757375] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.757382] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.757390] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.006 [2024-11-29 09:46:34.761426] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.006 [2024-11-29 09:46:34.761435] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.761441] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1404e10): datao=0, datal=512, cccid=6 00:23:12.006 [2024-11-29 09:46:34.761449] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1485370) on tqpair(0x1404e10): expected_datao=0, payload_size=512 00:23:12.006 [2024-11-29 09:46:34.761459] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.761466] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.761475] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.006 [2024-11-29 09:46:34.761483] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.006 [2024-11-29 09:46:34.761489] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.761495] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1404e10): datao=0, datal=4096, cccid=7 00:23:12.006 [2024-11-29 09:46:34.761502] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14854d0) on tqpair(0x1404e10): expected_datao=0, payload_size=4096 00:23:12.006 [2024-11-29 09:46:34.761512] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.761519] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.761531] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.006 [2024-11-29 09:46:34.761540] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.006 [2024-11-29 09:46:34.761547] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.761553] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1485210) on tqpair=0x1404e10 00:23:12.006 [2024-11-29 09:46:34.761574] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.006 [2024-11-29 09:46:34.761585] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.006 [2024-11-29 09:46:34.761591] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.761597] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14850b0) on tqpair=0x1404e10 00:23:12.006 [2024-11-29 09:46:34.761612] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.006 [2024-11-29 09:46:34.761622] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.006 [2024-11-29 09:46:34.761628] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.761635] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1485370) on tqpair=0x1404e10 00:23:12.006 [2024-11-29 09:46:34.761649] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.006 [2024-11-29 09:46:34.761659] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.006 [2024-11-29 09:46:34.761665] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.006 [2024-11-29 09:46:34.761671] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14854d0) on tqpair=0x1404e10 00:23:12.006 ===================================================== 00:23:12.006 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:12.006 ===================================================== 00:23:12.006 Controller Capabilities/Features 00:23:12.006 ================================ 00:23:12.006 Vendor ID: 8086 00:23:12.006 Subsystem Vendor ID: 8086 00:23:12.006 Serial Number: SPDK00000000000001 00:23:12.006 Model Number: SPDK bdev Controller 00:23:12.006 Firmware Version: 24.01.1 00:23:12.006 Recommended Arb Burst: 6 00:23:12.006 IEEE OUI Identifier: e4 d2 5c 00:23:12.006 Multi-path I/O 00:23:12.006 May have multiple subsystem ports: Yes 00:23:12.006 May have multiple controllers: Yes 00:23:12.006 Associated with SR-IOV VF: No 00:23:12.007 Max Data Transfer Size: 131072 00:23:12.007 Max Number of Namespaces: 32 00:23:12.007 Max Number of I/O Queues: 127 00:23:12.007 NVMe Specification Version (VS): 1.3 00:23:12.007 NVMe Specification Version (Identify): 1.3 00:23:12.007 Maximum Queue Entries: 128 00:23:12.007 Contiguous Queues Required: Yes 00:23:12.007 Arbitration Mechanisms Supported 00:23:12.007 Weighted Round Robin: Not Supported 00:23:12.007 Vendor Specific: Not Supported 00:23:12.007 Reset Timeout: 15000 ms 00:23:12.007 Doorbell Stride: 4 bytes 00:23:12.007 NVM Subsystem Reset: Not Supported 00:23:12.007 Command Sets Supported 00:23:12.007 NVM Command Set: Supported 00:23:12.007 Boot Partition: Not Supported 00:23:12.007 Memory Page Size Minimum: 4096 bytes 00:23:12.007 Memory Page Size Maximum: 4096 bytes 00:23:12.007 Persistent Memory Region: Not Supported 00:23:12.007 Optional Asynchronous Events Supported 00:23:12.007 Namespace Attribute Notices: Supported 00:23:12.007 Firmware Activation Notices: Not Supported 00:23:12.007 ANA Change Notices: Not Supported 00:23:12.007 PLE Aggregate Log Change Notices: Not Supported 00:23:12.007 LBA Status Info Alert Notices: Not Supported 00:23:12.007 EGE Aggregate Log Change Notices: Not Supported 00:23:12.007 Normal NVM Subsystem Shutdown event: Not Supported 00:23:12.007 Zone Descriptor Change Notices: Not Supported 00:23:12.007 Discovery Log Change Notices: Not Supported 00:23:12.007 Controller Attributes 00:23:12.007 128-bit Host Identifier: Supported 00:23:12.007 Non-Operational Permissive Mode: Not Supported 00:23:12.007 NVM Sets: Not Supported 00:23:12.007 Read Recovery Levels: Not Supported 00:23:12.007 Endurance Groups: Not Supported 00:23:12.007 Predictable Latency Mode: Not Supported 00:23:12.007 Traffic Based Keep ALive: Not Supported 00:23:12.007 Namespace Granularity: Not Supported 00:23:12.007 SQ Associations: Not Supported 00:23:12.007 UUID List: Not Supported 00:23:12.007 Multi-Domain Subsystem: Not Supported 00:23:12.007 Fixed Capacity Management: Not Supported 00:23:12.007 Variable Capacity Management: Not Supported 00:23:12.007 Delete Endurance Group: Not Supported 00:23:12.007 Delete NVM Set: Not Supported 00:23:12.007 Extended LBA Formats Supported: Not Supported 00:23:12.007 Flexible Data Placement Supported: Not Supported 00:23:12.007 00:23:12.007 Controller Memory Buffer Support 00:23:12.007 ================================ 00:23:12.007 Supported: No 00:23:12.007 00:23:12.007 Persistent Memory Region Support 00:23:12.007 ================================ 00:23:12.007 Supported: No 00:23:12.007 00:23:12.007 Admin Command Set Attributes 00:23:12.007 ============================ 00:23:12.007 Security Send/Receive: Not Supported 00:23:12.007 Format NVM: Not Supported 00:23:12.007 Firmware Activate/Download: Not Supported 00:23:12.007 Namespace Management: Not Supported 00:23:12.007 Device Self-Test: Not Supported 00:23:12.007 Directives: Not Supported 00:23:12.007 NVMe-MI: Not Supported 00:23:12.007 Virtualization Management: Not Supported 00:23:12.007 Doorbell Buffer Config: Not Supported 00:23:12.007 Get LBA Status Capability: Not Supported 00:23:12.007 Command & Feature Lockdown Capability: Not Supported 00:23:12.007 Abort Command Limit: 4 00:23:12.007 Async Event Request Limit: 4 00:23:12.007 Number of Firmware Slots: N/A 00:23:12.007 Firmware Slot 1 Read-Only: N/A 00:23:12.007 Firmware Activation Without Reset: N/A 00:23:12.007 Multiple Update Detection Support: N/A 00:23:12.007 Firmware Update Granularity: No Information Provided 00:23:12.007 Per-Namespace SMART Log: No 00:23:12.007 Asymmetric Namespace Access Log Page: Not Supported 00:23:12.007 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:12.007 Command Effects Log Page: Supported 00:23:12.007 Get Log Page Extended Data: Supported 00:23:12.007 Telemetry Log Pages: Not Supported 00:23:12.007 Persistent Event Log Pages: Not Supported 00:23:12.007 Supported Log Pages Log Page: May Support 00:23:12.007 Commands Supported & Effects Log Page: Not Supported 00:23:12.007 Feature Identifiers & Effects Log Page:May Support 00:23:12.007 NVMe-MI Commands & Effects Log Page: May Support 00:23:12.007 Data Area 4 for Telemetry Log: Not Supported 00:23:12.007 Error Log Page Entries Supported: 128 00:23:12.007 Keep Alive: Supported 00:23:12.007 Keep Alive Granularity: 10000 ms 00:23:12.007 00:23:12.007 NVM Command Set Attributes 00:23:12.007 ========================== 00:23:12.007 Submission Queue Entry Size 00:23:12.007 Max: 64 00:23:12.007 Min: 64 00:23:12.007 Completion Queue Entry Size 00:23:12.007 Max: 16 00:23:12.007 Min: 16 00:23:12.007 Number of Namespaces: 32 00:23:12.007 Compare Command: Supported 00:23:12.007 Write Uncorrectable Command: Not Supported 00:23:12.007 Dataset Management Command: Supported 00:23:12.007 Write Zeroes Command: Supported 00:23:12.007 Set Features Save Field: Not Supported 00:23:12.007 Reservations: Supported 00:23:12.007 Timestamp: Not Supported 00:23:12.007 Copy: Supported 00:23:12.007 Volatile Write Cache: Present 00:23:12.007 Atomic Write Unit (Normal): 1 00:23:12.007 Atomic Write Unit (PFail): 1 00:23:12.007 Atomic Compare & Write Unit: 1 00:23:12.007 Fused Compare & Write: Supported 00:23:12.007 Scatter-Gather List 00:23:12.007 SGL Command Set: Supported 00:23:12.007 SGL Keyed: Supported 00:23:12.007 SGL Bit Bucket Descriptor: Not Supported 00:23:12.007 SGL Metadata Pointer: Not Supported 00:23:12.007 Oversized SGL: Not Supported 00:23:12.007 SGL Metadata Address: Not Supported 00:23:12.007 SGL Offset: Supported 00:23:12.007 Transport SGL Data Block: Not Supported 00:23:12.007 Replay Protected Memory Block: Not Supported 00:23:12.007 00:23:12.007 Firmware Slot Information 00:23:12.007 ========================= 00:23:12.007 Active slot: 1 00:23:12.007 Slot 1 Firmware Revision: 24.01.1 00:23:12.007 00:23:12.007 00:23:12.007 Commands Supported and Effects 00:23:12.007 ============================== 00:23:12.007 Admin Commands 00:23:12.007 -------------- 00:23:12.007 Get Log Page (02h): Supported 00:23:12.007 Identify (06h): Supported 00:23:12.007 Abort (08h): Supported 00:23:12.007 Set Features (09h): Supported 00:23:12.007 Get Features (0Ah): Supported 00:23:12.007 Asynchronous Event Request (0Ch): Supported 00:23:12.007 Keep Alive (18h): Supported 00:23:12.007 I/O Commands 00:23:12.007 ------------ 00:23:12.007 Flush (00h): Supported LBA-Change 00:23:12.007 Write (01h): Supported LBA-Change 00:23:12.007 Read (02h): Supported 00:23:12.007 Compare (05h): Supported 00:23:12.007 Write Zeroes (08h): Supported LBA-Change 00:23:12.007 Dataset Management (09h): Supported LBA-Change 00:23:12.007 Copy (19h): Supported LBA-Change 00:23:12.007 Unknown (79h): Supported LBA-Change 00:23:12.007 Unknown (7Ah): Supported 00:23:12.007 00:23:12.007 Error Log 00:23:12.007 ========= 00:23:12.007 00:23:12.007 Arbitration 00:23:12.007 =========== 00:23:12.007 Arbitration Burst: 1 00:23:12.007 00:23:12.007 Power Management 00:23:12.007 ================ 00:23:12.007 Number of Power States: 1 00:23:12.007 Current Power State: Power State #0 00:23:12.007 Power State #0: 00:23:12.007 Max Power: 0.00 W 00:23:12.007 Non-Operational State: Operational 00:23:12.007 Entry Latency: Not Reported 00:23:12.007 Exit Latency: Not Reported 00:23:12.007 Relative Read Throughput: 0 00:23:12.007 Relative Read Latency: 0 00:23:12.007 Relative Write Throughput: 0 00:23:12.007 Relative Write Latency: 0 00:23:12.007 Idle Power: Not Reported 00:23:12.007 Active Power: Not Reported 00:23:12.007 Non-Operational Permissive Mode: Not Supported 00:23:12.007 00:23:12.007 Health Information 00:23:12.007 ================== 00:23:12.007 Critical Warnings: 00:23:12.007 Available Spare Space: OK 00:23:12.007 Temperature: OK 00:23:12.007 Device Reliability: OK 00:23:12.007 Read Only: No 00:23:12.007 Volatile Memory Backup: OK 00:23:12.007 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:12.007 Temperature Threshold: [2024-11-29 09:46:34.761790] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.007 [2024-11-29 09:46:34.761802] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.007 [2024-11-29 09:46:34.761809] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1404e10) 00:23:12.007 [2024-11-29 09:46:34.761819] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.007 [2024-11-29 09:46:34.761842] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14854d0, cid 7, qid 0 00:23:12.007 [2024-11-29 09:46:34.761976] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.007 [2024-11-29 09:46:34.761991] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.007 [2024-11-29 09:46:34.761998] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.007 [2024-11-29 09:46:34.762005] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14854d0) on tqpair=0x1404e10 00:23:12.007 [2024-11-29 09:46:34.762045] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:12.008 [2024-11-29 09:46:34.762066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:12.008 [2024-11-29 09:46:34.762078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:12.008 [2024-11-29 09:46:34.762087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:12.008 [2024-11-29 09:46:34.762096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:12.008 [2024-11-29 09:46:34.762108] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.762116] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.762122] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.008 [2024-11-29 09:46:34.762133] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.008 [2024-11-29 09:46:34.762155] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.008 [2024-11-29 09:46:34.762277] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.008 [2024-11-29 09:46:34.762289] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.008 [2024-11-29 09:46:34.762295] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.762302] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.008 [2024-11-29 09:46:34.762314] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.762321] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.762327] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.008 [2024-11-29 09:46:34.762337] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.008 [2024-11-29 09:46:34.762363] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.008 [2024-11-29 09:46:34.762473] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.008 [2024-11-29 09:46:34.762488] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.008 [2024-11-29 09:46:34.762495] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.762502] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.008 [2024-11-29 09:46:34.762516] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:12.008 [2024-11-29 09:46:34.762524] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:12.008 [2024-11-29 09:46:34.762540] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.762549] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.762556] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.008 [2024-11-29 09:46:34.762566] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.008 [2024-11-29 09:46:34.762587] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.008 [2024-11-29 09:46:34.762677] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.008 [2024-11-29 09:46:34.762690] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.008 [2024-11-29 09:46:34.762696] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.762703] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.008 [2024-11-29 09:46:34.762720] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.762729] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.762735] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.008 [2024-11-29 09:46:34.762746] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.008 [2024-11-29 09:46:34.762765] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.008 [2024-11-29 09:46:34.762845] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.008 [2024-11-29 09:46:34.762857] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.008 [2024-11-29 09:46:34.762863] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.762870] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.008 [2024-11-29 09:46:34.762886] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.762895] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.762902] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.008 [2024-11-29 09:46:34.762912] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.008 [2024-11-29 09:46:34.762931] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.008 [2024-11-29 09:46:34.763021] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.008 [2024-11-29 09:46:34.763033] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.008 [2024-11-29 09:46:34.763039] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763046] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.008 [2024-11-29 09:46:34.763063] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763071] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763078] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.008 [2024-11-29 09:46:34.763088] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.008 [2024-11-29 09:46:34.763108] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.008 [2024-11-29 09:46:34.763193] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.008 [2024-11-29 09:46:34.763207] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.008 [2024-11-29 09:46:34.763217] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763224] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.008 [2024-11-29 09:46:34.763242] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763251] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763258] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.008 [2024-11-29 09:46:34.763268] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.008 [2024-11-29 09:46:34.763289] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.008 [2024-11-29 09:46:34.763373] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.008 [2024-11-29 09:46:34.763388] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.008 [2024-11-29 09:46:34.763404] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763412] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.008 [2024-11-29 09:46:34.763430] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763439] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763445] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.008 [2024-11-29 09:46:34.763456] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.008 [2024-11-29 09:46:34.763476] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.008 [2024-11-29 09:46:34.763566] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.008 [2024-11-29 09:46:34.763578] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.008 [2024-11-29 09:46:34.763584] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763591] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.008 [2024-11-29 09:46:34.763607] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763616] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763623] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.008 [2024-11-29 09:46:34.763633] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.008 [2024-11-29 09:46:34.763653] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.008 [2024-11-29 09:46:34.763731] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.008 [2024-11-29 09:46:34.763743] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.008 [2024-11-29 09:46:34.763750] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763756] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.008 [2024-11-29 09:46:34.763773] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763782] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.008 [2024-11-29 09:46:34.763788] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.008 [2024-11-29 09:46:34.763798] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.008 [2024-11-29 09:46:34.763818] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.009 [2024-11-29 09:46:34.763898] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.009 [2024-11-29 09:46:34.763910] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.009 [2024-11-29 09:46:34.763920] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.763928] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.009 [2024-11-29 09:46:34.763945] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.763954] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.763960] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.009 [2024-11-29 09:46:34.763971] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.009 [2024-11-29 09:46:34.763991] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.009 [2024-11-29 09:46:34.764078] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.009 [2024-11-29 09:46:34.764092] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.009 [2024-11-29 09:46:34.764099] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764105] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.009 [2024-11-29 09:46:34.764122] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764132] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764138] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.009 [2024-11-29 09:46:34.764148] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.009 [2024-11-29 09:46:34.764169] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.009 [2024-11-29 09:46:34.764249] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.009 [2024-11-29 09:46:34.764264] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.009 [2024-11-29 09:46:34.764270] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764276] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.009 [2024-11-29 09:46:34.764294] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764303] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764309] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.009 [2024-11-29 09:46:34.764320] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.009 [2024-11-29 09:46:34.764340] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.009 [2024-11-29 09:46:34.764427] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.009 [2024-11-29 09:46:34.764442] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.009 [2024-11-29 09:46:34.764449] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764455] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.009 [2024-11-29 09:46:34.764473] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764482] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764488] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.009 [2024-11-29 09:46:34.764499] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.009 [2024-11-29 09:46:34.764519] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.009 [2024-11-29 09:46:34.764604] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.009 [2024-11-29 09:46:34.764616] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.009 [2024-11-29 09:46:34.764623] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764633] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.009 [2024-11-29 09:46:34.764650] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764660] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764666] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.009 [2024-11-29 09:46:34.764676] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.009 [2024-11-29 09:46:34.764697] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.009 [2024-11-29 09:46:34.764797] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.009 [2024-11-29 09:46:34.764812] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.009 [2024-11-29 09:46:34.764818] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764825] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.009 [2024-11-29 09:46:34.764842] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764851] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764857] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.009 [2024-11-29 09:46:34.764868] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.009 [2024-11-29 09:46:34.764888] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.009 [2024-11-29 09:46:34.764972] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.009 [2024-11-29 09:46:34.764986] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.009 [2024-11-29 09:46:34.764993] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.764999] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.009 [2024-11-29 09:46:34.765017] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.765026] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.765032] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.009 [2024-11-29 09:46:34.765042] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.009 [2024-11-29 09:46:34.765063] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.009 [2024-11-29 09:46:34.765148] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.009 [2024-11-29 09:46:34.765160] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.009 [2024-11-29 09:46:34.765166] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.765173] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.009 [2024-11-29 09:46:34.765188] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.765197] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.765203] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.009 [2024-11-29 09:46:34.765214] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.009 [2024-11-29 09:46:34.765233] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.009 [2024-11-29 09:46:34.765312] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.009 [2024-11-29 09:46:34.765324] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.009 [2024-11-29 09:46:34.765331] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.765337] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.009 [2024-11-29 09:46:34.765358] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.765368] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.765375] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1404e10) 00:23:12.009 [2024-11-29 09:46:34.765385] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.009 [2024-11-29 09:46:34.769421] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1484f50, cid 3, qid 0 00:23:12.009 [2024-11-29 09:46:34.769538] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.009 [2024-11-29 09:46:34.769551] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.009 [2024-11-29 09:46:34.769557] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.009 [2024-11-29 09:46:34.769564] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1484f50) on tqpair=0x1404e10 00:23:12.009 [2024-11-29 09:46:34.769578] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 7 milliseconds 00:23:12.009 0 Kelvin (-273 Celsius) 00:23:12.009 Available Spare: 0% 00:23:12.009 Available Spare Threshold: 0% 00:23:12.009 Life Percentage Used: 0% 00:23:12.009 Data Units Read: 0 00:23:12.009 Data Units Written: 0 00:23:12.009 Host Read Commands: 0 00:23:12.009 Host Write Commands: 0 00:23:12.009 Controller Busy Time: 0 minutes 00:23:12.009 Power Cycles: 0 00:23:12.009 Power On Hours: 0 hours 00:23:12.009 Unsafe Shutdowns: 0 00:23:12.009 Unrecoverable Media Errors: 0 00:23:12.009 Lifetime Error Log Entries: 0 00:23:12.009 Warning Temperature Time: 0 minutes 00:23:12.009 Critical Temperature Time: 0 minutes 00:23:12.009 00:23:12.009 Number of Queues 00:23:12.009 ================ 00:23:12.009 Number of I/O Submission Queues: 127 00:23:12.009 Number of I/O Completion Queues: 127 00:23:12.009 00:23:12.009 Active Namespaces 00:23:12.009 ================= 00:23:12.009 Namespace ID:1 00:23:12.009 Error Recovery Timeout: Unlimited 00:23:12.009 Command Set Identifier: NVM (00h) 00:23:12.009 Deallocate: Supported 00:23:12.009 Deallocated/Unwritten Error: Not Supported 00:23:12.009 Deallocated Read Value: Unknown 00:23:12.009 Deallocate in Write Zeroes: Not Supported 00:23:12.009 Deallocated Guard Field: 0xFFFF 00:23:12.009 Flush: Supported 00:23:12.009 Reservation: Supported 00:23:12.009 Namespace Sharing Capabilities: Multiple Controllers 00:23:12.009 Size (in LBAs): 131072 (0GiB) 00:23:12.009 Capacity (in LBAs): 131072 (0GiB) 00:23:12.009 Utilization (in LBAs): 131072 (0GiB) 00:23:12.009 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:12.010 EUI64: ABCDEF0123456789 00:23:12.010 UUID: 6e3bcb51-968f-4383-9f76-06f590b958d7 00:23:12.010 Thin Provisioning: Not Supported 00:23:12.010 Per-NS Atomic Units: Yes 00:23:12.010 Atomic Boundary Size (Normal): 0 00:23:12.010 Atomic Boundary Size (PFail): 0 00:23:12.010 Atomic Boundary Offset: 0 00:23:12.010 Maximum Single Source Range Length: 65535 00:23:12.010 Maximum Copy Length: 65535 00:23:12.010 Maximum Source Range Count: 1 00:23:12.010 NGUID/EUI64 Never Reused: No 00:23:12.010 Namespace Write Protected: No 00:23:12.010 Number of LBA Formats: 1 00:23:12.010 Current LBA Format: LBA Format #00 00:23:12.010 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:12.010 00:23:12.010 09:46:34 -- host/identify.sh@51 -- # sync 00:23:12.010 09:46:34 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:12.010 09:46:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.010 09:46:34 -- common/autotest_common.sh@10 -- # set +x 00:23:12.010 09:46:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.010 09:46:34 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:12.010 09:46:34 -- host/identify.sh@56 -- # nvmftestfini 00:23:12.010 09:46:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:12.010 09:46:34 -- nvmf/common.sh@116 -- # sync 00:23:12.010 09:46:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:12.010 09:46:34 -- nvmf/common.sh@119 -- # set +e 00:23:12.010 09:46:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:12.010 09:46:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:12.010 rmmod nvme_tcp 00:23:12.010 rmmod nvme_fabrics 00:23:12.010 rmmod nvme_keyring 00:23:12.269 09:46:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:12.269 09:46:34 -- nvmf/common.sh@123 -- # set -e 00:23:12.269 09:46:34 -- nvmf/common.sh@124 -- # return 0 00:23:12.269 09:46:34 -- nvmf/common.sh@477 -- # '[' -n 103023 ']' 00:23:12.269 09:46:34 -- nvmf/common.sh@478 -- # killprocess 103023 00:23:12.269 09:46:34 -- common/autotest_common.sh@936 -- # '[' -z 103023 ']' 00:23:12.269 09:46:34 -- common/autotest_common.sh@940 -- # kill -0 103023 00:23:12.269 09:46:34 -- common/autotest_common.sh@941 -- # uname 00:23:12.269 09:46:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:12.269 09:46:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 103023 00:23:12.269 09:46:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:12.269 09:46:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:12.269 09:46:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 103023' 00:23:12.269 killing process with pid 103023 00:23:12.269 09:46:34 -- common/autotest_common.sh@955 -- # kill 103023 00:23:12.269 [2024-11-29 09:46:34.888202] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:12.269 09:46:34 -- common/autotest_common.sh@960 -- # wait 103023 00:23:12.527 09:46:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:12.527 09:46:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:12.527 09:46:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:12.527 09:46:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:12.527 09:46:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:12.527 09:46:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:12.527 09:46:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:12.527 09:46:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:14.428 09:46:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:14.428 00:23:14.428 real 0m6.343s 00:23:14.428 user 0m7.747s 00:23:14.428 sys 0m1.969s 00:23:14.428 09:46:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:14.428 09:46:37 -- common/autotest_common.sh@10 -- # set +x 00:23:14.428 ************************************ 00:23:14.428 END TEST nvmf_identify 00:23:14.428 ************************************ 00:23:14.428 09:46:37 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:14.428 09:46:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:14.428 09:46:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:14.428 09:46:37 -- common/autotest_common.sh@10 -- # set +x 00:23:14.428 ************************************ 00:23:14.428 START TEST nvmf_perf 00:23:14.428 ************************************ 00:23:14.428 09:46:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:14.686 * Looking for test storage... 00:23:14.687 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:14.687 09:46:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:14.687 09:46:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:14.687 09:46:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:14.687 09:46:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:14.687 09:46:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:14.687 09:46:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:14.687 09:46:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:14.687 09:46:37 -- scripts/common.sh@335 -- # IFS=.-: 00:23:14.687 09:46:37 -- scripts/common.sh@335 -- # read -ra ver1 00:23:14.687 09:46:37 -- scripts/common.sh@336 -- # IFS=.-: 00:23:14.687 09:46:37 -- scripts/common.sh@336 -- # read -ra ver2 00:23:14.687 09:46:37 -- scripts/common.sh@337 -- # local 'op=<' 00:23:14.687 09:46:37 -- scripts/common.sh@339 -- # ver1_l=2 00:23:14.687 09:46:37 -- scripts/common.sh@340 -- # ver2_l=1 00:23:14.687 09:46:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:14.687 09:46:37 -- scripts/common.sh@343 -- # case "$op" in 00:23:14.687 09:46:37 -- scripts/common.sh@344 -- # : 1 00:23:14.687 09:46:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:14.687 09:46:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:14.687 09:46:37 -- scripts/common.sh@364 -- # decimal 1 00:23:14.687 09:46:37 -- scripts/common.sh@352 -- # local d=1 00:23:14.687 09:46:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:14.687 09:46:37 -- scripts/common.sh@354 -- # echo 1 00:23:14.687 09:46:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:14.687 09:46:37 -- scripts/common.sh@365 -- # decimal 2 00:23:14.687 09:46:37 -- scripts/common.sh@352 -- # local d=2 00:23:14.687 09:46:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:14.687 09:46:37 -- scripts/common.sh@354 -- # echo 2 00:23:14.687 09:46:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:14.687 09:46:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:14.687 09:46:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:14.687 09:46:37 -- scripts/common.sh@367 -- # return 0 00:23:14.687 09:46:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:14.687 09:46:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:14.687 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.687 --rc genhtml_branch_coverage=1 00:23:14.687 --rc genhtml_function_coverage=1 00:23:14.687 --rc genhtml_legend=1 00:23:14.687 --rc geninfo_all_blocks=1 00:23:14.687 --rc geninfo_unexecuted_blocks=1 00:23:14.687 00:23:14.687 ' 00:23:14.687 09:46:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:14.687 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.687 --rc genhtml_branch_coverage=1 00:23:14.687 --rc genhtml_function_coverage=1 00:23:14.687 --rc genhtml_legend=1 00:23:14.687 --rc geninfo_all_blocks=1 00:23:14.687 --rc geninfo_unexecuted_blocks=1 00:23:14.687 00:23:14.687 ' 00:23:14.687 09:46:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:14.687 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.687 --rc genhtml_branch_coverage=1 00:23:14.687 --rc genhtml_function_coverage=1 00:23:14.687 --rc genhtml_legend=1 00:23:14.687 --rc geninfo_all_blocks=1 00:23:14.687 --rc geninfo_unexecuted_blocks=1 00:23:14.687 00:23:14.687 ' 00:23:14.687 09:46:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:14.687 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.687 --rc genhtml_branch_coverage=1 00:23:14.687 --rc genhtml_function_coverage=1 00:23:14.687 --rc genhtml_legend=1 00:23:14.687 --rc geninfo_all_blocks=1 00:23:14.687 --rc geninfo_unexecuted_blocks=1 00:23:14.687 00:23:14.687 ' 00:23:14.687 09:46:37 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:14.687 09:46:37 -- nvmf/common.sh@7 -- # uname -s 00:23:14.687 09:46:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:14.687 09:46:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:14.687 09:46:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:14.687 09:46:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:14.687 09:46:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:14.687 09:46:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:14.687 09:46:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:14.687 09:46:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:14.687 09:46:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:14.687 09:46:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:14.687 09:46:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:14.687 09:46:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:14.687 09:46:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:14.687 09:46:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:14.687 09:46:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:14.687 09:46:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:14.687 09:46:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:14.687 09:46:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:14.687 09:46:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:14.687 09:46:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.687 09:46:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.687 09:46:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.687 09:46:37 -- paths/export.sh@5 -- # export PATH 00:23:14.687 09:46:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.687 09:46:37 -- nvmf/common.sh@46 -- # : 0 00:23:14.687 09:46:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:14.687 09:46:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:14.687 09:46:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:14.687 09:46:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:14.687 09:46:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:14.687 09:46:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:14.687 09:46:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:14.687 09:46:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:14.687 09:46:37 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:14.687 09:46:37 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:14.687 09:46:37 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:14.687 09:46:37 -- host/perf.sh@17 -- # nvmftestinit 00:23:14.687 09:46:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:14.687 09:46:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:14.687 09:46:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:14.687 09:46:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:14.687 09:46:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:14.687 09:46:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:14.687 09:46:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:14.687 09:46:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:14.687 09:46:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:14.687 09:46:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:14.687 09:46:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:14.687 09:46:37 -- common/autotest_common.sh@10 -- # set +x 00:23:16.590 09:46:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:16.590 09:46:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:16.590 09:46:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:16.590 09:46:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:16.590 09:46:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:16.590 09:46:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:16.590 09:46:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:16.590 09:46:39 -- nvmf/common.sh@294 -- # net_devs=() 00:23:16.590 09:46:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:16.590 09:46:39 -- nvmf/common.sh@295 -- # e810=() 00:23:16.590 09:46:39 -- nvmf/common.sh@295 -- # local -ga e810 00:23:16.590 09:46:39 -- nvmf/common.sh@296 -- # x722=() 00:23:16.590 09:46:39 -- nvmf/common.sh@296 -- # local -ga x722 00:23:16.590 09:46:39 -- nvmf/common.sh@297 -- # mlx=() 00:23:16.590 09:46:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:16.590 09:46:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:16.590 09:46:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:16.590 09:46:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:16.590 09:46:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:16.590 09:46:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:16.590 09:46:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:16.590 09:46:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:16.590 09:46:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:16.590 09:46:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:16.590 09:46:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:16.590 09:46:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:16.590 09:46:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:16.590 09:46:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:16.590 09:46:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:16.590 09:46:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:16.590 09:46:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:16.590 09:46:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:16.591 09:46:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:16.591 09:46:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:16.591 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:16.591 09:46:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:16.591 09:46:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:16.591 09:46:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:16.591 09:46:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:16.591 09:46:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:16.591 09:46:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:16.591 09:46:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:16.591 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:16.591 09:46:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:16.591 09:46:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:16.591 09:46:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:16.591 09:46:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:16.591 09:46:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:16.591 09:46:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:16.591 09:46:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:16.591 09:46:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:16.591 09:46:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:16.591 09:46:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:16.591 09:46:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:16.591 09:46:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:16.591 09:46:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:16.591 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:16.591 09:46:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:16.591 09:46:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:16.591 09:46:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:16.591 09:46:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:16.591 09:46:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:16.591 09:46:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:16.591 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:16.591 09:46:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:16.591 09:46:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:16.591 09:46:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:16.591 09:46:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:16.591 09:46:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:16.591 09:46:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:16.591 09:46:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:16.591 09:46:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:16.591 09:46:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:16.591 09:46:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:16.591 09:46:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:16.591 09:46:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:16.591 09:46:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:16.591 09:46:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:16.591 09:46:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:16.591 09:46:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:16.591 09:46:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:16.591 09:46:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:16.591 09:46:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:16.591 09:46:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:16.591 09:46:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:16.591 09:46:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:16.591 09:46:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:16.850 09:46:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:16.850 09:46:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:16.850 09:46:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:16.850 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:16.850 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.248 ms 00:23:16.850 00:23:16.850 --- 10.0.0.2 ping statistics --- 00:23:16.850 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:16.850 rtt min/avg/max/mdev = 0.248/0.248/0.248/0.000 ms 00:23:16.850 09:46:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:16.850 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:16.850 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.056 ms 00:23:16.850 00:23:16.850 --- 10.0.0.1 ping statistics --- 00:23:16.850 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:16.850 rtt min/avg/max/mdev = 0.056/0.056/0.056/0.000 ms 00:23:16.850 09:46:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:16.850 09:46:39 -- nvmf/common.sh@410 -- # return 0 00:23:16.850 09:46:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:16.850 09:46:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:16.850 09:46:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:16.850 09:46:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:16.850 09:46:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:16.850 09:46:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:16.850 09:46:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:16.850 09:46:39 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:16.850 09:46:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:16.850 09:46:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:16.851 09:46:39 -- common/autotest_common.sh@10 -- # set +x 00:23:16.851 09:46:39 -- nvmf/common.sh@469 -- # nvmfpid=105241 00:23:16.851 09:46:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:16.851 09:46:39 -- nvmf/common.sh@470 -- # waitforlisten 105241 00:23:16.851 09:46:39 -- common/autotest_common.sh@829 -- # '[' -z 105241 ']' 00:23:16.851 09:46:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:16.851 09:46:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:16.851 09:46:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:16.851 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:16.851 09:46:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:16.851 09:46:39 -- common/autotest_common.sh@10 -- # set +x 00:23:16.851 [2024-11-29 09:46:39.527013] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:16.851 [2024-11-29 09:46:39.527078] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:16.851 EAL: No free 2048 kB hugepages reported on node 1 00:23:16.851 [2024-11-29 09:46:39.599224] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:17.110 [2024-11-29 09:46:39.721242] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:17.110 [2024-11-29 09:46:39.721399] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:17.110 [2024-11-29 09:46:39.721416] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:17.110 [2024-11-29 09:46:39.721429] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:17.110 [2024-11-29 09:46:39.721480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:17.110 [2024-11-29 09:46:39.721509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:17.110 [2024-11-29 09:46:39.721570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:17.110 [2024-11-29 09:46:39.721572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:18.046 09:46:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:18.046 09:46:40 -- common/autotest_common.sh@862 -- # return 0 00:23:18.046 09:46:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:18.046 09:46:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:18.046 09:46:40 -- common/autotest_common.sh@10 -- # set +x 00:23:18.046 09:46:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:18.046 09:46:40 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:18.046 09:46:40 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:21.334 09:46:43 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:21.334 09:46:43 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:21.334 09:46:43 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:21.334 09:46:43 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:21.592 09:46:44 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:21.592 09:46:44 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:21.592 09:46:44 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:21.592 09:46:44 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:21.592 09:46:44 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:21.850 [2024-11-29 09:46:44.465164] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:21.850 09:46:44 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:22.108 09:46:44 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:22.108 09:46:44 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:22.365 09:46:44 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:22.365 09:46:44 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:22.623 09:46:45 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:22.880 [2024-11-29 09:46:45.476948] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:22.880 09:46:45 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:23.138 09:46:45 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:23.138 09:46:45 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:23.138 09:46:45 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:23.138 09:46:45 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:24.513 Initializing NVMe Controllers 00:23:24.513 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:24.513 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:24.513 Initialization complete. Launching workers. 00:23:24.513 ======================================================== 00:23:24.513 Latency(us) 00:23:24.513 Device Information : IOPS MiB/s Average min max 00:23:24.513 PCIE (0000:88:00.0) NSID 1 from core 0: 86676.65 338.58 368.59 11.86 4311.53 00:23:24.513 ======================================================== 00:23:24.513 Total : 86676.65 338.58 368.59 11.86 4311.53 00:23:24.513 00:23:24.513 09:46:46 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:24.513 EAL: No free 2048 kB hugepages reported on node 1 00:23:25.894 Initializing NVMe Controllers 00:23:25.894 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:25.894 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:25.894 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:25.894 Initialization complete. Launching workers. 00:23:25.894 ======================================================== 00:23:25.894 Latency(us) 00:23:25.894 Device Information : IOPS MiB/s Average min max 00:23:25.894 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 75.00 0.29 13753.88 160.88 45906.30 00:23:25.894 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 61.00 0.24 16467.11 7914.86 47902.74 00:23:25.894 ======================================================== 00:23:25.894 Total : 136.00 0.53 14970.84 160.88 47902.74 00:23:25.894 00:23:25.894 09:46:48 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:25.894 EAL: No free 2048 kB hugepages reported on node 1 00:23:27.273 Initializing NVMe Controllers 00:23:27.273 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:27.273 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:27.273 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:27.273 Initialization complete. Launching workers. 00:23:27.273 ======================================================== 00:23:27.273 Latency(us) 00:23:27.273 Device Information : IOPS MiB/s Average min max 00:23:27.273 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8581.95 33.52 3746.63 568.34 7626.13 00:23:27.273 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3957.98 15.46 8122.64 6936.54 15785.26 00:23:27.273 ======================================================== 00:23:27.273 Total : 12539.92 48.98 5127.83 568.34 15785.26 00:23:27.273 00:23:27.273 09:46:49 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:27.273 09:46:49 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:27.273 09:46:49 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:27.273 EAL: No free 2048 kB hugepages reported on node 1 00:23:29.807 Initializing NVMe Controllers 00:23:29.807 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:29.807 Controller IO queue size 128, less than required. 00:23:29.807 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:29.807 Controller IO queue size 128, less than required. 00:23:29.807 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:29.807 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:29.807 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:29.807 Initialization complete. Launching workers. 00:23:29.807 ======================================================== 00:23:29.807 Latency(us) 00:23:29.807 Device Information : IOPS MiB/s Average min max 00:23:29.807 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1492.30 373.08 87540.72 67231.36 128120.61 00:23:29.807 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 578.68 144.67 228220.47 84497.96 363233.68 00:23:29.807 ======================================================== 00:23:29.807 Total : 2070.98 517.75 126849.79 67231.36 363233.68 00:23:29.807 00:23:29.807 09:46:52 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:29.807 EAL: No free 2048 kB hugepages reported on node 1 00:23:29.807 No valid NVMe controllers or AIO or URING devices found 00:23:29.807 Initializing NVMe Controllers 00:23:29.807 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:29.807 Controller IO queue size 128, less than required. 00:23:29.807 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:29.807 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:29.807 Controller IO queue size 128, less than required. 00:23:29.807 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:29.807 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:29.807 WARNING: Some requested NVMe devices were skipped 00:23:29.808 09:46:52 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:30.066 EAL: No free 2048 kB hugepages reported on node 1 00:23:32.598 Initializing NVMe Controllers 00:23:32.598 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:32.598 Controller IO queue size 128, less than required. 00:23:32.598 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:32.598 Controller IO queue size 128, less than required. 00:23:32.598 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:32.598 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:32.598 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:32.598 Initialization complete. Launching workers. 00:23:32.598 00:23:32.598 ==================== 00:23:32.598 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:32.598 TCP transport: 00:23:32.598 polls: 11591 00:23:32.598 idle_polls: 8213 00:23:32.598 sock_completions: 3378 00:23:32.598 nvme_completions: 5977 00:23:32.598 submitted_requests: 9141 00:23:32.598 queued_requests: 1 00:23:32.598 00:23:32.598 ==================== 00:23:32.598 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:32.598 TCP transport: 00:23:32.598 polls: 12000 00:23:32.598 idle_polls: 8971 00:23:32.598 sock_completions: 3029 00:23:32.598 nvme_completions: 5552 00:23:32.598 submitted_requests: 8560 00:23:32.598 queued_requests: 1 00:23:32.598 ======================================================== 00:23:32.598 Latency(us) 00:23:32.598 Device Information : IOPS MiB/s Average min max 00:23:32.598 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1557.86 389.46 83544.28 50462.42 148118.74 00:23:32.598 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1451.37 362.84 89610.43 43137.02 151312.99 00:23:32.598 ======================================================== 00:23:32.598 Total : 3009.22 752.31 86470.02 43137.02 151312.99 00:23:32.598 00:23:32.598 09:46:55 -- host/perf.sh@66 -- # sync 00:23:32.598 09:46:55 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:32.855 09:46:55 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:32.855 09:46:55 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:32.855 09:46:55 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:36.144 09:46:58 -- host/perf.sh@72 -- # ls_guid=7df41f15-1e83-44ee-9f78-09d708f4b3dd 00:23:36.144 09:46:58 -- host/perf.sh@73 -- # get_lvs_free_mb 7df41f15-1e83-44ee-9f78-09d708f4b3dd 00:23:36.144 09:46:58 -- common/autotest_common.sh@1353 -- # local lvs_uuid=7df41f15-1e83-44ee-9f78-09d708f4b3dd 00:23:36.144 09:46:58 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:36.144 09:46:58 -- common/autotest_common.sh@1355 -- # local fc 00:23:36.144 09:46:58 -- common/autotest_common.sh@1356 -- # local cs 00:23:36.144 09:46:58 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:36.402 09:46:59 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:36.402 { 00:23:36.402 "uuid": "7df41f15-1e83-44ee-9f78-09d708f4b3dd", 00:23:36.402 "name": "lvs_0", 00:23:36.402 "base_bdev": "Nvme0n1", 00:23:36.402 "total_data_clusters": 238234, 00:23:36.402 "free_clusters": 238234, 00:23:36.402 "block_size": 512, 00:23:36.402 "cluster_size": 4194304 00:23:36.402 } 00:23:36.402 ]' 00:23:36.402 09:46:59 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="7df41f15-1e83-44ee-9f78-09d708f4b3dd") .free_clusters' 00:23:36.402 09:46:59 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:36.402 09:46:59 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="7df41f15-1e83-44ee-9f78-09d708f4b3dd") .cluster_size' 00:23:36.660 09:46:59 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:36.660 09:46:59 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:36.660 09:46:59 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:36.660 952936 00:23:36.660 09:46:59 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:36.660 09:46:59 -- host/perf.sh@78 -- # free_mb=20480 00:23:36.660 09:46:59 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 7df41f15-1e83-44ee-9f78-09d708f4b3dd lbd_0 20480 00:23:37.256 09:46:59 -- host/perf.sh@80 -- # lb_guid=3a518998-2c5e-4613-9c3a-7bccd3cf62f7 00:23:37.256 09:46:59 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 3a518998-2c5e-4613-9c3a-7bccd3cf62f7 lvs_n_0 00:23:37.867 09:47:00 -- host/perf.sh@83 -- # ls_nested_guid=af4695df-a2b4-44f4-b5f2-4d5d40c6e0ba 00:23:37.867 09:47:00 -- host/perf.sh@84 -- # get_lvs_free_mb af4695df-a2b4-44f4-b5f2-4d5d40c6e0ba 00:23:37.867 09:47:00 -- common/autotest_common.sh@1353 -- # local lvs_uuid=af4695df-a2b4-44f4-b5f2-4d5d40c6e0ba 00:23:37.867 09:47:00 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:37.867 09:47:00 -- common/autotest_common.sh@1355 -- # local fc 00:23:37.867 09:47:00 -- common/autotest_common.sh@1356 -- # local cs 00:23:37.867 09:47:00 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:38.126 09:47:00 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:38.126 { 00:23:38.126 "uuid": "7df41f15-1e83-44ee-9f78-09d708f4b3dd", 00:23:38.126 "name": "lvs_0", 00:23:38.126 "base_bdev": "Nvme0n1", 00:23:38.126 "total_data_clusters": 238234, 00:23:38.126 "free_clusters": 233114, 00:23:38.126 "block_size": 512, 00:23:38.126 "cluster_size": 4194304 00:23:38.126 }, 00:23:38.126 { 00:23:38.126 "uuid": "af4695df-a2b4-44f4-b5f2-4d5d40c6e0ba", 00:23:38.126 "name": "lvs_n_0", 00:23:38.126 "base_bdev": "3a518998-2c5e-4613-9c3a-7bccd3cf62f7", 00:23:38.126 "total_data_clusters": 5114, 00:23:38.126 "free_clusters": 5114, 00:23:38.126 "block_size": 512, 00:23:38.126 "cluster_size": 4194304 00:23:38.126 } 00:23:38.126 ]' 00:23:38.126 09:47:00 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="af4695df-a2b4-44f4-b5f2-4d5d40c6e0ba") .free_clusters' 00:23:38.384 09:47:00 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:38.384 09:47:00 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="af4695df-a2b4-44f4-b5f2-4d5d40c6e0ba") .cluster_size' 00:23:38.384 09:47:01 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:38.384 09:47:01 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:38.384 09:47:01 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:38.384 20456 00:23:38.384 09:47:01 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:38.384 09:47:01 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u af4695df-a2b4-44f4-b5f2-4d5d40c6e0ba lbd_nest_0 20456 00:23:38.643 09:47:01 -- host/perf.sh@88 -- # lb_nested_guid=ac6cbf70-28b1-4dae-b387-b29bcae81b72 00:23:38.643 09:47:01 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:38.900 09:47:01 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:38.901 09:47:01 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 ac6cbf70-28b1-4dae-b387-b29bcae81b72 00:23:39.159 09:47:01 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:39.418 09:47:02 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:39.418 09:47:02 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:39.418 09:47:02 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:39.418 09:47:02 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:39.418 09:47:02 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:39.418 EAL: No free 2048 kB hugepages reported on node 1 00:23:51.677 Initializing NVMe Controllers 00:23:51.677 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:51.677 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:51.677 Initialization complete. Launching workers. 00:23:51.677 ======================================================== 00:23:51.677 Latency(us) 00:23:51.677 Device Information : IOPS MiB/s Average min max 00:23:51.677 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 50.68 0.02 19808.93 170.97 46884.37 00:23:51.677 ======================================================== 00:23:51.677 Total : 50.68 0.02 19808.93 170.97 46884.37 00:23:51.677 00:23:51.677 09:47:12 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:51.677 09:47:12 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:51.677 EAL: No free 2048 kB hugepages reported on node 1 00:24:01.651 Initializing NVMe Controllers 00:24:01.651 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:01.651 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:01.651 Initialization complete. Launching workers. 00:24:01.651 ======================================================== 00:24:01.651 Latency(us) 00:24:01.651 Device Information : IOPS MiB/s Average min max 00:24:01.651 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 79.70 9.96 12563.41 5002.74 47897.26 00:24:01.651 ======================================================== 00:24:01.651 Total : 79.70 9.96 12563.41 5002.74 47897.26 00:24:01.651 00:24:01.651 09:47:22 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:01.651 09:47:22 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:01.652 09:47:22 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:01.652 EAL: No free 2048 kB hugepages reported on node 1 00:24:11.636 Initializing NVMe Controllers 00:24:11.636 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:11.636 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:11.636 Initialization complete. Launching workers. 00:24:11.636 ======================================================== 00:24:11.636 Latency(us) 00:24:11.636 Device Information : IOPS MiB/s Average min max 00:24:11.636 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7812.60 3.81 4096.07 307.86 11733.15 00:24:11.636 ======================================================== 00:24:11.636 Total : 7812.60 3.81 4096.07 307.86 11733.15 00:24:11.636 00:24:11.636 09:47:32 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:11.636 09:47:32 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:11.636 EAL: No free 2048 kB hugepages reported on node 1 00:24:21.616 Initializing NVMe Controllers 00:24:21.616 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:21.616 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:21.616 Initialization complete. Launching workers. 00:24:21.616 ======================================================== 00:24:21.616 Latency(us) 00:24:21.616 Device Information : IOPS MiB/s Average min max 00:24:21.616 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4093.59 511.70 7820.05 719.58 18264.86 00:24:21.616 ======================================================== 00:24:21.616 Total : 4093.59 511.70 7820.05 719.58 18264.86 00:24:21.616 00:24:21.616 09:47:43 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:21.616 09:47:43 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:21.616 09:47:43 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:21.616 EAL: No free 2048 kB hugepages reported on node 1 00:24:31.598 Initializing NVMe Controllers 00:24:31.598 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:31.598 Controller IO queue size 128, less than required. 00:24:31.598 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:31.598 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:31.598 Initialization complete. Launching workers. 00:24:31.598 ======================================================== 00:24:31.598 Latency(us) 00:24:31.598 Device Information : IOPS MiB/s Average min max 00:24:31.598 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12040.22 5.88 10635.38 1871.00 25002.45 00:24:31.598 ======================================================== 00:24:31.598 Total : 12040.22 5.88 10635.38 1871.00 25002.45 00:24:31.598 00:24:31.598 09:47:53 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:31.598 09:47:53 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:31.598 EAL: No free 2048 kB hugepages reported on node 1 00:24:41.570 Initializing NVMe Controllers 00:24:41.570 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:41.570 Controller IO queue size 128, less than required. 00:24:41.570 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:41.570 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:41.570 Initialization complete. Launching workers. 00:24:41.570 ======================================================== 00:24:41.570 Latency(us) 00:24:41.570 Device Information : IOPS MiB/s Average min max 00:24:41.570 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1196.40 149.55 107418.56 15989.66 230441.39 00:24:41.570 ======================================================== 00:24:41.570 Total : 1196.40 149.55 107418.56 15989.66 230441.39 00:24:41.570 00:24:41.570 09:48:04 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:41.828 09:48:04 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ac6cbf70-28b1-4dae-b387-b29bcae81b72 00:24:42.400 09:48:05 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:42.663 09:48:05 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 3a518998-2c5e-4613-9c3a-7bccd3cf62f7 00:24:43.232 09:48:05 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:43.491 09:48:06 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:43.491 09:48:06 -- host/perf.sh@114 -- # nvmftestfini 00:24:43.491 09:48:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:43.491 09:48:06 -- nvmf/common.sh@116 -- # sync 00:24:43.491 09:48:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:43.491 09:48:06 -- nvmf/common.sh@119 -- # set +e 00:24:43.491 09:48:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:43.491 09:48:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:43.491 rmmod nvme_tcp 00:24:43.491 rmmod nvme_fabrics 00:24:43.491 rmmod nvme_keyring 00:24:43.491 09:48:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:43.491 09:48:06 -- nvmf/common.sh@123 -- # set -e 00:24:43.491 09:48:06 -- nvmf/common.sh@124 -- # return 0 00:24:43.491 09:48:06 -- nvmf/common.sh@477 -- # '[' -n 105241 ']' 00:24:43.491 09:48:06 -- nvmf/common.sh@478 -- # killprocess 105241 00:24:43.491 09:48:06 -- common/autotest_common.sh@936 -- # '[' -z 105241 ']' 00:24:43.491 09:48:06 -- common/autotest_common.sh@940 -- # kill -0 105241 00:24:43.491 09:48:06 -- common/autotest_common.sh@941 -- # uname 00:24:43.491 09:48:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:43.491 09:48:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 105241 00:24:43.491 09:48:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:43.491 09:48:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:43.491 09:48:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 105241' 00:24:43.491 killing process with pid 105241 00:24:43.491 09:48:06 -- common/autotest_common.sh@955 -- # kill 105241 00:24:43.491 09:48:06 -- common/autotest_common.sh@960 -- # wait 105241 00:24:45.470 09:48:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:45.470 09:48:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:45.470 09:48:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:45.470 09:48:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:45.470 09:48:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:45.470 09:48:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:45.470 09:48:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:45.470 09:48:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:47.380 09:48:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:47.380 00:24:47.380 real 1m32.599s 00:24:47.380 user 5m42.774s 00:24:47.380 sys 0m15.812s 00:24:47.380 09:48:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:47.380 09:48:09 -- common/autotest_common.sh@10 -- # set +x 00:24:47.380 ************************************ 00:24:47.380 END TEST nvmf_perf 00:24:47.380 ************************************ 00:24:47.380 09:48:09 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:47.380 09:48:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:47.380 09:48:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:47.380 09:48:09 -- common/autotest_common.sh@10 -- # set +x 00:24:47.380 ************************************ 00:24:47.380 START TEST nvmf_fio_host 00:24:47.380 ************************************ 00:24:47.380 09:48:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:47.380 * Looking for test storage... 00:24:47.380 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:47.380 09:48:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:47.380 09:48:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:47.380 09:48:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:47.380 09:48:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:47.380 09:48:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:47.380 09:48:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:47.380 09:48:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:47.380 09:48:10 -- scripts/common.sh@335 -- # IFS=.-: 00:24:47.380 09:48:10 -- scripts/common.sh@335 -- # read -ra ver1 00:24:47.380 09:48:10 -- scripts/common.sh@336 -- # IFS=.-: 00:24:47.380 09:48:10 -- scripts/common.sh@336 -- # read -ra ver2 00:24:47.380 09:48:10 -- scripts/common.sh@337 -- # local 'op=<' 00:24:47.380 09:48:10 -- scripts/common.sh@339 -- # ver1_l=2 00:24:47.380 09:48:10 -- scripts/common.sh@340 -- # ver2_l=1 00:24:47.380 09:48:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:47.380 09:48:10 -- scripts/common.sh@343 -- # case "$op" in 00:24:47.380 09:48:10 -- scripts/common.sh@344 -- # : 1 00:24:47.380 09:48:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:47.380 09:48:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:47.380 09:48:10 -- scripts/common.sh@364 -- # decimal 1 00:24:47.380 09:48:10 -- scripts/common.sh@352 -- # local d=1 00:24:47.380 09:48:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:47.380 09:48:10 -- scripts/common.sh@354 -- # echo 1 00:24:47.380 09:48:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:47.380 09:48:10 -- scripts/common.sh@365 -- # decimal 2 00:24:47.380 09:48:10 -- scripts/common.sh@352 -- # local d=2 00:24:47.380 09:48:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:47.380 09:48:10 -- scripts/common.sh@354 -- # echo 2 00:24:47.380 09:48:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:47.380 09:48:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:47.380 09:48:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:47.380 09:48:10 -- scripts/common.sh@367 -- # return 0 00:24:47.380 09:48:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:47.380 09:48:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:47.380 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:47.380 --rc genhtml_branch_coverage=1 00:24:47.380 --rc genhtml_function_coverage=1 00:24:47.380 --rc genhtml_legend=1 00:24:47.380 --rc geninfo_all_blocks=1 00:24:47.380 --rc geninfo_unexecuted_blocks=1 00:24:47.380 00:24:47.380 ' 00:24:47.380 09:48:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:47.380 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:47.380 --rc genhtml_branch_coverage=1 00:24:47.380 --rc genhtml_function_coverage=1 00:24:47.380 --rc genhtml_legend=1 00:24:47.380 --rc geninfo_all_blocks=1 00:24:47.380 --rc geninfo_unexecuted_blocks=1 00:24:47.380 00:24:47.380 ' 00:24:47.380 09:48:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:47.380 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:47.380 --rc genhtml_branch_coverage=1 00:24:47.380 --rc genhtml_function_coverage=1 00:24:47.380 --rc genhtml_legend=1 00:24:47.380 --rc geninfo_all_blocks=1 00:24:47.380 --rc geninfo_unexecuted_blocks=1 00:24:47.380 00:24:47.380 ' 00:24:47.380 09:48:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:47.380 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:47.380 --rc genhtml_branch_coverage=1 00:24:47.380 --rc genhtml_function_coverage=1 00:24:47.380 --rc genhtml_legend=1 00:24:47.380 --rc geninfo_all_blocks=1 00:24:47.380 --rc geninfo_unexecuted_blocks=1 00:24:47.380 00:24:47.380 ' 00:24:47.380 09:48:10 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:47.380 09:48:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:47.380 09:48:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:47.380 09:48:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:47.380 09:48:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.381 09:48:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.381 09:48:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.381 09:48:10 -- paths/export.sh@5 -- # export PATH 00:24:47.381 09:48:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.381 09:48:10 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:47.381 09:48:10 -- nvmf/common.sh@7 -- # uname -s 00:24:47.381 09:48:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:47.381 09:48:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:47.381 09:48:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:47.381 09:48:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:47.381 09:48:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:47.381 09:48:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:47.381 09:48:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:47.381 09:48:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:47.381 09:48:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:47.381 09:48:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:47.381 09:48:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:47.381 09:48:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:47.381 09:48:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:47.381 09:48:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:47.381 09:48:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:47.381 09:48:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:47.381 09:48:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:47.381 09:48:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:47.381 09:48:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:47.381 09:48:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.381 09:48:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.381 09:48:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.381 09:48:10 -- paths/export.sh@5 -- # export PATH 00:24:47.381 09:48:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.381 09:48:10 -- nvmf/common.sh@46 -- # : 0 00:24:47.381 09:48:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:47.381 09:48:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:47.381 09:48:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:47.381 09:48:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:47.381 09:48:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:47.381 09:48:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:47.381 09:48:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:47.381 09:48:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:47.381 09:48:10 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:47.381 09:48:10 -- host/fio.sh@14 -- # nvmftestinit 00:24:47.381 09:48:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:47.381 09:48:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:47.381 09:48:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:47.381 09:48:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:47.381 09:48:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:47.381 09:48:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:47.381 09:48:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:47.381 09:48:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:47.381 09:48:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:47.381 09:48:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:47.381 09:48:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:47.381 09:48:10 -- common/autotest_common.sh@10 -- # set +x 00:24:49.287 09:48:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:49.287 09:48:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:49.287 09:48:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:49.287 09:48:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:49.287 09:48:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:49.287 09:48:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:49.287 09:48:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:49.287 09:48:11 -- nvmf/common.sh@294 -- # net_devs=() 00:24:49.287 09:48:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:49.287 09:48:11 -- nvmf/common.sh@295 -- # e810=() 00:24:49.287 09:48:11 -- nvmf/common.sh@295 -- # local -ga e810 00:24:49.287 09:48:11 -- nvmf/common.sh@296 -- # x722=() 00:24:49.287 09:48:11 -- nvmf/common.sh@296 -- # local -ga x722 00:24:49.287 09:48:11 -- nvmf/common.sh@297 -- # mlx=() 00:24:49.287 09:48:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:49.287 09:48:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:49.287 09:48:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:49.287 09:48:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:49.287 09:48:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:49.287 09:48:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:49.287 09:48:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:49.287 09:48:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:49.287 09:48:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:49.287 09:48:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:49.287 09:48:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:49.287 09:48:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:49.287 09:48:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:49.287 09:48:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:49.287 09:48:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:49.287 09:48:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:49.287 09:48:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:49.287 09:48:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:49.287 09:48:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:49.287 09:48:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:49.287 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:49.287 09:48:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:49.287 09:48:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:49.287 09:48:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:49.287 09:48:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:49.287 09:48:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:49.287 09:48:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:49.287 09:48:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:49.287 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:49.287 09:48:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:49.287 09:48:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:49.287 09:48:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:49.287 09:48:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:49.287 09:48:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:49.287 09:48:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:49.287 09:48:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:49.287 09:48:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:49.288 09:48:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:49.288 09:48:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:49.288 09:48:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:49.288 09:48:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:49.288 09:48:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:49.288 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:49.288 09:48:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:49.288 09:48:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:49.288 09:48:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:49.288 09:48:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:49.288 09:48:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:49.288 09:48:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:49.288 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:49.288 09:48:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:49.288 09:48:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:49.288 09:48:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:49.288 09:48:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:49.288 09:48:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:49.288 09:48:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:49.288 09:48:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:49.288 09:48:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:49.288 09:48:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:49.288 09:48:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:49.288 09:48:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:49.288 09:48:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:49.288 09:48:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:49.288 09:48:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:49.288 09:48:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:49.288 09:48:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:49.288 09:48:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:49.288 09:48:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:49.288 09:48:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:49.288 09:48:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:49.288 09:48:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:49.288 09:48:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:49.288 09:48:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:49.288 09:48:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:49.288 09:48:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:49.288 09:48:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:49.288 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:49.288 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.207 ms 00:24:49.288 00:24:49.288 --- 10.0.0.2 ping statistics --- 00:24:49.288 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:49.288 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:24:49.288 09:48:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:49.288 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:49.288 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.052 ms 00:24:49.288 00:24:49.288 --- 10.0.0.1 ping statistics --- 00:24:49.288 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:49.288 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:24:49.288 09:48:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:49.288 09:48:12 -- nvmf/common.sh@410 -- # return 0 00:24:49.288 09:48:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:49.288 09:48:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:49.288 09:48:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:49.288 09:48:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:49.288 09:48:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:49.288 09:48:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:49.288 09:48:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:49.288 09:48:12 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:49.288 09:48:12 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:49.288 09:48:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:49.288 09:48:12 -- common/autotest_common.sh@10 -- # set +x 00:24:49.288 09:48:12 -- host/fio.sh@24 -- # nvmfpid=118353 00:24:49.288 09:48:12 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:49.288 09:48:12 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:49.288 09:48:12 -- host/fio.sh@28 -- # waitforlisten 118353 00:24:49.288 09:48:12 -- common/autotest_common.sh@829 -- # '[' -z 118353 ']' 00:24:49.288 09:48:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:49.288 09:48:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:49.288 09:48:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:49.288 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:49.288 09:48:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:49.288 09:48:12 -- common/autotest_common.sh@10 -- # set +x 00:24:49.288 [2024-11-29 09:48:12.114743] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:49.288 [2024-11-29 09:48:12.114835] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:49.548 EAL: No free 2048 kB hugepages reported on node 1 00:24:49.548 [2024-11-29 09:48:12.184106] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:49.548 [2024-11-29 09:48:12.302898] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:49.548 [2024-11-29 09:48:12.303081] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:49.548 [2024-11-29 09:48:12.303099] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:49.548 [2024-11-29 09:48:12.303112] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:49.548 [2024-11-29 09:48:12.303167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:49.548 [2024-11-29 09:48:12.303215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:49.548 [2024-11-29 09:48:12.303317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:49.548 [2024-11-29 09:48:12.303320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:50.485 09:48:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:50.485 09:48:13 -- common/autotest_common.sh@862 -- # return 0 00:24:50.485 09:48:13 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:50.485 [2024-11-29 09:48:13.319634] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:50.743 09:48:13 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:50.743 09:48:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:50.743 09:48:13 -- common/autotest_common.sh@10 -- # set +x 00:24:50.743 09:48:13 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:51.001 Malloc1 00:24:51.001 09:48:13 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:51.258 09:48:13 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:51.516 09:48:14 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:51.774 [2024-11-29 09:48:14.369894] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:51.774 09:48:14 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:52.039 09:48:14 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:52.040 09:48:14 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:52.040 09:48:14 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:52.040 09:48:14 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:52.040 09:48:14 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:52.040 09:48:14 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:52.040 09:48:14 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:52.040 09:48:14 -- common/autotest_common.sh@1330 -- # shift 00:24:52.040 09:48:14 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:52.040 09:48:14 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:52.040 09:48:14 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:52.040 09:48:14 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:52.040 09:48:14 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:52.040 09:48:14 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:52.040 09:48:14 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:52.040 09:48:14 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:52.040 09:48:14 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:52.040 09:48:14 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:52.040 09:48:14 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:52.040 09:48:14 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:52.040 09:48:14 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:52.040 09:48:14 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:52.040 09:48:14 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:52.298 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:52.298 fio-3.35 00:24:52.298 Starting 1 thread 00:24:52.298 EAL: No free 2048 kB hugepages reported on node 1 00:24:54.825 00:24:54.825 test: (groupid=0, jobs=1): err= 0: pid=118848: Fri Nov 29 09:48:17 2024 00:24:54.825 read: IOPS=9332, BW=36.5MiB/s (38.2MB/s)(73.1MiB/2006msec) 00:24:54.825 slat (nsec): min=1840, max=163676, avg=2368.54, stdev=1888.70 00:24:54.825 clat (usec): min=2413, max=13613, avg=7569.74, stdev=596.56 00:24:54.825 lat (usec): min=2437, max=13615, avg=7572.11, stdev=596.43 00:24:54.825 clat percentiles (usec): 00:24:54.825 | 1.00th=[ 6259], 5.00th=[ 6652], 10.00th=[ 6849], 20.00th=[ 7111], 00:24:54.825 | 30.00th=[ 7308], 40.00th=[ 7439], 50.00th=[ 7570], 60.00th=[ 7701], 00:24:54.825 | 70.00th=[ 7898], 80.00th=[ 8029], 90.00th=[ 8291], 95.00th=[ 8455], 00:24:54.825 | 99.00th=[ 8848], 99.50th=[ 9110], 99.90th=[11207], 99.95th=[12125], 00:24:54.825 | 99.99th=[13042] 00:24:54.825 bw ( KiB/s): min=36816, max=37784, per=99.93%, avg=37302.00, stdev=395.41, samples=4 00:24:54.825 iops : min= 9204, max= 9446, avg=9325.50, stdev=98.85, samples=4 00:24:54.825 write: IOPS=9337, BW=36.5MiB/s (38.2MB/s)(73.2MiB/2006msec); 0 zone resets 00:24:54.825 slat (nsec): min=1970, max=111066, avg=2505.69, stdev=1410.85 00:24:54.825 clat (usec): min=1336, max=11302, avg=6098.46, stdev=497.20 00:24:54.825 lat (usec): min=1345, max=11304, avg=6100.96, stdev=497.12 00:24:54.825 clat percentiles (usec): 00:24:54.825 | 1.00th=[ 4948], 5.00th=[ 5342], 10.00th=[ 5538], 20.00th=[ 5735], 00:24:54.825 | 30.00th=[ 5866], 40.00th=[ 5997], 50.00th=[ 6128], 60.00th=[ 6194], 00:24:54.825 | 70.00th=[ 6325], 80.00th=[ 6456], 90.00th=[ 6652], 95.00th=[ 6849], 00:24:54.825 | 99.00th=[ 7177], 99.50th=[ 7308], 99.90th=[ 9503], 99.95th=[10028], 00:24:54.825 | 99.99th=[11207] 00:24:54.825 bw ( KiB/s): min=36992, max=37712, per=99.99%, avg=37348.00, stdev=314.25, samples=4 00:24:54.825 iops : min= 9248, max= 9428, avg=9337.00, stdev=78.56, samples=4 00:24:54.825 lat (msec) : 2=0.03%, 4=0.11%, 10=99.76%, 20=0.10% 00:24:54.825 cpu : usr=61.25%, sys=36.06%, ctx=91, majf=0, minf=41 00:24:54.825 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:54.825 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:54.825 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:54.825 issued rwts: total=18720,18732,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:54.825 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:54.825 00:24:54.825 Run status group 0 (all jobs): 00:24:54.825 READ: bw=36.5MiB/s (38.2MB/s), 36.5MiB/s-36.5MiB/s (38.2MB/s-38.2MB/s), io=73.1MiB (76.7MB), run=2006-2006msec 00:24:54.825 WRITE: bw=36.5MiB/s (38.2MB/s), 36.5MiB/s-36.5MiB/s (38.2MB/s-38.2MB/s), io=73.2MiB (76.7MB), run=2006-2006msec 00:24:54.825 09:48:17 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:54.825 09:48:17 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:54.825 09:48:17 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:54.825 09:48:17 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:54.825 09:48:17 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:54.825 09:48:17 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:54.825 09:48:17 -- common/autotest_common.sh@1330 -- # shift 00:24:54.825 09:48:17 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:54.825 09:48:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:54.825 09:48:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:54.825 09:48:17 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:54.825 09:48:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:54.825 09:48:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:54.825 09:48:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:54.825 09:48:17 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:54.825 09:48:17 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:54.825 09:48:17 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:54.825 09:48:17 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:54.825 09:48:17 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:54.825 09:48:17 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:54.826 09:48:17 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:54.826 09:48:17 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:54.826 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:24:54.826 fio-3.35 00:24:54.826 Starting 1 thread 00:24:54.826 EAL: No free 2048 kB hugepages reported on node 1 00:24:56.200 [2024-11-29 09:48:18.958790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x152f070 is same with the state(5) to be set 00:24:57.133 00:24:57.133 test: (groupid=0, jobs=1): err= 0: pid=119189: Fri Nov 29 09:48:19 2024 00:24:57.133 read: IOPS=9026, BW=141MiB/s (148MB/s)(283MiB/2003msec) 00:24:57.133 slat (nsec): min=2770, max=96715, avg=3585.67, stdev=1843.41 00:24:57.133 clat (usec): min=1882, max=16720, avg=8371.09, stdev=1911.00 00:24:57.133 lat (usec): min=1886, max=16724, avg=8374.68, stdev=1911.14 00:24:57.133 clat percentiles (usec): 00:24:57.133 | 1.00th=[ 4490], 5.00th=[ 5407], 10.00th=[ 6063], 20.00th=[ 6783], 00:24:57.133 | 30.00th=[ 7308], 40.00th=[ 7767], 50.00th=[ 8291], 60.00th=[ 8717], 00:24:57.133 | 70.00th=[ 9241], 80.00th=[ 9896], 90.00th=[10683], 95.00th=[11731], 00:24:57.133 | 99.00th=[13435], 99.50th=[13960], 99.90th=[16057], 99.95th=[16319], 00:24:57.133 | 99.99th=[16712] 00:24:57.133 bw ( KiB/s): min=59968, max=82304, per=49.06%, avg=70856.00, stdev=9308.44, samples=4 00:24:57.133 iops : min= 3748, max= 5144, avg=4428.50, stdev=581.78, samples=4 00:24:57.133 write: IOPS=5210, BW=81.4MiB/s (85.4MB/s)(144MiB/1770msec); 0 zone resets 00:24:57.133 slat (usec): min=30, max=189, avg=33.62, stdev= 5.84 00:24:57.133 clat (usec): min=6443, max=19539, avg=10544.78, stdev=1771.09 00:24:57.133 lat (usec): min=6474, max=19570, avg=10578.40, stdev=1771.49 00:24:57.133 clat percentiles (usec): 00:24:57.133 | 1.00th=[ 7111], 5.00th=[ 7898], 10.00th=[ 8455], 20.00th=[ 8979], 00:24:57.133 | 30.00th=[ 9503], 40.00th=[ 9896], 50.00th=[10421], 60.00th=[10814], 00:24:57.133 | 70.00th=[11469], 80.00th=[11994], 90.00th=[12911], 95.00th=[13829], 00:24:57.133 | 99.00th=[14877], 99.50th=[15270], 99.90th=[16712], 99.95th=[17433], 00:24:57.133 | 99.99th=[19530] 00:24:57.133 bw ( KiB/s): min=63136, max=85952, per=88.50%, avg=73784.00, stdev=9419.98, samples=4 00:24:57.133 iops : min= 3946, max= 5372, avg=4611.50, stdev=588.75, samples=4 00:24:57.133 lat (msec) : 2=0.01%, 4=0.31%, 10=67.96%, 20=31.73% 00:24:57.133 cpu : usr=77.08%, sys=21.37%, ctx=29, majf=0, minf=69 00:24:57.133 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:24:57.133 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:57.133 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:57.133 issued rwts: total=18080,9223,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:57.133 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:57.133 00:24:57.133 Run status group 0 (all jobs): 00:24:57.133 READ: bw=141MiB/s (148MB/s), 141MiB/s-141MiB/s (148MB/s-148MB/s), io=283MiB (296MB), run=2003-2003msec 00:24:57.133 WRITE: bw=81.4MiB/s (85.4MB/s), 81.4MiB/s-81.4MiB/s (85.4MB/s-85.4MB/s), io=144MiB (151MB), run=1770-1770msec 00:24:57.133 09:48:19 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:57.133 09:48:19 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:24:57.133 09:48:19 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:24:57.133 09:48:19 -- host/fio.sh@51 -- # get_nvme_bdfs 00:24:57.133 09:48:19 -- common/autotest_common.sh@1508 -- # bdfs=() 00:24:57.133 09:48:19 -- common/autotest_common.sh@1508 -- # local bdfs 00:24:57.133 09:48:19 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:24:57.133 09:48:19 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:24:57.133 09:48:19 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:24:57.391 09:48:20 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:24:57.391 09:48:20 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:24:57.391 09:48:20 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:25:00.685 Nvme0n1 00:25:00.685 09:48:23 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:03.222 09:48:26 -- host/fio.sh@53 -- # ls_guid=6c26331a-629b-4ec8-9522-8ae926a5a6ed 00:25:03.222 09:48:26 -- host/fio.sh@54 -- # get_lvs_free_mb 6c26331a-629b-4ec8-9522-8ae926a5a6ed 00:25:03.222 09:48:26 -- common/autotest_common.sh@1353 -- # local lvs_uuid=6c26331a-629b-4ec8-9522-8ae926a5a6ed 00:25:03.223 09:48:26 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:03.223 09:48:26 -- common/autotest_common.sh@1355 -- # local fc 00:25:03.223 09:48:26 -- common/autotest_common.sh@1356 -- # local cs 00:25:03.223 09:48:26 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:03.480 09:48:26 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:03.480 { 00:25:03.480 "uuid": "6c26331a-629b-4ec8-9522-8ae926a5a6ed", 00:25:03.480 "name": "lvs_0", 00:25:03.480 "base_bdev": "Nvme0n1", 00:25:03.480 "total_data_clusters": 930, 00:25:03.480 "free_clusters": 930, 00:25:03.480 "block_size": 512, 00:25:03.480 "cluster_size": 1073741824 00:25:03.480 } 00:25:03.480 ]' 00:25:03.480 09:48:26 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="6c26331a-629b-4ec8-9522-8ae926a5a6ed") .free_clusters' 00:25:03.480 09:48:26 -- common/autotest_common.sh@1358 -- # fc=930 00:25:03.480 09:48:26 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="6c26331a-629b-4ec8-9522-8ae926a5a6ed") .cluster_size' 00:25:03.739 09:48:26 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:25:03.739 09:48:26 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:25:03.739 09:48:26 -- common/autotest_common.sh@1363 -- # echo 952320 00:25:03.739 952320 00:25:03.739 09:48:26 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:03.997 c0cc1d0f-f2f4-41e0-9240-98184cf03db5 00:25:03.997 09:48:26 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:04.255 09:48:27 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:04.513 09:48:27 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:04.770 09:48:27 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:04.770 09:48:27 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:04.770 09:48:27 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:04.770 09:48:27 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:04.770 09:48:27 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:04.770 09:48:27 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:04.770 09:48:27 -- common/autotest_common.sh@1330 -- # shift 00:25:04.770 09:48:27 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:04.770 09:48:27 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:04.770 09:48:27 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:04.770 09:48:27 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:04.770 09:48:27 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:04.770 09:48:27 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:04.770 09:48:27 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:04.770 09:48:27 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:04.770 09:48:27 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:04.770 09:48:27 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:04.770 09:48:27 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:05.030 09:48:27 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:05.030 09:48:27 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:05.030 09:48:27 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:05.030 09:48:27 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:05.030 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:05.030 fio-3.35 00:25:05.030 Starting 1 thread 00:25:05.030 EAL: No free 2048 kB hugepages reported on node 1 00:25:07.559 00:25:07.559 test: (groupid=0, jobs=1): err= 0: pid=120530: Fri Nov 29 09:48:30 2024 00:25:07.559 read: IOPS=6428, BW=25.1MiB/s (26.3MB/s)(50.4MiB/2007msec) 00:25:07.559 slat (nsec): min=1918, max=133017, avg=2414.30, stdev=1847.92 00:25:07.559 clat (usec): min=654, max=170596, avg=10922.56, stdev=11285.78 00:25:07.559 lat (usec): min=657, max=170624, avg=10924.97, stdev=11286.00 00:25:07.559 clat percentiles (msec): 00:25:07.559 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 10], 00:25:07.559 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:25:07.559 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:25:07.559 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:25:07.559 | 99.99th=[ 171] 00:25:07.559 bw ( KiB/s): min=18184, max=28312, per=99.84%, avg=25674.00, stdev=4995.80, samples=4 00:25:07.559 iops : min= 4546, max= 7078, avg=6418.50, stdev=1248.95, samples=4 00:25:07.559 write: IOPS=6433, BW=25.1MiB/s (26.4MB/s)(50.4MiB/2007msec); 0 zone resets 00:25:07.559 slat (nsec): min=2017, max=95559, avg=2491.26, stdev=1252.95 00:25:07.559 clat (usec): min=300, max=168998, avg=8839.73, stdev=10580.83 00:25:07.559 lat (usec): min=302, max=169003, avg=8842.22, stdev=10581.05 00:25:07.559 clat percentiles (msec): 00:25:07.559 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:25:07.559 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 9], 00:25:07.559 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:25:07.559 | 99.00th=[ 11], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:25:07.559 | 99.99th=[ 169] 00:25:07.559 bw ( KiB/s): min=19128, max=28016, per=99.88%, avg=25702.00, stdev=4383.76, samples=4 00:25:07.559 iops : min= 4782, max= 7004, avg=6425.50, stdev=1095.94, samples=4 00:25:07.559 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:25:07.559 lat (msec) : 2=0.03%, 4=0.18%, 10=71.83%, 20=27.45%, 250=0.50% 00:25:07.559 cpu : usr=63.21%, sys=34.80%, ctx=72, majf=0, minf=41 00:25:07.559 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:07.559 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:07.559 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:07.559 issued rwts: total=12903,12912,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:07.559 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:07.559 00:25:07.559 Run status group 0 (all jobs): 00:25:07.559 READ: bw=25.1MiB/s (26.3MB/s), 25.1MiB/s-25.1MiB/s (26.3MB/s-26.3MB/s), io=50.4MiB (52.8MB), run=2007-2007msec 00:25:07.559 WRITE: bw=25.1MiB/s (26.4MB/s), 25.1MiB/s-25.1MiB/s (26.4MB/s-26.4MB/s), io=50.4MiB (52.9MB), run=2007-2007msec 00:25:07.559 09:48:30 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:07.559 09:48:30 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:08.930 09:48:31 -- host/fio.sh@64 -- # ls_nested_guid=ef2aabe0-e6ff-47a5-b131-e10a6655bd33 00:25:08.930 09:48:31 -- host/fio.sh@65 -- # get_lvs_free_mb ef2aabe0-e6ff-47a5-b131-e10a6655bd33 00:25:08.930 09:48:31 -- common/autotest_common.sh@1353 -- # local lvs_uuid=ef2aabe0-e6ff-47a5-b131-e10a6655bd33 00:25:08.930 09:48:31 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:08.930 09:48:31 -- common/autotest_common.sh@1355 -- # local fc 00:25:08.930 09:48:31 -- common/autotest_common.sh@1356 -- # local cs 00:25:08.930 09:48:31 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:08.930 09:48:31 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:08.930 { 00:25:08.930 "uuid": "6c26331a-629b-4ec8-9522-8ae926a5a6ed", 00:25:08.930 "name": "lvs_0", 00:25:08.930 "base_bdev": "Nvme0n1", 00:25:08.930 "total_data_clusters": 930, 00:25:08.930 "free_clusters": 0, 00:25:08.930 "block_size": 512, 00:25:08.930 "cluster_size": 1073741824 00:25:08.930 }, 00:25:08.930 { 00:25:08.930 "uuid": "ef2aabe0-e6ff-47a5-b131-e10a6655bd33", 00:25:08.930 "name": "lvs_n_0", 00:25:08.930 "base_bdev": "c0cc1d0f-f2f4-41e0-9240-98184cf03db5", 00:25:08.930 "total_data_clusters": 237847, 00:25:08.930 "free_clusters": 237847, 00:25:08.930 "block_size": 512, 00:25:08.930 "cluster_size": 4194304 00:25:08.930 } 00:25:08.930 ]' 00:25:08.930 09:48:31 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="ef2aabe0-e6ff-47a5-b131-e10a6655bd33") .free_clusters' 00:25:09.188 09:48:31 -- common/autotest_common.sh@1358 -- # fc=237847 00:25:09.188 09:48:31 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="ef2aabe0-e6ff-47a5-b131-e10a6655bd33") .cluster_size' 00:25:09.188 09:48:31 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:09.188 09:48:31 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:25:09.188 09:48:31 -- common/autotest_common.sh@1363 -- # echo 951388 00:25:09.188 951388 00:25:09.188 09:48:31 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:09.754 19895981-3f84-4c49-add7-8bf000e6edfd 00:25:09.754 09:48:32 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:10.012 09:48:32 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:10.270 09:48:33 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:10.528 09:48:33 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:10.528 09:48:33 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:10.528 09:48:33 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:10.528 09:48:33 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:10.528 09:48:33 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:10.528 09:48:33 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:10.528 09:48:33 -- common/autotest_common.sh@1330 -- # shift 00:25:10.528 09:48:33 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:10.528 09:48:33 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:10.528 09:48:33 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:10.528 09:48:33 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:10.528 09:48:33 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:10.528 09:48:33 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:10.528 09:48:33 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:10.528 09:48:33 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:10.528 09:48:33 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:10.528 09:48:33 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:10.528 09:48:33 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:10.528 09:48:33 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:10.528 09:48:33 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:10.528 09:48:33 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:10.528 09:48:33 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:10.786 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:10.786 fio-3.35 00:25:10.786 Starting 1 thread 00:25:10.786 EAL: No free 2048 kB hugepages reported on node 1 00:25:13.313 00:25:13.313 test: (groupid=0, jobs=1): err= 0: pid=121385: Fri Nov 29 09:48:35 2024 00:25:13.313 read: IOPS=5872, BW=22.9MiB/s (24.1MB/s)(46.1MiB/2009msec) 00:25:13.313 slat (nsec): min=1925, max=140650, avg=2513.47, stdev=2170.64 00:25:13.313 clat (usec): min=4409, max=19819, avg=12025.32, stdev=993.62 00:25:13.313 lat (usec): min=4416, max=19822, avg=12027.83, stdev=993.54 00:25:13.313 clat percentiles (usec): 00:25:13.313 | 1.00th=[ 9765], 5.00th=[10421], 10.00th=[10814], 20.00th=[11207], 00:25:13.313 | 30.00th=[11600], 40.00th=[11863], 50.00th=[11994], 60.00th=[12256], 00:25:13.313 | 70.00th=[12518], 80.00th=[12780], 90.00th=[13173], 95.00th=[13566], 00:25:13.313 | 99.00th=[14222], 99.50th=[14615], 99.90th=[17171], 99.95th=[17433], 00:25:13.313 | 99.99th=[19006] 00:25:13.313 bw ( KiB/s): min=22376, max=24112, per=99.91%, avg=23466.00, stdev=753.91, samples=4 00:25:13.313 iops : min= 5594, max= 6028, avg=5866.50, stdev=188.48, samples=4 00:25:13.313 write: IOPS=5862, BW=22.9MiB/s (24.0MB/s)(46.0MiB/2009msec); 0 zone resets 00:25:13.313 slat (nsec): min=2000, max=110132, avg=2611.28, stdev=1649.50 00:25:13.313 clat (usec): min=2244, max=18734, avg=9684.93, stdev=913.65 00:25:13.313 lat (usec): min=2253, max=18736, avg=9687.54, stdev=913.64 00:25:13.313 clat percentiles (usec): 00:25:13.313 | 1.00th=[ 7635], 5.00th=[ 8356], 10.00th=[ 8586], 20.00th=[ 8979], 00:25:13.313 | 30.00th=[ 9241], 40.00th=[ 9503], 50.00th=[ 9634], 60.00th=[ 9896], 00:25:13.313 | 70.00th=[10028], 80.00th=[10421], 90.00th=[10683], 95.00th=[10945], 00:25:13.313 | 99.00th=[11600], 99.50th=[11994], 99.90th=[16057], 99.95th=[17171], 00:25:13.313 | 99.99th=[18744] 00:25:13.313 bw ( KiB/s): min=23296, max=23560, per=99.91%, avg=23428.00, stdev=147.87, samples=4 00:25:13.313 iops : min= 5824, max= 5890, avg=5857.00, stdev=36.97, samples=4 00:25:13.313 lat (msec) : 4=0.04%, 10=33.66%, 20=66.30% 00:25:13.313 cpu : usr=61.11%, sys=37.05%, ctx=48, majf=0, minf=41 00:25:13.313 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:13.313 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:13.313 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:13.313 issued rwts: total=11797,11777,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:13.313 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:13.313 00:25:13.313 Run status group 0 (all jobs): 00:25:13.313 READ: bw=22.9MiB/s (24.1MB/s), 22.9MiB/s-22.9MiB/s (24.1MB/s-24.1MB/s), io=46.1MiB (48.3MB), run=2009-2009msec 00:25:13.313 WRITE: bw=22.9MiB/s (24.0MB/s), 22.9MiB/s-22.9MiB/s (24.0MB/s-24.0MB/s), io=46.0MiB (48.2MB), run=2009-2009msec 00:25:13.313 09:48:35 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:13.313 09:48:36 -- host/fio.sh@74 -- # sync 00:25:13.313 09:48:36 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:17.553 09:48:39 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:17.553 09:48:40 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:20.835 09:48:43 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:20.835 09:48:43 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:22.741 09:48:45 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:22.741 09:48:45 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:22.741 09:48:45 -- host/fio.sh@86 -- # nvmftestfini 00:25:22.741 09:48:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:22.741 09:48:45 -- nvmf/common.sh@116 -- # sync 00:25:22.741 09:48:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:22.741 09:48:45 -- nvmf/common.sh@119 -- # set +e 00:25:22.741 09:48:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:22.741 09:48:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:22.741 rmmod nvme_tcp 00:25:22.741 rmmod nvme_fabrics 00:25:22.741 rmmod nvme_keyring 00:25:22.741 09:48:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:22.741 09:48:45 -- nvmf/common.sh@123 -- # set -e 00:25:22.741 09:48:45 -- nvmf/common.sh@124 -- # return 0 00:25:22.741 09:48:45 -- nvmf/common.sh@477 -- # '[' -n 118353 ']' 00:25:22.741 09:48:45 -- nvmf/common.sh@478 -- # killprocess 118353 00:25:22.741 09:48:45 -- common/autotest_common.sh@936 -- # '[' -z 118353 ']' 00:25:22.741 09:48:45 -- common/autotest_common.sh@940 -- # kill -0 118353 00:25:22.741 09:48:45 -- common/autotest_common.sh@941 -- # uname 00:25:22.741 09:48:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:22.741 09:48:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 118353 00:25:22.741 09:48:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:22.741 09:48:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:22.741 09:48:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 118353' 00:25:22.741 killing process with pid 118353 00:25:22.741 09:48:45 -- common/autotest_common.sh@955 -- # kill 118353 00:25:22.741 09:48:45 -- common/autotest_common.sh@960 -- # wait 118353 00:25:23.002 09:48:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:23.002 09:48:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:23.002 09:48:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:23.002 09:48:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:23.002 09:48:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:23.002 09:48:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:23.002 09:48:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:23.002 09:48:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:24.909 09:48:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:24.909 00:25:24.909 real 0m37.809s 00:25:24.909 user 2m25.338s 00:25:24.909 sys 0m6.727s 00:25:24.909 09:48:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:24.909 09:48:47 -- common/autotest_common.sh@10 -- # set +x 00:25:24.909 ************************************ 00:25:24.909 END TEST nvmf_fio_host 00:25:24.909 ************************************ 00:25:24.909 09:48:47 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:24.909 09:48:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:24.909 09:48:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:24.909 09:48:47 -- common/autotest_common.sh@10 -- # set +x 00:25:24.909 ************************************ 00:25:24.909 START TEST nvmf_failover 00:25:24.909 ************************************ 00:25:24.909 09:48:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:25.168 * Looking for test storage... 00:25:25.168 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:25.168 09:48:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:25.168 09:48:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:25.168 09:48:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:25.168 09:48:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:25.168 09:48:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:25.168 09:48:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:25.168 09:48:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:25.168 09:48:47 -- scripts/common.sh@335 -- # IFS=.-: 00:25:25.168 09:48:47 -- scripts/common.sh@335 -- # read -ra ver1 00:25:25.168 09:48:47 -- scripts/common.sh@336 -- # IFS=.-: 00:25:25.168 09:48:47 -- scripts/common.sh@336 -- # read -ra ver2 00:25:25.168 09:48:47 -- scripts/common.sh@337 -- # local 'op=<' 00:25:25.168 09:48:47 -- scripts/common.sh@339 -- # ver1_l=2 00:25:25.168 09:48:47 -- scripts/common.sh@340 -- # ver2_l=1 00:25:25.168 09:48:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:25.168 09:48:47 -- scripts/common.sh@343 -- # case "$op" in 00:25:25.168 09:48:47 -- scripts/common.sh@344 -- # : 1 00:25:25.168 09:48:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:25.168 09:48:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:25.168 09:48:47 -- scripts/common.sh@364 -- # decimal 1 00:25:25.168 09:48:47 -- scripts/common.sh@352 -- # local d=1 00:25:25.168 09:48:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:25.168 09:48:47 -- scripts/common.sh@354 -- # echo 1 00:25:25.168 09:48:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:25.168 09:48:47 -- scripts/common.sh@365 -- # decimal 2 00:25:25.168 09:48:47 -- scripts/common.sh@352 -- # local d=2 00:25:25.168 09:48:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:25.168 09:48:47 -- scripts/common.sh@354 -- # echo 2 00:25:25.168 09:48:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:25.168 09:48:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:25.169 09:48:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:25.169 09:48:47 -- scripts/common.sh@367 -- # return 0 00:25:25.169 09:48:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:25.169 09:48:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:25.169 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:25.169 --rc genhtml_branch_coverage=1 00:25:25.169 --rc genhtml_function_coverage=1 00:25:25.169 --rc genhtml_legend=1 00:25:25.169 --rc geninfo_all_blocks=1 00:25:25.169 --rc geninfo_unexecuted_blocks=1 00:25:25.169 00:25:25.169 ' 00:25:25.169 09:48:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:25.169 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:25.169 --rc genhtml_branch_coverage=1 00:25:25.169 --rc genhtml_function_coverage=1 00:25:25.169 --rc genhtml_legend=1 00:25:25.169 --rc geninfo_all_blocks=1 00:25:25.169 --rc geninfo_unexecuted_blocks=1 00:25:25.169 00:25:25.169 ' 00:25:25.169 09:48:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:25.169 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:25.169 --rc genhtml_branch_coverage=1 00:25:25.169 --rc genhtml_function_coverage=1 00:25:25.169 --rc genhtml_legend=1 00:25:25.169 --rc geninfo_all_blocks=1 00:25:25.169 --rc geninfo_unexecuted_blocks=1 00:25:25.169 00:25:25.169 ' 00:25:25.169 09:48:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:25.169 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:25.169 --rc genhtml_branch_coverage=1 00:25:25.169 --rc genhtml_function_coverage=1 00:25:25.169 --rc genhtml_legend=1 00:25:25.169 --rc geninfo_all_blocks=1 00:25:25.169 --rc geninfo_unexecuted_blocks=1 00:25:25.169 00:25:25.169 ' 00:25:25.169 09:48:47 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:25.169 09:48:47 -- nvmf/common.sh@7 -- # uname -s 00:25:25.169 09:48:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:25.169 09:48:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:25.169 09:48:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:25.169 09:48:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:25.169 09:48:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:25.169 09:48:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:25.169 09:48:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:25.169 09:48:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:25.169 09:48:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:25.169 09:48:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:25.169 09:48:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:25.169 09:48:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:25.169 09:48:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:25.169 09:48:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:25.169 09:48:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:25.169 09:48:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:25.169 09:48:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:25.169 09:48:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:25.169 09:48:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:25.169 09:48:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:25.169 09:48:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:25.169 09:48:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:25.169 09:48:47 -- paths/export.sh@5 -- # export PATH 00:25:25.169 09:48:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:25.169 09:48:47 -- nvmf/common.sh@46 -- # : 0 00:25:25.169 09:48:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:25.169 09:48:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:25.169 09:48:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:25.169 09:48:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:25.169 09:48:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:25.169 09:48:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:25.169 09:48:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:25.169 09:48:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:25.169 09:48:47 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:25.169 09:48:47 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:25.169 09:48:47 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:25.169 09:48:47 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:25.169 09:48:47 -- host/failover.sh@18 -- # nvmftestinit 00:25:25.169 09:48:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:25.169 09:48:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:25.169 09:48:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:25.169 09:48:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:25.169 09:48:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:25.169 09:48:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:25.169 09:48:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:25.169 09:48:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:25.169 09:48:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:25.169 09:48:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:25.169 09:48:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:25.169 09:48:47 -- common/autotest_common.sh@10 -- # set +x 00:25:27.073 09:48:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:27.073 09:48:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:27.073 09:48:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:27.073 09:48:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:27.073 09:48:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:27.073 09:48:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:27.073 09:48:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:27.073 09:48:49 -- nvmf/common.sh@294 -- # net_devs=() 00:25:27.073 09:48:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:27.073 09:48:49 -- nvmf/common.sh@295 -- # e810=() 00:25:27.073 09:48:49 -- nvmf/common.sh@295 -- # local -ga e810 00:25:27.073 09:48:49 -- nvmf/common.sh@296 -- # x722=() 00:25:27.073 09:48:49 -- nvmf/common.sh@296 -- # local -ga x722 00:25:27.073 09:48:49 -- nvmf/common.sh@297 -- # mlx=() 00:25:27.073 09:48:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:27.073 09:48:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:27.073 09:48:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:27.073 09:48:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:27.073 09:48:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:27.073 09:48:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:27.073 09:48:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:27.073 09:48:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:27.073 09:48:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:27.073 09:48:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:27.073 09:48:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:27.073 09:48:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:27.073 09:48:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:27.073 09:48:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:27.073 09:48:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:27.073 09:48:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:27.073 09:48:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:27.073 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:27.073 09:48:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:27.073 09:48:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:27.073 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:27.073 09:48:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:27.073 09:48:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:27.073 09:48:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:27.073 09:48:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:27.073 09:48:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:27.073 09:48:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:27.073 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:27.073 09:48:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:27.073 09:48:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:27.073 09:48:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:27.073 09:48:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:27.073 09:48:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:27.073 09:48:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:27.073 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:27.073 09:48:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:27.073 09:48:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:27.073 09:48:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:27.073 09:48:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:27.073 09:48:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:27.073 09:48:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:27.073 09:48:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:27.073 09:48:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:27.073 09:48:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:27.073 09:48:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:27.073 09:48:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:27.073 09:48:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:27.073 09:48:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:27.073 09:48:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:27.073 09:48:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:27.073 09:48:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:27.073 09:48:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:27.073 09:48:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:27.073 09:48:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:27.073 09:48:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:27.073 09:48:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:27.073 09:48:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:27.332 09:48:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:27.332 09:48:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:27.332 09:48:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:27.332 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:27.332 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.260 ms 00:25:27.332 00:25:27.332 --- 10.0.0.2 ping statistics --- 00:25:27.332 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:27.332 rtt min/avg/max/mdev = 0.260/0.260/0.260/0.000 ms 00:25:27.332 09:48:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:27.332 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:27.332 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:25:27.332 00:25:27.332 --- 10.0.0.1 ping statistics --- 00:25:27.332 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:27.332 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:25:27.332 09:48:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:27.332 09:48:49 -- nvmf/common.sh@410 -- # return 0 00:25:27.332 09:48:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:27.332 09:48:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:27.332 09:48:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:27.332 09:48:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:27.332 09:48:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:27.332 09:48:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:27.332 09:48:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:27.332 09:48:49 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:27.332 09:48:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:27.332 09:48:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:27.332 09:48:49 -- common/autotest_common.sh@10 -- # set +x 00:25:27.332 09:48:49 -- nvmf/common.sh@469 -- # nvmfpid=124700 00:25:27.332 09:48:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:27.332 09:48:49 -- nvmf/common.sh@470 -- # waitforlisten 124700 00:25:27.332 09:48:49 -- common/autotest_common.sh@829 -- # '[' -z 124700 ']' 00:25:27.332 09:48:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:27.332 09:48:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:27.332 09:48:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:27.332 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:27.332 09:48:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:27.332 09:48:49 -- common/autotest_common.sh@10 -- # set +x 00:25:27.332 [2024-11-29 09:48:49.999360] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:27.332 [2024-11-29 09:48:49.999439] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:27.332 EAL: No free 2048 kB hugepages reported on node 1 00:25:27.332 [2024-11-29 09:48:50.073285] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:27.592 [2024-11-29 09:48:50.189013] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:27.592 [2024-11-29 09:48:50.189179] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:27.592 [2024-11-29 09:48:50.189199] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:27.592 [2024-11-29 09:48:50.189215] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:27.592 [2024-11-29 09:48:50.189314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:27.592 [2024-11-29 09:48:50.189415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:27.592 [2024-11-29 09:48:50.189418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:28.162 09:48:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:28.162 09:48:50 -- common/autotest_common.sh@862 -- # return 0 00:25:28.162 09:48:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:28.162 09:48:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:28.162 09:48:50 -- common/autotest_common.sh@10 -- # set +x 00:25:28.420 09:48:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:28.420 09:48:51 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:28.420 [2024-11-29 09:48:51.229725] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:28.420 09:48:51 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:28.680 Malloc0 00:25:28.939 09:48:51 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:29.199 09:48:51 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:29.199 09:48:52 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:29.457 [2024-11-29 09:48:52.267694] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:29.457 09:48:52 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:29.715 [2024-11-29 09:48:52.512420] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:29.715 09:48:52 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:29.973 [2024-11-29 09:48:52.777271] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:29.973 09:48:52 -- host/failover.sh@31 -- # bdevperf_pid=125112 00:25:29.973 09:48:52 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:29.973 09:48:52 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:29.973 09:48:52 -- host/failover.sh@34 -- # waitforlisten 125112 /var/tmp/bdevperf.sock 00:25:29.973 09:48:52 -- common/autotest_common.sh@829 -- # '[' -z 125112 ']' 00:25:29.973 09:48:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:29.973 09:48:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:29.973 09:48:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:29.973 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:29.973 09:48:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:29.973 09:48:52 -- common/autotest_common.sh@10 -- # set +x 00:25:31.346 09:48:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:31.346 09:48:53 -- common/autotest_common.sh@862 -- # return 0 00:25:31.346 09:48:53 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:31.346 NVMe0n1 00:25:31.346 09:48:54 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:31.911 00:25:31.911 09:48:54 -- host/failover.sh@39 -- # run_test_pid=125279 00:25:31.911 09:48:54 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:31.911 09:48:54 -- host/failover.sh@41 -- # sleep 1 00:25:32.843 09:48:55 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:33.101 [2024-11-29 09:48:55.877367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.101 [2024-11-29 09:48:55.877486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.101 [2024-11-29 09:48:55.877511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.101 [2024-11-29 09:48:55.877524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.101 [2024-11-29 09:48:55.877536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.101 [2024-11-29 09:48:55.877548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.101 [2024-11-29 09:48:55.877569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.877992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.878003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.878013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.878025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.878036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 [2024-11-29 09:48:55.878047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1208cb0 is same with the state(5) to be set 00:25:33.102 09:48:55 -- host/failover.sh@45 -- # sleep 3 00:25:36.382 09:48:58 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:36.641 00:25:36.641 09:48:59 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:36.899 [2024-11-29 09:48:59.509517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.899 [2024-11-29 09:48:59.509884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.509896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.509909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.509921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.509932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.509944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.509955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.509967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.509978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.509990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 [2024-11-29 09:48:59.510377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120a3a0 is same with the state(5) to be set 00:25:36.900 09:48:59 -- host/failover.sh@50 -- # sleep 3 00:25:40.181 09:49:02 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:40.181 [2024-11-29 09:49:02.770241] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:40.181 09:49:02 -- host/failover.sh@55 -- # sleep 1 00:25:41.116 09:49:03 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:41.374 [2024-11-29 09:49:04.081943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.081982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.081998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.374 [2024-11-29 09:49:04.082416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.375 [2024-11-29 09:49:04.082428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.375 [2024-11-29 09:49:04.082440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.375 [2024-11-29 09:49:04.082452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.375 [2024-11-29 09:49:04.082463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.375 [2024-11-29 09:49:04.082474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.375 [2024-11-29 09:49:04.082487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.375 [2024-11-29 09:49:04.082499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.375 [2024-11-29 09:49:04.082511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.375 [2024-11-29 09:49:04.082539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.375 [2024-11-29 09:49:04.082551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.375 [2024-11-29 09:49:04.082563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x120aa80 is same with the state(5) to be set 00:25:41.375 09:49:04 -- host/failover.sh@59 -- # wait 125279 00:25:47.936 0 00:25:47.936 09:49:09 -- host/failover.sh@61 -- # killprocess 125112 00:25:47.936 09:49:09 -- common/autotest_common.sh@936 -- # '[' -z 125112 ']' 00:25:47.936 09:49:09 -- common/autotest_common.sh@940 -- # kill -0 125112 00:25:47.936 09:49:09 -- common/autotest_common.sh@941 -- # uname 00:25:47.936 09:49:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:47.936 09:49:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 125112 00:25:47.936 09:49:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:47.936 09:49:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:47.936 09:49:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 125112' 00:25:47.936 killing process with pid 125112 00:25:47.936 09:49:09 -- common/autotest_common.sh@955 -- # kill 125112 00:25:47.936 09:49:09 -- common/autotest_common.sh@960 -- # wait 125112 00:25:47.936 09:49:10 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:47.936 [2024-11-29 09:48:52.836320] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:47.936 [2024-11-29 09:48:52.836432] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid125112 ] 00:25:47.936 EAL: No free 2048 kB hugepages reported on node 1 00:25:47.936 [2024-11-29 09:48:52.895153] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:47.936 [2024-11-29 09:48:53.001838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:47.936 Running I/O for 15 seconds... 00:25:47.936 [2024-11-29 09:48:55.878364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:118656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.936 [2024-11-29 09:48:55.878412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.936 [2024-11-29 09:48:55.878441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:118088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.936 [2024-11-29 09:48:55.878458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.936 [2024-11-29 09:48:55.878475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:118128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:118136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:118144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:118152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:118168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:118184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:118192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:118664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:118688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:118704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:118712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:118200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:118216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:118240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:118248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:118256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.878974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.878989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:118264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:118272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:118288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:118744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:118752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:118760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:118768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:118776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:118784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:118792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:118832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:118848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:118864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:118872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:118888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.937 [2024-11-29 09:48:55.879422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:118896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:118904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:118912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.937 [2024-11-29 09:48:55.879527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:118920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:118928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:118936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.937 [2024-11-29 09:48:55.879621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:118304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.937 [2024-11-29 09:48:55.879652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.937 [2024-11-29 09:48:55.879667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:118312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.879681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.879696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:118328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.879710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.879725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:118344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.879740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.879755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:118368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.879769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.879800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:118376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.879813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.879828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:118384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.879842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.879862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:118400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.879877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.879891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:118408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.879905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.879920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:118416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.879937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.879952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:118424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.879965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.879980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:118432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.879993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:118440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.880021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:118448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.880050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:118456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.880078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:118488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.880106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:118944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:118952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.880161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:118960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:118968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:118976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:118984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:118992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:119000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:119008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:119016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.880426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:119024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:119032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:119040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:119048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.880548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:119056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:119064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:119072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:119080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.880662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:119088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.880710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:119096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:119104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.880769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:119112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.938 [2024-11-29 09:48:55.880803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:119120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.938 [2024-11-29 09:48:55.880852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:119128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.938 [2024-11-29 09:48:55.880866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.880881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:118496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.880894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.880909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:118504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.880923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.880937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:118520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.880951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.880966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:118528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.880979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.880993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:118552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:118568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:118584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:119136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.939 [2024-11-29 09:48:55.881125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:119144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.939 [2024-11-29 09:48:55.881154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:119152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:119160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:119168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.939 [2024-11-29 09:48:55.881239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:119176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:119184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.939 [2024-11-29 09:48:55.881295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:119192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:119200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.939 [2024-11-29 09:48:55.881356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:119208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.939 [2024-11-29 09:48:55.881384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:119216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.939 [2024-11-29 09:48:55.881444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:119224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:119232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:119240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.939 [2024-11-29 09:48:55.881537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:119248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.939 [2024-11-29 09:48:55.881567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:119256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.939 [2024-11-29 09:48:55.881595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:119264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:118632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:118640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:118648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:118672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.939 [2024-11-29 09:48:55.881755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.939 [2024-11-29 09:48:55.881769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:118680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:55.881783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.881798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:118696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:55.881811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.881826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:118720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:55.881840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.881855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:118728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:55.881872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.881888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:119272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:55.881901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.881916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:119280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.940 [2024-11-29 09:48:55.881930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.881945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:119288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.940 [2024-11-29 09:48:55.881959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.881973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:119296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:55.881987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:119304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.940 [2024-11-29 09:48:55.882017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:119312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.940 [2024-11-29 09:48:55.882046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:119320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.940 [2024-11-29 09:48:55.882075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:119328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:55.882104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:118736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:55.882133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:118800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:55.882162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:118808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:55.882190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:118816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:55.882219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:118824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:55.882251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:118840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:55.882280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:118856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:55.882310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16f56a0 is same with the state(5) to be set 00:25:47.940 [2024-11-29 09:48:55.882342] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:47.940 [2024-11-29 09:48:55.882353] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:47.940 [2024-11-29 09:48:55.882365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118880 len:8 PRP1 0x0 PRP2 0x0 00:25:47.940 [2024-11-29 09:48:55.882400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882464] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x16f56a0 was disconnected and freed. reset controller. 00:25:47.940 [2024-11-29 09:48:55.882490] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:47.940 [2024-11-29 09:48:55.882527] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.940 [2024-11-29 09:48:55.882550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882567] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.940 [2024-11-29 09:48:55.882581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882595] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.940 [2024-11-29 09:48:55.882609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882622] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.940 [2024-11-29 09:48:55.882635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:55.882649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:47.940 [2024-11-29 09:48:55.884869] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:47.940 [2024-11-29 09:48:55.884906] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16d6870 (9): Bad file descriptor 00:25:47.940 [2024-11-29 09:48:55.912482] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:47.940 [2024-11-29 09:48:59.510568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:114568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:59.510613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.940 [2024-11-29 09:48:59.510649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:114576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.940 [2024-11-29 09:48:59.510667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.510685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:114600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.510710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.510725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:114608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.510739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.510755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:114632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.510775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.510809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:114648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.510823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.510838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:114656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.510866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.510881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:114664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.510895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.510909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:114672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.510922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.510937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:114688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.510950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.510964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:114112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.510977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.510991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:114144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:114152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:114176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:114184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:114192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:114200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:114240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:114696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:114704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:114736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:114768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:114776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:114784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:114792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:114808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:114256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:114272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:114288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:114296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:114304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.941 [2024-11-29 09:48:59.511593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.941 [2024-11-29 09:48:59.511608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:114312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.511621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.511636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:114320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.511651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.511667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:114368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.511695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.511715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:114816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.511729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.511760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:114840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.511784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.511798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:114848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.511811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.511825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:114856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.511840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.511855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:114864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.511871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.511886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:114872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.511898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.511912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:114880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.511925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.511939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:114888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.511952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.511966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:114896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.511979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.511994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:114904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.512008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:114912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.512036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:114920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.512065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:114928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.512094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:114936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.512121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:114944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.512149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:114952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.512176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:114960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.512203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:114968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.512234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:114976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.512263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:114984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.512290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:114992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.512328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:115000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.512355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:115008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.512418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:115016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.512462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:115024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.512491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:115032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.512522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:115040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.512551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:115048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.512581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:115056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.942 [2024-11-29 09:48:59.512610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:115064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.512639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:115072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.512700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.942 [2024-11-29 09:48:59.512716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:115080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.942 [2024-11-29 09:48:59.512730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.512759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:114384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.512778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.512792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:114392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.512805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.512819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:114408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.512831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.512853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:114416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.512866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.512880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:114424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.512893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.512907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:114432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.512920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.512934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:114448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.512947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.512961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:114456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.512974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.512988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:114472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:114480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:114488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:114496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:114512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:114528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:114536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:114552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:115088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:115096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.943 [2024-11-29 09:48:59.513246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:115104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:115112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:115120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:115128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:115136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:115144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.943 [2024-11-29 09:48:59.513435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:115152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.943 [2024-11-29 09:48:59.513480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:115160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.943 [2024-11-29 09:48:59.513509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:115168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.943 [2024-11-29 09:48:59.513539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:114560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:114584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:114592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.943 [2024-11-29 09:48:59.513627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.943 [2024-11-29 09:48:59.513642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:114616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.513656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.513671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:114624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.513690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.513720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:114640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.513734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.513748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:114680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.513776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.513794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:114712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.513807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.513821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:115176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.944 [2024-11-29 09:48:59.513838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.513856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:115184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.513869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.513883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:115192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.944 [2024-11-29 09:48:59.513896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.513912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:115200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.944 [2024-11-29 09:48:59.513926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.513941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:115208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.513954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.513969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:115216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.944 [2024-11-29 09:48:59.513982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.513996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:115224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.514010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:115232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.944 [2024-11-29 09:48:59.514038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:115240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.514066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:115248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.944 [2024-11-29 09:48:59.514093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:115256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.944 [2024-11-29 09:48:59.514121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:115264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.514148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:115272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.944 [2024-11-29 09:48:59.514187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:115280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.514219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:115288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.514256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:115296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.514283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:115304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.944 [2024-11-29 09:48:59.514310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:115312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.944 [2024-11-29 09:48:59.514337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:115320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.944 [2024-11-29 09:48:59.514364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:114720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.514425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:114728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.514456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:114744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.514485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:114752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.514513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:114760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.514542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:114800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.514570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:114824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.944 [2024-11-29 09:48:59.514603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.944 [2024-11-29 09:48:59.514618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1702c90 is same with the state(5) to be set 00:25:47.944 [2024-11-29 09:48:59.514635] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:47.944 [2024-11-29 09:48:59.514646] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:47.945 [2024-11-29 09:48:59.514657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:114832 len:8 PRP1 0x0 PRP2 0x0 00:25:47.945 [2024-11-29 09:48:59.514671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:48:59.514740] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1702c90 was disconnected and freed. reset controller. 00:25:47.945 [2024-11-29 09:48:59.514758] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:47.945 [2024-11-29 09:48:59.514790] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.945 [2024-11-29 09:48:59.514825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:48:59.514840] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.945 [2024-11-29 09:48:59.514853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:48:59.514867] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.945 [2024-11-29 09:48:59.514880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:48:59.514893] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.945 [2024-11-29 09:48:59.514907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:48:59.514931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:47.945 [2024-11-29 09:48:59.514982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16d6870 (9): Bad file descriptor 00:25:47.945 [2024-11-29 09:48:59.517214] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:47.945 [2024-11-29 09:48:59.548646] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:47.945 [2024-11-29 09:49:04.081850] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.945 [2024-11-29 09:49:04.081929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.081960] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.945 [2024-11-29 09:49:04.081975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.081990] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.945 [2024-11-29 09:49:04.082004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.082018] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.945 [2024-11-29 09:49:04.082032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.082056] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16d6870 is same with the state(5) to be set 00:25:47.945 [2024-11-29 09:49:04.082719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:76584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.082744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.082770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:76600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.082786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.082803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:76616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.082817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.082833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:76624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.082847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.082862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:76640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.082884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.082898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:76664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.082912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.082928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:76704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.082965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.082979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:76728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.082992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.083006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:76744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.083019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.083034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:76112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.083047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.083061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:76120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.083074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.083089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:76136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.083102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.083122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:76152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.083136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.083151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:76168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.083164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.083178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:76176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.083191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.083206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:76760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.083219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.083233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:76768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.083247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.083261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:76792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.083274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.083289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:76800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.945 [2024-11-29 09:49:04.083302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.083316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:76808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.945 [2024-11-29 09:49:04.083329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.945 [2024-11-29 09:49:04.083343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:76816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.083356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:76824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.083420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:76832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.083465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:76840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.946 [2024-11-29 09:49:04.083494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:76848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.946 [2024-11-29 09:49:04.083531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:76856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.946 [2024-11-29 09:49:04.083562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:76864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.083591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:76872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.083620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:76880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.946 [2024-11-29 09:49:04.083649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:76888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.946 [2024-11-29 09:49:04.083678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:76896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.083722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:76904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.083751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:76912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.083811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:76920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.083840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:76928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.083875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:76936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.946 [2024-11-29 09:49:04.083902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:76944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.083937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:76952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.946 [2024-11-29 09:49:04.083968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.083983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:76960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.946 [2024-11-29 09:49:04.083996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.084010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:76968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.946 [2024-11-29 09:49:04.084023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.084037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:76976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.084051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.084065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:76984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.946 [2024-11-29 09:49:04.084078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.084092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:76992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.084105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.084119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:77000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.084132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.084146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:77008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.084160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.084175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:77016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.946 [2024-11-29 09:49:04.084187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.084201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:77024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.084214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.084229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:77032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.084242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.084256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:77040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.084270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.084284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:77048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.946 [2024-11-29 09:49:04.084298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.084316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:77056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.946 [2024-11-29 09:49:04.084330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.084345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:77064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.946 [2024-11-29 09:49:04.084358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.946 [2024-11-29 09:49:04.084372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:77072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.946 [2024-11-29 09:49:04.084389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:77080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:77088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.947 [2024-11-29 09:49:04.084470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:76200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:76240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:76248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:76272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:76280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:76296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:76312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:76320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:76328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:76344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:76368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:76384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:76392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:76400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:76408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:77096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.084970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.084984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:77104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.947 [2024-11-29 09:49:04.084997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.085011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:77112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.947 [2024-11-29 09:49:04.085024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.085039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:77120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.947 [2024-11-29 09:49:04.085052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.085066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:77128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.947 [2024-11-29 09:49:04.085079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.085096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:77136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.947 [2024-11-29 09:49:04.085110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.085125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:77144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.085138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.085152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:77152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.947 [2024-11-29 09:49:04.085165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.085180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:77160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.947 [2024-11-29 09:49:04.085194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.085208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:77168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.947 [2024-11-29 09:49:04.085221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.947 [2024-11-29 09:49:04.085236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:76416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:76440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:76448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:76472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:76480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:76488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:76504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:76528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:77176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:77184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.948 [2024-11-29 09:49:04.085532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:77192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.948 [2024-11-29 09:49:04.085560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:77200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:76576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:76592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:76608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:76632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:76648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:76656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:76672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:76680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:77208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:77216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:77224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:77232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.948 [2024-11-29 09:49:04.085951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:77240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.085979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.085993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:77248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.086006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.086021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:77256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.086046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.086060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:77264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.948 [2024-11-29 09:49:04.086074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.086088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:77272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.086102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.086128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:77280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.948 [2024-11-29 09:49:04.086142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.086157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:77288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.948 [2024-11-29 09:49:04.086171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.086185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:77296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.948 [2024-11-29 09:49:04.086199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.086213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:77304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.948 [2024-11-29 09:49:04.086232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.086251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:77312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.086265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.086280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:77320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.948 [2024-11-29 09:49:04.086294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.086308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:77328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.948 [2024-11-29 09:49:04.086322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.086337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:77336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.948 [2024-11-29 09:49:04.086350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.948 [2024-11-29 09:49:04.086365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:77344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.949 [2024-11-29 09:49:04.086389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.949 [2024-11-29 09:49:04.086429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:77352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:47.949 [2024-11-29 09:49:04.086444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.949 [2024-11-29 09:49:04.086459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:77360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.949 [2024-11-29 09:49:04.086473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.949 [2024-11-29 09:49:04.086489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:76688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.949 [2024-11-29 09:49:04.086503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.949 [2024-11-29 09:49:04.086518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:76696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.949 [2024-11-29 09:49:04.086532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.949 [2024-11-29 09:49:04.086547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:76712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.949 [2024-11-29 09:49:04.086560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.949 [2024-11-29 09:49:04.086576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:76720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.949 [2024-11-29 09:49:04.086589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.949 [2024-11-29 09:49:04.086604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:76736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.949 [2024-11-29 09:49:04.086618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.949 [2024-11-29 09:49:04.086633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:76752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.949 [2024-11-29 09:49:04.086650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.949 [2024-11-29 09:49:04.086665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:76776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:47.949 [2024-11-29 09:49:04.086679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.949 [2024-11-29 09:49:04.086693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16e2d10 is same with the state(5) to be set 00:25:47.949 [2024-11-29 09:49:04.086724] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:47.949 [2024-11-29 09:49:04.086737] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:47.949 [2024-11-29 09:49:04.086754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:76784 len:8 PRP1 0x0 PRP2 0x0 00:25:47.949 [2024-11-29 09:49:04.086767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.949 [2024-11-29 09:49:04.086824] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x16e2d10 was disconnected and freed. reset controller. 00:25:47.949 [2024-11-29 09:49:04.086841] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:47.949 [2024-11-29 09:49:04.086871] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:47.949 [2024-11-29 09:49:04.089185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:47.949 [2024-11-29 09:49:04.089226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16d6870 (9): Bad file descriptor 00:25:47.949 [2024-11-29 09:49:04.158848] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:47.949 00:25:47.949 Latency(us) 00:25:47.949 [2024-11-29T08:49:10.792Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:47.949 [2024-11-29T08:49:10.792Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:47.949 Verification LBA range: start 0x0 length 0x4000 00:25:47.949 NVMe0n1 : 15.01 13011.97 50.83 484.39 0.00 9467.09 788.86 16311.18 00:25:47.949 [2024-11-29T08:49:10.792Z] =================================================================================================================== 00:25:47.949 [2024-11-29T08:49:10.792Z] Total : 13011.97 50.83 484.39 0.00 9467.09 788.86 16311.18 00:25:47.949 Received shutdown signal, test time was about 15.000000 seconds 00:25:47.949 00:25:47.949 Latency(us) 00:25:47.949 [2024-11-29T08:49:10.792Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:47.949 [2024-11-29T08:49:10.792Z] =================================================================================================================== 00:25:47.949 [2024-11-29T08:49:10.792Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:47.949 09:49:10 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:47.949 09:49:10 -- host/failover.sh@65 -- # count=3 00:25:47.949 09:49:10 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:47.949 09:49:10 -- host/failover.sh@73 -- # bdevperf_pid=127177 00:25:47.949 09:49:10 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:47.949 09:49:10 -- host/failover.sh@75 -- # waitforlisten 127177 /var/tmp/bdevperf.sock 00:25:47.949 09:49:10 -- common/autotest_common.sh@829 -- # '[' -z 127177 ']' 00:25:47.949 09:49:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:47.949 09:49:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:47.949 09:49:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:47.949 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:47.949 09:49:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:47.949 09:49:10 -- common/autotest_common.sh@10 -- # set +x 00:25:48.513 09:49:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:48.513 09:49:11 -- common/autotest_common.sh@862 -- # return 0 00:25:48.513 09:49:11 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:48.769 [2024-11-29 09:49:11.358938] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:48.769 09:49:11 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:49.025 [2024-11-29 09:49:11.611702] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:49.025 09:49:11 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:49.281 NVMe0n1 00:25:49.281 09:49:12 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:49.844 00:25:49.844 09:49:12 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:50.101 00:25:50.101 09:49:12 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:50.101 09:49:12 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:50.387 09:49:13 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:50.671 09:49:13 -- host/failover.sh@87 -- # sleep 3 00:25:53.946 09:49:16 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:53.947 09:49:16 -- host/failover.sh@88 -- # grep -q NVMe0 00:25:53.947 09:49:16 -- host/failover.sh@90 -- # run_test_pid=128003 00:25:53.947 09:49:16 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:53.947 09:49:16 -- host/failover.sh@92 -- # wait 128003 00:25:55.321 0 00:25:55.321 09:49:17 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:55.321 [2024-11-29 09:49:10.127365] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:55.321 [2024-11-29 09:49:10.127488] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid127177 ] 00:25:55.321 EAL: No free 2048 kB hugepages reported on node 1 00:25:55.321 [2024-11-29 09:49:10.188983] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:55.321 [2024-11-29 09:49:10.296576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:55.321 [2024-11-29 09:49:13.353092] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:55.321 [2024-11-29 09:49:13.353214] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.321 [2024-11-29 09:49:13.353240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.321 [2024-11-29 09:49:13.353260] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.321 [2024-11-29 09:49:13.353275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.321 [2024-11-29 09:49:13.353289] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.321 [2024-11-29 09:49:13.353304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.321 [2024-11-29 09:49:13.353318] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.321 [2024-11-29 09:49:13.353332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.321 [2024-11-29 09:49:13.353348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:55.321 [2024-11-29 09:49:13.353410] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:55.321 [2024-11-29 09:49:13.353455] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x856870 (9): Bad file descriptor 00:25:55.322 [2024-11-29 09:49:13.401745] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:55.322 Running I/O for 1 seconds... 00:25:55.322 00:25:55.322 Latency(us) 00:25:55.322 [2024-11-29T08:49:18.165Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:55.322 [2024-11-29T08:49:18.165Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:55.322 Verification LBA range: start 0x0 length 0x4000 00:25:55.322 NVMe0n1 : 1.01 12536.58 48.97 0.00 0.00 10160.79 1450.29 10777.03 00:25:55.322 [2024-11-29T08:49:18.165Z] =================================================================================================================== 00:25:55.322 [2024-11-29T08:49:18.165Z] Total : 12536.58 48.97 0.00 0.00 10160.79 1450.29 10777.03 00:25:55.322 09:49:17 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:55.322 09:49:17 -- host/failover.sh@95 -- # grep -q NVMe0 00:25:55.322 09:49:18 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:55.580 09:49:18 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:55.580 09:49:18 -- host/failover.sh@99 -- # grep -q NVMe0 00:25:55.838 09:49:18 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:56.096 09:49:18 -- host/failover.sh@101 -- # sleep 3 00:25:59.374 09:49:21 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:59.374 09:49:21 -- host/failover.sh@103 -- # grep -q NVMe0 00:25:59.374 09:49:22 -- host/failover.sh@108 -- # killprocess 127177 00:25:59.374 09:49:22 -- common/autotest_common.sh@936 -- # '[' -z 127177 ']' 00:25:59.374 09:49:22 -- common/autotest_common.sh@940 -- # kill -0 127177 00:25:59.374 09:49:22 -- common/autotest_common.sh@941 -- # uname 00:25:59.374 09:49:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:59.374 09:49:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 127177 00:25:59.374 09:49:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:59.374 09:49:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:59.374 09:49:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 127177' 00:25:59.374 killing process with pid 127177 00:25:59.374 09:49:22 -- common/autotest_common.sh@955 -- # kill 127177 00:25:59.374 09:49:22 -- common/autotest_common.sh@960 -- # wait 127177 00:25:59.632 09:49:22 -- host/failover.sh@110 -- # sync 00:25:59.632 09:49:22 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:59.890 09:49:22 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:25:59.890 09:49:22 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:59.890 09:49:22 -- host/failover.sh@116 -- # nvmftestfini 00:25:59.890 09:49:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:59.890 09:49:22 -- nvmf/common.sh@116 -- # sync 00:25:59.890 09:49:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:59.890 09:49:22 -- nvmf/common.sh@119 -- # set +e 00:25:59.890 09:49:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:59.890 09:49:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:59.890 rmmod nvme_tcp 00:25:59.890 rmmod nvme_fabrics 00:25:59.890 rmmod nvme_keyring 00:25:59.890 09:49:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:59.890 09:49:22 -- nvmf/common.sh@123 -- # set -e 00:25:59.890 09:49:22 -- nvmf/common.sh@124 -- # return 0 00:25:59.890 09:49:22 -- nvmf/common.sh@477 -- # '[' -n 124700 ']' 00:25:59.890 09:49:22 -- nvmf/common.sh@478 -- # killprocess 124700 00:25:59.890 09:49:22 -- common/autotest_common.sh@936 -- # '[' -z 124700 ']' 00:25:59.890 09:49:22 -- common/autotest_common.sh@940 -- # kill -0 124700 00:25:59.890 09:49:22 -- common/autotest_common.sh@941 -- # uname 00:25:59.890 09:49:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:59.890 09:49:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 124700 00:26:00.149 09:49:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:00.149 09:49:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:00.149 09:49:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 124700' 00:26:00.149 killing process with pid 124700 00:26:00.149 09:49:22 -- common/autotest_common.sh@955 -- # kill 124700 00:26:00.149 09:49:22 -- common/autotest_common.sh@960 -- # wait 124700 00:26:00.409 09:49:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:00.409 09:49:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:00.409 09:49:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:00.409 09:49:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:00.409 09:49:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:00.409 09:49:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:00.409 09:49:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:00.409 09:49:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:02.312 09:49:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:02.312 00:26:02.312 real 0m37.372s 00:26:02.312 user 2m12.783s 00:26:02.312 sys 0m5.850s 00:26:02.312 09:49:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:02.312 09:49:25 -- common/autotest_common.sh@10 -- # set +x 00:26:02.312 ************************************ 00:26:02.312 END TEST nvmf_failover 00:26:02.312 ************************************ 00:26:02.312 09:49:25 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:02.312 09:49:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:02.312 09:49:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:02.312 09:49:25 -- common/autotest_common.sh@10 -- # set +x 00:26:02.312 ************************************ 00:26:02.312 START TEST nvmf_discovery 00:26:02.312 ************************************ 00:26:02.312 09:49:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:02.568 * Looking for test storage... 00:26:02.569 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:02.569 09:49:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:02.569 09:49:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:02.569 09:49:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:02.569 09:49:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:02.569 09:49:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:02.569 09:49:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:02.569 09:49:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:02.569 09:49:25 -- scripts/common.sh@335 -- # IFS=.-: 00:26:02.569 09:49:25 -- scripts/common.sh@335 -- # read -ra ver1 00:26:02.569 09:49:25 -- scripts/common.sh@336 -- # IFS=.-: 00:26:02.569 09:49:25 -- scripts/common.sh@336 -- # read -ra ver2 00:26:02.569 09:49:25 -- scripts/common.sh@337 -- # local 'op=<' 00:26:02.569 09:49:25 -- scripts/common.sh@339 -- # ver1_l=2 00:26:02.569 09:49:25 -- scripts/common.sh@340 -- # ver2_l=1 00:26:02.569 09:49:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:02.569 09:49:25 -- scripts/common.sh@343 -- # case "$op" in 00:26:02.569 09:49:25 -- scripts/common.sh@344 -- # : 1 00:26:02.569 09:49:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:02.569 09:49:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:02.569 09:49:25 -- scripts/common.sh@364 -- # decimal 1 00:26:02.569 09:49:25 -- scripts/common.sh@352 -- # local d=1 00:26:02.569 09:49:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:02.569 09:49:25 -- scripts/common.sh@354 -- # echo 1 00:26:02.569 09:49:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:02.569 09:49:25 -- scripts/common.sh@365 -- # decimal 2 00:26:02.569 09:49:25 -- scripts/common.sh@352 -- # local d=2 00:26:02.569 09:49:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:02.569 09:49:25 -- scripts/common.sh@354 -- # echo 2 00:26:02.569 09:49:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:02.569 09:49:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:02.569 09:49:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:02.569 09:49:25 -- scripts/common.sh@367 -- # return 0 00:26:02.569 09:49:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:02.569 09:49:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:02.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.569 --rc genhtml_branch_coverage=1 00:26:02.569 --rc genhtml_function_coverage=1 00:26:02.569 --rc genhtml_legend=1 00:26:02.569 --rc geninfo_all_blocks=1 00:26:02.569 --rc geninfo_unexecuted_blocks=1 00:26:02.569 00:26:02.569 ' 00:26:02.569 09:49:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:02.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.569 --rc genhtml_branch_coverage=1 00:26:02.569 --rc genhtml_function_coverage=1 00:26:02.569 --rc genhtml_legend=1 00:26:02.569 --rc geninfo_all_blocks=1 00:26:02.569 --rc geninfo_unexecuted_blocks=1 00:26:02.569 00:26:02.569 ' 00:26:02.569 09:49:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:02.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.569 --rc genhtml_branch_coverage=1 00:26:02.569 --rc genhtml_function_coverage=1 00:26:02.569 --rc genhtml_legend=1 00:26:02.569 --rc geninfo_all_blocks=1 00:26:02.569 --rc geninfo_unexecuted_blocks=1 00:26:02.569 00:26:02.569 ' 00:26:02.569 09:49:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:02.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:02.569 --rc genhtml_branch_coverage=1 00:26:02.569 --rc genhtml_function_coverage=1 00:26:02.569 --rc genhtml_legend=1 00:26:02.569 --rc geninfo_all_blocks=1 00:26:02.569 --rc geninfo_unexecuted_blocks=1 00:26:02.569 00:26:02.569 ' 00:26:02.569 09:49:25 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:02.569 09:49:25 -- nvmf/common.sh@7 -- # uname -s 00:26:02.569 09:49:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:02.569 09:49:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:02.569 09:49:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:02.569 09:49:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:02.569 09:49:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:02.569 09:49:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:02.569 09:49:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:02.569 09:49:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:02.569 09:49:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:02.569 09:49:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:02.569 09:49:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:02.569 09:49:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:02.569 09:49:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:02.569 09:49:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:02.569 09:49:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:02.569 09:49:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:02.569 09:49:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:02.569 09:49:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:02.569 09:49:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:02.569 09:49:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.569 09:49:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.569 09:49:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.569 09:49:25 -- paths/export.sh@5 -- # export PATH 00:26:02.569 09:49:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:02.569 09:49:25 -- nvmf/common.sh@46 -- # : 0 00:26:02.569 09:49:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:02.569 09:49:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:02.569 09:49:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:02.569 09:49:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:02.569 09:49:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:02.569 09:49:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:02.569 09:49:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:02.569 09:49:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:02.569 09:49:25 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:02.569 09:49:25 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:02.569 09:49:25 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:02.569 09:49:25 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:02.569 09:49:25 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:02.569 09:49:25 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:02.569 09:49:25 -- host/discovery.sh@25 -- # nvmftestinit 00:26:02.569 09:49:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:02.569 09:49:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:02.569 09:49:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:02.569 09:49:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:02.569 09:49:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:02.569 09:49:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:02.569 09:49:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:02.569 09:49:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:02.569 09:49:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:02.569 09:49:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:02.569 09:49:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:02.569 09:49:25 -- common/autotest_common.sh@10 -- # set +x 00:26:05.098 09:49:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:05.098 09:49:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:05.098 09:49:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:05.098 09:49:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:05.098 09:49:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:05.098 09:49:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:05.098 09:49:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:05.098 09:49:27 -- nvmf/common.sh@294 -- # net_devs=() 00:26:05.098 09:49:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:05.098 09:49:27 -- nvmf/common.sh@295 -- # e810=() 00:26:05.098 09:49:27 -- nvmf/common.sh@295 -- # local -ga e810 00:26:05.098 09:49:27 -- nvmf/common.sh@296 -- # x722=() 00:26:05.098 09:49:27 -- nvmf/common.sh@296 -- # local -ga x722 00:26:05.098 09:49:27 -- nvmf/common.sh@297 -- # mlx=() 00:26:05.098 09:49:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:05.098 09:49:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:05.098 09:49:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:05.098 09:49:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:05.098 09:49:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:05.098 09:49:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:05.098 09:49:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:05.098 09:49:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:05.098 09:49:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:05.098 09:49:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:05.098 09:49:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:05.098 09:49:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:05.098 09:49:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:05.098 09:49:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:05.098 09:49:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:05.098 09:49:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:05.098 09:49:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:05.098 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:05.098 09:49:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:05.098 09:49:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:05.098 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:05.098 09:49:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:05.098 09:49:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:05.098 09:49:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:05.098 09:49:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:05.098 09:49:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:05.098 09:49:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:05.098 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:05.098 09:49:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:05.098 09:49:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:05.098 09:49:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:05.098 09:49:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:05.098 09:49:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:05.098 09:49:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:05.098 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:05.098 09:49:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:05.098 09:49:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:05.098 09:49:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:05.098 09:49:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:05.098 09:49:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:05.098 09:49:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:05.098 09:49:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:05.098 09:49:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:05.098 09:49:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:05.098 09:49:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:05.098 09:49:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:05.098 09:49:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:05.098 09:49:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:05.098 09:49:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:05.098 09:49:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:05.098 09:49:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:05.098 09:49:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:05.098 09:49:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:05.098 09:49:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:05.098 09:49:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:05.098 09:49:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:05.098 09:49:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:05.098 09:49:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:05.098 09:49:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:05.098 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:05.098 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:26:05.098 00:26:05.098 --- 10.0.0.2 ping statistics --- 00:26:05.098 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:05.098 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:26:05.098 09:49:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:05.098 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:05.098 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.146 ms 00:26:05.098 00:26:05.098 --- 10.0.0.1 ping statistics --- 00:26:05.098 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:05.098 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:26:05.098 09:49:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:05.098 09:49:27 -- nvmf/common.sh@410 -- # return 0 00:26:05.098 09:49:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:05.098 09:49:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:05.098 09:49:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:05.098 09:49:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:05.098 09:49:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:05.098 09:49:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:05.098 09:49:27 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:05.098 09:49:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:05.098 09:49:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:05.098 09:49:27 -- common/autotest_common.sh@10 -- # set +x 00:26:05.098 09:49:27 -- nvmf/common.sh@469 -- # nvmfpid=130643 00:26:05.098 09:49:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:05.098 09:49:27 -- nvmf/common.sh@470 -- # waitforlisten 130643 00:26:05.098 09:49:27 -- common/autotest_common.sh@829 -- # '[' -z 130643 ']' 00:26:05.098 09:49:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:05.098 09:49:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:05.098 09:49:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:05.098 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:05.098 09:49:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:05.098 09:49:27 -- common/autotest_common.sh@10 -- # set +x 00:26:05.098 [2024-11-29 09:49:27.631983] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:05.098 [2024-11-29 09:49:27.632052] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:05.098 EAL: No free 2048 kB hugepages reported on node 1 00:26:05.098 [2024-11-29 09:49:27.695642] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:05.098 [2024-11-29 09:49:27.802168] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:05.098 [2024-11-29 09:49:27.802315] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:05.098 [2024-11-29 09:49:27.802334] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:05.098 [2024-11-29 09:49:27.802347] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:05.098 [2024-11-29 09:49:27.802372] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:06.032 09:49:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:06.032 09:49:28 -- common/autotest_common.sh@862 -- # return 0 00:26:06.032 09:49:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:06.032 09:49:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:06.032 09:49:28 -- common/autotest_common.sh@10 -- # set +x 00:26:06.032 09:49:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:06.032 09:49:28 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:06.032 09:49:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.032 09:49:28 -- common/autotest_common.sh@10 -- # set +x 00:26:06.032 [2024-11-29 09:49:28.669561] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:06.032 09:49:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.032 09:49:28 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:06.032 09:49:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.032 09:49:28 -- common/autotest_common.sh@10 -- # set +x 00:26:06.032 [2024-11-29 09:49:28.677772] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:06.032 09:49:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.032 09:49:28 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:06.032 09:49:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.032 09:49:28 -- common/autotest_common.sh@10 -- # set +x 00:26:06.032 null0 00:26:06.032 09:49:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.032 09:49:28 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:06.032 09:49:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.032 09:49:28 -- common/autotest_common.sh@10 -- # set +x 00:26:06.032 null1 00:26:06.032 09:49:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.032 09:49:28 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:06.032 09:49:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.032 09:49:28 -- common/autotest_common.sh@10 -- # set +x 00:26:06.032 09:49:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.032 09:49:28 -- host/discovery.sh@45 -- # hostpid=130795 00:26:06.032 09:49:28 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:06.032 09:49:28 -- host/discovery.sh@46 -- # waitforlisten 130795 /tmp/host.sock 00:26:06.032 09:49:28 -- common/autotest_common.sh@829 -- # '[' -z 130795 ']' 00:26:06.032 09:49:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:06.032 09:49:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:06.032 09:49:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:06.032 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:06.032 09:49:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:06.032 09:49:28 -- common/autotest_common.sh@10 -- # set +x 00:26:06.032 [2024-11-29 09:49:28.746650] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:06.032 [2024-11-29 09:49:28.746733] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid130795 ] 00:26:06.032 EAL: No free 2048 kB hugepages reported on node 1 00:26:06.032 [2024-11-29 09:49:28.806880] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:06.290 [2024-11-29 09:49:28.920984] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:06.290 [2024-11-29 09:49:28.921160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:07.224 09:49:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:07.224 09:49:29 -- common/autotest_common.sh@862 -- # return 0 00:26:07.224 09:49:29 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:07.224 09:49:29 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:07.224 09:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.224 09:49:29 -- common/autotest_common.sh@10 -- # set +x 00:26:07.224 09:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.224 09:49:29 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:07.224 09:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.224 09:49:29 -- common/autotest_common.sh@10 -- # set +x 00:26:07.224 09:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.224 09:49:29 -- host/discovery.sh@72 -- # notify_id=0 00:26:07.224 09:49:29 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:07.224 09:49:29 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:07.224 09:49:29 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:07.224 09:49:29 -- host/discovery.sh@59 -- # sort 00:26:07.224 09:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.224 09:49:29 -- common/autotest_common.sh@10 -- # set +x 00:26:07.224 09:49:29 -- host/discovery.sh@59 -- # xargs 00:26:07.224 09:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.224 09:49:29 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:07.224 09:49:29 -- host/discovery.sh@79 -- # get_bdev_list 00:26:07.224 09:49:29 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.224 09:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.224 09:49:29 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:07.224 09:49:29 -- common/autotest_common.sh@10 -- # set +x 00:26:07.224 09:49:29 -- host/discovery.sh@55 -- # sort 00:26:07.224 09:49:29 -- host/discovery.sh@55 -- # xargs 00:26:07.224 09:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.224 09:49:29 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:07.224 09:49:29 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:07.224 09:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.224 09:49:29 -- common/autotest_common.sh@10 -- # set +x 00:26:07.224 09:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.224 09:49:29 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:07.224 09:49:29 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:07.224 09:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.224 09:49:29 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:07.224 09:49:29 -- common/autotest_common.sh@10 -- # set +x 00:26:07.224 09:49:29 -- host/discovery.sh@59 -- # sort 00:26:07.224 09:49:29 -- host/discovery.sh@59 -- # xargs 00:26:07.224 09:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.224 09:49:29 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:07.224 09:49:29 -- host/discovery.sh@83 -- # get_bdev_list 00:26:07.224 09:49:29 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.224 09:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.224 09:49:29 -- common/autotest_common.sh@10 -- # set +x 00:26:07.224 09:49:29 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:07.224 09:49:29 -- host/discovery.sh@55 -- # sort 00:26:07.224 09:49:29 -- host/discovery.sh@55 -- # xargs 00:26:07.224 09:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.224 09:49:29 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:07.224 09:49:29 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:07.224 09:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.224 09:49:29 -- common/autotest_common.sh@10 -- # set +x 00:26:07.224 09:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.224 09:49:29 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:07.224 09:49:29 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:07.224 09:49:29 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:07.224 09:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.224 09:49:29 -- host/discovery.sh@59 -- # sort 00:26:07.224 09:49:29 -- common/autotest_common.sh@10 -- # set +x 00:26:07.224 09:49:29 -- host/discovery.sh@59 -- # xargs 00:26:07.224 09:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.224 09:49:29 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:07.224 09:49:29 -- host/discovery.sh@87 -- # get_bdev_list 00:26:07.224 09:49:29 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.224 09:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.224 09:49:29 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:07.224 09:49:29 -- common/autotest_common.sh@10 -- # set +x 00:26:07.224 09:49:29 -- host/discovery.sh@55 -- # sort 00:26:07.224 09:49:29 -- host/discovery.sh@55 -- # xargs 00:26:07.224 09:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.224 09:49:30 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:07.224 09:49:30 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:07.224 09:49:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.224 09:49:30 -- common/autotest_common.sh@10 -- # set +x 00:26:07.224 [2024-11-29 09:49:30.021590] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:07.224 09:49:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.224 09:49:30 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:07.225 09:49:30 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:07.225 09:49:30 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:07.225 09:49:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.225 09:49:30 -- common/autotest_common.sh@10 -- # set +x 00:26:07.225 09:49:30 -- host/discovery.sh@59 -- # sort 00:26:07.225 09:49:30 -- host/discovery.sh@59 -- # xargs 00:26:07.225 09:49:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.482 09:49:30 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:07.482 09:49:30 -- host/discovery.sh@93 -- # get_bdev_list 00:26:07.482 09:49:30 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.482 09:49:30 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:07.482 09:49:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.482 09:49:30 -- common/autotest_common.sh@10 -- # set +x 00:26:07.482 09:49:30 -- host/discovery.sh@55 -- # sort 00:26:07.482 09:49:30 -- host/discovery.sh@55 -- # xargs 00:26:07.482 09:49:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.482 09:49:30 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:07.482 09:49:30 -- host/discovery.sh@94 -- # get_notification_count 00:26:07.482 09:49:30 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:07.482 09:49:30 -- host/discovery.sh@74 -- # jq '. | length' 00:26:07.482 09:49:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.482 09:49:30 -- common/autotest_common.sh@10 -- # set +x 00:26:07.482 09:49:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.482 09:49:30 -- host/discovery.sh@74 -- # notification_count=0 00:26:07.482 09:49:30 -- host/discovery.sh@75 -- # notify_id=0 00:26:07.482 09:49:30 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:07.482 09:49:30 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:07.482 09:49:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.482 09:49:30 -- common/autotest_common.sh@10 -- # set +x 00:26:07.482 09:49:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.482 09:49:30 -- host/discovery.sh@100 -- # sleep 1 00:26:08.047 [2024-11-29 09:49:30.810205] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:08.047 [2024-11-29 09:49:30.810241] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:08.047 [2024-11-29 09:49:30.810275] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:08.305 [2024-11-29 09:49:30.938680] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:08.305 [2024-11-29 09:49:31.039450] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:08.305 [2024-11-29 09:49:31.039472] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:08.563 09:49:31 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:08.563 09:49:31 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:08.563 09:49:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.563 09:49:31 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:08.563 09:49:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.563 09:49:31 -- host/discovery.sh@59 -- # sort 00:26:08.563 09:49:31 -- host/discovery.sh@59 -- # xargs 00:26:08.563 09:49:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.563 09:49:31 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:08.563 09:49:31 -- host/discovery.sh@102 -- # get_bdev_list 00:26:08.563 09:49:31 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:08.563 09:49:31 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:08.563 09:49:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.563 09:49:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.563 09:49:31 -- host/discovery.sh@55 -- # sort 00:26:08.563 09:49:31 -- host/discovery.sh@55 -- # xargs 00:26:08.563 09:49:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.563 09:49:31 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:08.563 09:49:31 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:08.563 09:49:31 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:08.563 09:49:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.563 09:49:31 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:08.563 09:49:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.563 09:49:31 -- host/discovery.sh@63 -- # sort -n 00:26:08.563 09:49:31 -- host/discovery.sh@63 -- # xargs 00:26:08.563 09:49:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.563 09:49:31 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:08.563 09:49:31 -- host/discovery.sh@104 -- # get_notification_count 00:26:08.563 09:49:31 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:08.563 09:49:31 -- host/discovery.sh@74 -- # jq '. | length' 00:26:08.563 09:49:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.563 09:49:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.563 09:49:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.563 09:49:31 -- host/discovery.sh@74 -- # notification_count=1 00:26:08.563 09:49:31 -- host/discovery.sh@75 -- # notify_id=1 00:26:08.563 09:49:31 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:08.563 09:49:31 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:08.563 09:49:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.563 09:49:31 -- common/autotest_common.sh@10 -- # set +x 00:26:08.563 09:49:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.563 09:49:31 -- host/discovery.sh@109 -- # sleep 1 00:26:09.496 09:49:32 -- host/discovery.sh@110 -- # get_bdev_list 00:26:09.496 09:49:32 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:09.496 09:49:32 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:09.496 09:49:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.496 09:49:32 -- host/discovery.sh@55 -- # sort 00:26:09.496 09:49:32 -- common/autotest_common.sh@10 -- # set +x 00:26:09.496 09:49:32 -- host/discovery.sh@55 -- # xargs 00:26:09.753 09:49:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.753 09:49:32 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:09.753 09:49:32 -- host/discovery.sh@111 -- # get_notification_count 00:26:09.753 09:49:32 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:09.753 09:49:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.753 09:49:32 -- host/discovery.sh@74 -- # jq '. | length' 00:26:09.753 09:49:32 -- common/autotest_common.sh@10 -- # set +x 00:26:09.753 09:49:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.753 09:49:32 -- host/discovery.sh@74 -- # notification_count=1 00:26:09.753 09:49:32 -- host/discovery.sh@75 -- # notify_id=2 00:26:09.753 09:49:32 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:09.753 09:49:32 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:09.753 09:49:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.753 09:49:32 -- common/autotest_common.sh@10 -- # set +x 00:26:09.753 [2024-11-29 09:49:32.416564] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:09.753 [2024-11-29 09:49:32.417199] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:09.753 [2024-11-29 09:49:32.417238] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:09.753 09:49:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.753 09:49:32 -- host/discovery.sh@117 -- # sleep 1 00:26:09.754 [2024-11-29 09:49:32.544645] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:10.012 [2024-11-29 09:49:32.605117] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:10.012 [2024-11-29 09:49:32.605142] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:10.012 [2024-11-29 09:49:32.605153] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:10.946 09:49:33 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:10.946 09:49:33 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:10.946 09:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.946 09:49:33 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:10.946 09:49:33 -- common/autotest_common.sh@10 -- # set +x 00:26:10.946 09:49:33 -- host/discovery.sh@59 -- # sort 00:26:10.946 09:49:33 -- host/discovery.sh@59 -- # xargs 00:26:10.946 09:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.946 09:49:33 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:10.946 09:49:33 -- host/discovery.sh@119 -- # get_bdev_list 00:26:10.946 09:49:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:10.946 09:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.946 09:49:33 -- common/autotest_common.sh@10 -- # set +x 00:26:10.946 09:49:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:10.946 09:49:33 -- host/discovery.sh@55 -- # sort 00:26:10.946 09:49:33 -- host/discovery.sh@55 -- # xargs 00:26:10.946 09:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.946 09:49:33 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:10.946 09:49:33 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:10.946 09:49:33 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:10.946 09:49:33 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:10.946 09:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.946 09:49:33 -- common/autotest_common.sh@10 -- # set +x 00:26:10.946 09:49:33 -- host/discovery.sh@63 -- # sort -n 00:26:10.946 09:49:33 -- host/discovery.sh@63 -- # xargs 00:26:10.946 09:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.946 09:49:33 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:10.946 09:49:33 -- host/discovery.sh@121 -- # get_notification_count 00:26:10.946 09:49:33 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:10.946 09:49:33 -- host/discovery.sh@74 -- # jq '. | length' 00:26:10.946 09:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.946 09:49:33 -- common/autotest_common.sh@10 -- # set +x 00:26:10.946 09:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.946 09:49:33 -- host/discovery.sh@74 -- # notification_count=0 00:26:10.946 09:49:33 -- host/discovery.sh@75 -- # notify_id=2 00:26:10.946 09:49:33 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:10.946 09:49:33 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:10.946 09:49:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.946 09:49:33 -- common/autotest_common.sh@10 -- # set +x 00:26:10.946 [2024-11-29 09:49:33.588730] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:10.946 [2024-11-29 09:49:33.588780] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:10.946 [2024-11-29 09:49:33.589250] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:10.946 [2024-11-29 09:49:33.589294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:10.946 [2024-11-29 09:49:33.589316] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:10.946 [2024-11-29 09:49:33.589332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:10.946 [2024-11-29 09:49:33.589348] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:10.946 [2024-11-29 09:49:33.589363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:10.946 [2024-11-29 09:49:33.589379] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:10.946 [2024-11-29 09:49:33.589404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:10.946 [2024-11-29 09:49:33.589458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:10.946 09:49:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.946 09:49:33 -- host/discovery.sh@127 -- # sleep 1 00:26:10.946 [2024-11-29 09:49:33.599247] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:10.946 [2024-11-29 09:49:33.609294] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:10.946 [2024-11-29 09:49:33.609562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:10.946 [2024-11-29 09:49:33.609727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:10.946 [2024-11-29 09:49:33.609758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c4810 with addr=10.0.0.2, port=4420 00:26:10.946 [2024-11-29 09:49:33.609778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:10.946 [2024-11-29 09:49:33.609804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:10.946 [2024-11-29 09:49:33.609842] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:10.946 [2024-11-29 09:49:33.609864] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:10.946 [2024-11-29 09:49:33.609882] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:10.946 [2024-11-29 09:49:33.609905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:10.946 [2024-11-29 09:49:33.619376] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:10.946 [2024-11-29 09:49:33.619614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:10.946 [2024-11-29 09:49:33.619761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:10.946 [2024-11-29 09:49:33.619792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c4810 with addr=10.0.0.2, port=4420 00:26:10.946 [2024-11-29 09:49:33.619810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:10.946 [2024-11-29 09:49:33.619835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:10.946 [2024-11-29 09:49:33.619857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:10.946 [2024-11-29 09:49:33.619872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:10.946 [2024-11-29 09:49:33.619898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:10.946 [2024-11-29 09:49:33.619936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:10.946 [2024-11-29 09:49:33.629465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:10.946 [2024-11-29 09:49:33.629659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:10.946 [2024-11-29 09:49:33.629835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:10.946 [2024-11-29 09:49:33.629865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c4810 with addr=10.0.0.2, port=4420 00:26:10.946 [2024-11-29 09:49:33.629883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:10.946 [2024-11-29 09:49:33.629907] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:10.946 [2024-11-29 09:49:33.629942] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:10.947 [2024-11-29 09:49:33.629962] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:10.947 [2024-11-29 09:49:33.629984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:10.947 [2024-11-29 09:49:33.630006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:10.947 [2024-11-29 09:49:33.639534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:10.947 [2024-11-29 09:49:33.639767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:10.947 [2024-11-29 09:49:33.639933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:10.947 [2024-11-29 09:49:33.639960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c4810 with addr=10.0.0.2, port=4420 00:26:10.947 [2024-11-29 09:49:33.639976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:10.947 [2024-11-29 09:49:33.639999] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:10.947 [2024-11-29 09:49:33.640061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:10.947 [2024-11-29 09:49:33.640085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:10.947 [2024-11-29 09:49:33.640101] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:10.947 [2024-11-29 09:49:33.640122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:10.947 [2024-11-29 09:49:33.649604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:10.947 [2024-11-29 09:49:33.649786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:10.947 [2024-11-29 09:49:33.649924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:10.947 [2024-11-29 09:49:33.649955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c4810 with addr=10.0.0.2, port=4420 00:26:10.947 [2024-11-29 09:49:33.649973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:10.947 [2024-11-29 09:49:33.649998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:10.947 [2024-11-29 09:49:33.650021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:10.947 [2024-11-29 09:49:33.650037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:10.947 [2024-11-29 09:49:33.650052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:10.947 [2024-11-29 09:49:33.650074] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:10.947 [2024-11-29 09:49:33.659691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:10.947 [2024-11-29 09:49:33.659882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:10.947 [2024-11-29 09:49:33.660017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:10.947 [2024-11-29 09:49:33.660047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c4810 with addr=10.0.0.2, port=4420 00:26:10.947 [2024-11-29 09:49:33.660066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:10.947 [2024-11-29 09:49:33.660091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:10.947 [2024-11-29 09:49:33.660126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:10.947 [2024-11-29 09:49:33.660146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:10.947 [2024-11-29 09:49:33.660163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:10.947 [2024-11-29 09:49:33.660204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:10.947 [2024-11-29 09:49:33.669769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:10.947 [2024-11-29 09:49:33.669929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:10.947 [2024-11-29 09:49:33.670094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:10.947 [2024-11-29 09:49:33.670133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5c4810 with addr=10.0.0.2, port=4420 00:26:10.947 [2024-11-29 09:49:33.670151] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c4810 is same with the state(5) to be set 00:26:10.947 [2024-11-29 09:49:33.670176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5c4810 (9): Bad file descriptor 00:26:10.947 [2024-11-29 09:49:33.670213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:10.947 [2024-11-29 09:49:33.670234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:10.947 [2024-11-29 09:49:33.670249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:10.947 [2024-11-29 09:49:33.670272] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:10.947 [2024-11-29 09:49:33.675217] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:10.947 [2024-11-29 09:49:33.675247] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:11.882 09:49:34 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:11.882 09:49:34 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:11.882 09:49:34 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:11.882 09:49:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.882 09:49:34 -- common/autotest_common.sh@10 -- # set +x 00:26:11.882 09:49:34 -- host/discovery.sh@59 -- # sort 00:26:11.882 09:49:34 -- host/discovery.sh@59 -- # xargs 00:26:11.882 09:49:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.882 09:49:34 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:11.882 09:49:34 -- host/discovery.sh@129 -- # get_bdev_list 00:26:11.882 09:49:34 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:11.882 09:49:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.882 09:49:34 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:11.882 09:49:34 -- common/autotest_common.sh@10 -- # set +x 00:26:11.882 09:49:34 -- host/discovery.sh@55 -- # sort 00:26:11.882 09:49:34 -- host/discovery.sh@55 -- # xargs 00:26:11.882 09:49:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.882 09:49:34 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:11.882 09:49:34 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:11.882 09:49:34 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:11.882 09:49:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.882 09:49:34 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:11.882 09:49:34 -- common/autotest_common.sh@10 -- # set +x 00:26:11.882 09:49:34 -- host/discovery.sh@63 -- # sort -n 00:26:11.882 09:49:34 -- host/discovery.sh@63 -- # xargs 00:26:11.882 09:49:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.882 09:49:34 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:11.882 09:49:34 -- host/discovery.sh@131 -- # get_notification_count 00:26:11.882 09:49:34 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:11.882 09:49:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.882 09:49:34 -- host/discovery.sh@74 -- # jq '. | length' 00:26:11.882 09:49:34 -- common/autotest_common.sh@10 -- # set +x 00:26:11.882 09:49:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.140 09:49:34 -- host/discovery.sh@74 -- # notification_count=0 00:26:12.140 09:49:34 -- host/discovery.sh@75 -- # notify_id=2 00:26:12.140 09:49:34 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:12.140 09:49:34 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:12.140 09:49:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.140 09:49:34 -- common/autotest_common.sh@10 -- # set +x 00:26:12.140 09:49:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.140 09:49:34 -- host/discovery.sh@135 -- # sleep 1 00:26:13.071 09:49:35 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:13.071 09:49:35 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:13.071 09:49:35 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:13.071 09:49:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.071 09:49:35 -- common/autotest_common.sh@10 -- # set +x 00:26:13.071 09:49:35 -- host/discovery.sh@59 -- # sort 00:26:13.071 09:49:35 -- host/discovery.sh@59 -- # xargs 00:26:13.071 09:49:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.071 09:49:35 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:13.071 09:49:35 -- host/discovery.sh@137 -- # get_bdev_list 00:26:13.071 09:49:35 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:13.071 09:49:35 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:13.071 09:49:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.071 09:49:35 -- common/autotest_common.sh@10 -- # set +x 00:26:13.071 09:49:35 -- host/discovery.sh@55 -- # sort 00:26:13.071 09:49:35 -- host/discovery.sh@55 -- # xargs 00:26:13.071 09:49:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.071 09:49:35 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:13.071 09:49:35 -- host/discovery.sh@138 -- # get_notification_count 00:26:13.071 09:49:35 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:13.071 09:49:35 -- host/discovery.sh@74 -- # jq '. | length' 00:26:13.071 09:49:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.071 09:49:35 -- common/autotest_common.sh@10 -- # set +x 00:26:13.071 09:49:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.071 09:49:35 -- host/discovery.sh@74 -- # notification_count=2 00:26:13.071 09:49:35 -- host/discovery.sh@75 -- # notify_id=4 00:26:13.071 09:49:35 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:13.072 09:49:35 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.072 09:49:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.072 09:49:35 -- common/autotest_common.sh@10 -- # set +x 00:26:14.444 [2024-11-29 09:49:36.944511] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:14.444 [2024-11-29 09:49:36.944536] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:14.444 [2024-11-29 09:49:36.944559] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:14.444 [2024-11-29 09:49:37.031841] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:14.444 [2024-11-29 09:49:37.260593] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:14.444 [2024-11-29 09:49:37.260627] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:14.444 09:49:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.444 09:49:37 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:14.444 09:49:37 -- common/autotest_common.sh@650 -- # local es=0 00:26:14.444 09:49:37 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:14.444 09:49:37 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:14.444 09:49:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:14.444 09:49:37 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:14.444 09:49:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:14.444 09:49:37 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:14.444 09:49:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.444 09:49:37 -- common/autotest_common.sh@10 -- # set +x 00:26:14.444 request: 00:26:14.444 { 00:26:14.444 "name": "nvme", 00:26:14.444 "trtype": "tcp", 00:26:14.444 "traddr": "10.0.0.2", 00:26:14.444 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:14.444 "adrfam": "ipv4", 00:26:14.444 "trsvcid": "8009", 00:26:14.444 "wait_for_attach": true, 00:26:14.444 "method": "bdev_nvme_start_discovery", 00:26:14.444 "req_id": 1 00:26:14.444 } 00:26:14.444 Got JSON-RPC error response 00:26:14.444 response: 00:26:14.444 { 00:26:14.444 "code": -17, 00:26:14.444 "message": "File exists" 00:26:14.444 } 00:26:14.444 09:49:37 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:14.444 09:49:37 -- common/autotest_common.sh@653 -- # es=1 00:26:14.444 09:49:37 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:14.444 09:49:37 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:14.444 09:49:37 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:14.444 09:49:37 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:14.444 09:49:37 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:14.444 09:49:37 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:14.444 09:49:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.444 09:49:37 -- common/autotest_common.sh@10 -- # set +x 00:26:14.444 09:49:37 -- host/discovery.sh@67 -- # sort 00:26:14.444 09:49:37 -- host/discovery.sh@67 -- # xargs 00:26:14.702 09:49:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.702 09:49:37 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:14.702 09:49:37 -- host/discovery.sh@147 -- # get_bdev_list 00:26:14.702 09:49:37 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:14.702 09:49:37 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:14.702 09:49:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.702 09:49:37 -- common/autotest_common.sh@10 -- # set +x 00:26:14.702 09:49:37 -- host/discovery.sh@55 -- # sort 00:26:14.702 09:49:37 -- host/discovery.sh@55 -- # xargs 00:26:14.702 09:49:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.702 09:49:37 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:14.702 09:49:37 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:14.702 09:49:37 -- common/autotest_common.sh@650 -- # local es=0 00:26:14.702 09:49:37 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:14.702 09:49:37 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:14.702 09:49:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:14.702 09:49:37 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:14.702 09:49:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:14.702 09:49:37 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:14.702 09:49:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.702 09:49:37 -- common/autotest_common.sh@10 -- # set +x 00:26:14.702 request: 00:26:14.702 { 00:26:14.702 "name": "nvme_second", 00:26:14.702 "trtype": "tcp", 00:26:14.702 "traddr": "10.0.0.2", 00:26:14.702 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:14.702 "adrfam": "ipv4", 00:26:14.702 "trsvcid": "8009", 00:26:14.702 "wait_for_attach": true, 00:26:14.702 "method": "bdev_nvme_start_discovery", 00:26:14.702 "req_id": 1 00:26:14.702 } 00:26:14.702 Got JSON-RPC error response 00:26:14.702 response: 00:26:14.702 { 00:26:14.702 "code": -17, 00:26:14.702 "message": "File exists" 00:26:14.702 } 00:26:14.702 09:49:37 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:14.702 09:49:37 -- common/autotest_common.sh@653 -- # es=1 00:26:14.702 09:49:37 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:14.702 09:49:37 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:14.702 09:49:37 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:14.702 09:49:37 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:14.702 09:49:37 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:14.702 09:49:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.702 09:49:37 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:14.702 09:49:37 -- common/autotest_common.sh@10 -- # set +x 00:26:14.702 09:49:37 -- host/discovery.sh@67 -- # sort 00:26:14.702 09:49:37 -- host/discovery.sh@67 -- # xargs 00:26:14.702 09:49:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.702 09:49:37 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:14.702 09:49:37 -- host/discovery.sh@153 -- # get_bdev_list 00:26:14.702 09:49:37 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:14.702 09:49:37 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:14.702 09:49:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.702 09:49:37 -- common/autotest_common.sh@10 -- # set +x 00:26:14.702 09:49:37 -- host/discovery.sh@55 -- # sort 00:26:14.702 09:49:37 -- host/discovery.sh@55 -- # xargs 00:26:14.702 09:49:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:14.702 09:49:37 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:14.702 09:49:37 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:14.702 09:49:37 -- common/autotest_common.sh@650 -- # local es=0 00:26:14.702 09:49:37 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:14.702 09:49:37 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:14.702 09:49:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:14.702 09:49:37 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:14.702 09:49:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:14.702 09:49:37 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:14.702 09:49:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:14.702 09:49:37 -- common/autotest_common.sh@10 -- # set +x 00:26:15.634 [2024-11-29 09:49:38.460263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.634 [2024-11-29 09:49:38.460453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.634 [2024-11-29 09:49:38.460484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5e83d0 with addr=10.0.0.2, port=8010 00:26:15.634 [2024-11-29 09:49:38.460517] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:15.634 [2024-11-29 09:49:38.460533] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:15.634 [2024-11-29 09:49:38.460547] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:17.009 [2024-11-29 09:49:39.462734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:17.009 [2024-11-29 09:49:39.462932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:17.009 [2024-11-29 09:49:39.462959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5b4d30 with addr=10.0.0.2, port=8010 00:26:17.009 [2024-11-29 09:49:39.462992] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:17.009 [2024-11-29 09:49:39.463007] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:17.009 [2024-11-29 09:49:39.463022] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:17.943 [2024-11-29 09:49:40.464901] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:17.943 request: 00:26:17.943 { 00:26:17.943 "name": "nvme_second", 00:26:17.943 "trtype": "tcp", 00:26:17.943 "traddr": "10.0.0.2", 00:26:17.943 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:17.943 "adrfam": "ipv4", 00:26:17.943 "trsvcid": "8010", 00:26:17.943 "attach_timeout_ms": 3000, 00:26:17.943 "method": "bdev_nvme_start_discovery", 00:26:17.943 "req_id": 1 00:26:17.943 } 00:26:17.943 Got JSON-RPC error response 00:26:17.943 response: 00:26:17.943 { 00:26:17.943 "code": -110, 00:26:17.943 "message": "Connection timed out" 00:26:17.943 } 00:26:17.943 09:49:40 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:17.943 09:49:40 -- common/autotest_common.sh@653 -- # es=1 00:26:17.943 09:49:40 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:17.943 09:49:40 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:17.943 09:49:40 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:17.943 09:49:40 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:17.943 09:49:40 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:17.943 09:49:40 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:17.943 09:49:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.943 09:49:40 -- common/autotest_common.sh@10 -- # set +x 00:26:17.943 09:49:40 -- host/discovery.sh@67 -- # sort 00:26:17.943 09:49:40 -- host/discovery.sh@67 -- # xargs 00:26:17.943 09:49:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.943 09:49:40 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:17.943 09:49:40 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:17.943 09:49:40 -- host/discovery.sh@162 -- # kill 130795 00:26:17.943 09:49:40 -- host/discovery.sh@163 -- # nvmftestfini 00:26:17.943 09:49:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:17.943 09:49:40 -- nvmf/common.sh@116 -- # sync 00:26:17.943 09:49:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:17.943 09:49:40 -- nvmf/common.sh@119 -- # set +e 00:26:17.943 09:49:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:17.943 09:49:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:17.943 rmmod nvme_tcp 00:26:17.943 rmmod nvme_fabrics 00:26:17.943 rmmod nvme_keyring 00:26:17.943 09:49:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:17.943 09:49:40 -- nvmf/common.sh@123 -- # set -e 00:26:17.943 09:49:40 -- nvmf/common.sh@124 -- # return 0 00:26:17.943 09:49:40 -- nvmf/common.sh@477 -- # '[' -n 130643 ']' 00:26:17.943 09:49:40 -- nvmf/common.sh@478 -- # killprocess 130643 00:26:17.943 09:49:40 -- common/autotest_common.sh@936 -- # '[' -z 130643 ']' 00:26:17.943 09:49:40 -- common/autotest_common.sh@940 -- # kill -0 130643 00:26:17.943 09:49:40 -- common/autotest_common.sh@941 -- # uname 00:26:17.943 09:49:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:17.943 09:49:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 130643 00:26:17.943 09:49:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:17.943 09:49:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:17.943 09:49:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 130643' 00:26:17.943 killing process with pid 130643 00:26:17.943 09:49:40 -- common/autotest_common.sh@955 -- # kill 130643 00:26:17.943 09:49:40 -- common/autotest_common.sh@960 -- # wait 130643 00:26:18.203 09:49:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:18.203 09:49:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:18.203 09:49:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:18.203 09:49:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:18.203 09:49:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:18.203 09:49:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:18.203 09:49:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:18.203 09:49:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:20.108 09:49:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:20.108 00:26:20.108 real 0m17.782s 00:26:20.108 user 0m27.483s 00:26:20.108 sys 0m2.913s 00:26:20.108 09:49:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:20.108 09:49:42 -- common/autotest_common.sh@10 -- # set +x 00:26:20.108 ************************************ 00:26:20.108 END TEST nvmf_discovery 00:26:20.108 ************************************ 00:26:20.108 09:49:42 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:20.108 09:49:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:20.108 09:49:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:20.108 09:49:42 -- common/autotest_common.sh@10 -- # set +x 00:26:20.108 ************************************ 00:26:20.108 START TEST nvmf_discovery_remove_ifc 00:26:20.108 ************************************ 00:26:20.108 09:49:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:20.367 * Looking for test storage... 00:26:20.367 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:20.367 09:49:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:20.367 09:49:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:20.367 09:49:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:20.367 09:49:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:20.367 09:49:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:20.367 09:49:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:20.367 09:49:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:20.367 09:49:43 -- scripts/common.sh@335 -- # IFS=.-: 00:26:20.367 09:49:43 -- scripts/common.sh@335 -- # read -ra ver1 00:26:20.367 09:49:43 -- scripts/common.sh@336 -- # IFS=.-: 00:26:20.367 09:49:43 -- scripts/common.sh@336 -- # read -ra ver2 00:26:20.367 09:49:43 -- scripts/common.sh@337 -- # local 'op=<' 00:26:20.367 09:49:43 -- scripts/common.sh@339 -- # ver1_l=2 00:26:20.367 09:49:43 -- scripts/common.sh@340 -- # ver2_l=1 00:26:20.367 09:49:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:20.367 09:49:43 -- scripts/common.sh@343 -- # case "$op" in 00:26:20.367 09:49:43 -- scripts/common.sh@344 -- # : 1 00:26:20.367 09:49:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:20.367 09:49:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:20.367 09:49:43 -- scripts/common.sh@364 -- # decimal 1 00:26:20.367 09:49:43 -- scripts/common.sh@352 -- # local d=1 00:26:20.367 09:49:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:20.367 09:49:43 -- scripts/common.sh@354 -- # echo 1 00:26:20.367 09:49:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:20.367 09:49:43 -- scripts/common.sh@365 -- # decimal 2 00:26:20.367 09:49:43 -- scripts/common.sh@352 -- # local d=2 00:26:20.367 09:49:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:20.367 09:49:43 -- scripts/common.sh@354 -- # echo 2 00:26:20.367 09:49:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:20.367 09:49:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:20.367 09:49:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:20.367 09:49:43 -- scripts/common.sh@367 -- # return 0 00:26:20.367 09:49:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:20.367 09:49:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:20.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:20.367 --rc genhtml_branch_coverage=1 00:26:20.367 --rc genhtml_function_coverage=1 00:26:20.367 --rc genhtml_legend=1 00:26:20.367 --rc geninfo_all_blocks=1 00:26:20.367 --rc geninfo_unexecuted_blocks=1 00:26:20.367 00:26:20.367 ' 00:26:20.367 09:49:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:20.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:20.367 --rc genhtml_branch_coverage=1 00:26:20.367 --rc genhtml_function_coverage=1 00:26:20.367 --rc genhtml_legend=1 00:26:20.367 --rc geninfo_all_blocks=1 00:26:20.367 --rc geninfo_unexecuted_blocks=1 00:26:20.367 00:26:20.367 ' 00:26:20.367 09:49:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:20.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:20.367 --rc genhtml_branch_coverage=1 00:26:20.367 --rc genhtml_function_coverage=1 00:26:20.367 --rc genhtml_legend=1 00:26:20.367 --rc geninfo_all_blocks=1 00:26:20.367 --rc geninfo_unexecuted_blocks=1 00:26:20.367 00:26:20.367 ' 00:26:20.367 09:49:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:20.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:20.367 --rc genhtml_branch_coverage=1 00:26:20.367 --rc genhtml_function_coverage=1 00:26:20.367 --rc genhtml_legend=1 00:26:20.367 --rc geninfo_all_blocks=1 00:26:20.367 --rc geninfo_unexecuted_blocks=1 00:26:20.367 00:26:20.367 ' 00:26:20.367 09:49:43 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:20.367 09:49:43 -- nvmf/common.sh@7 -- # uname -s 00:26:20.367 09:49:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:20.367 09:49:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:20.367 09:49:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:20.367 09:49:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:20.367 09:49:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:20.367 09:49:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:20.367 09:49:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:20.367 09:49:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:20.367 09:49:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:20.367 09:49:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:20.367 09:49:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:20.367 09:49:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:20.367 09:49:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:20.367 09:49:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:20.367 09:49:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:20.367 09:49:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:20.367 09:49:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:20.367 09:49:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:20.367 09:49:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:20.367 09:49:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:20.367 09:49:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:20.367 09:49:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:20.367 09:49:43 -- paths/export.sh@5 -- # export PATH 00:26:20.367 09:49:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:20.367 09:49:43 -- nvmf/common.sh@46 -- # : 0 00:26:20.367 09:49:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:20.367 09:49:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:20.367 09:49:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:20.367 09:49:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:20.367 09:49:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:20.367 09:49:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:20.367 09:49:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:20.367 09:49:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:20.367 09:49:43 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:20.367 09:49:43 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:20.367 09:49:43 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:20.367 09:49:43 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:20.367 09:49:43 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:20.367 09:49:43 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:20.367 09:49:43 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:20.367 09:49:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:20.367 09:49:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:20.367 09:49:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:20.367 09:49:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:20.367 09:49:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:20.368 09:49:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:20.368 09:49:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:20.368 09:49:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:20.368 09:49:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:20.368 09:49:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:20.368 09:49:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:20.368 09:49:43 -- common/autotest_common.sh@10 -- # set +x 00:26:22.330 09:49:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:22.330 09:49:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:22.330 09:49:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:22.330 09:49:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:22.330 09:49:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:22.330 09:49:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:22.330 09:49:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:22.330 09:49:45 -- nvmf/common.sh@294 -- # net_devs=() 00:26:22.330 09:49:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:22.330 09:49:45 -- nvmf/common.sh@295 -- # e810=() 00:26:22.330 09:49:45 -- nvmf/common.sh@295 -- # local -ga e810 00:26:22.330 09:49:45 -- nvmf/common.sh@296 -- # x722=() 00:26:22.330 09:49:45 -- nvmf/common.sh@296 -- # local -ga x722 00:26:22.330 09:49:45 -- nvmf/common.sh@297 -- # mlx=() 00:26:22.330 09:49:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:22.330 09:49:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:22.330 09:49:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:22.330 09:49:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:22.330 09:49:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:22.330 09:49:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:22.330 09:49:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:22.330 09:49:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:22.330 09:49:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:22.330 09:49:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:22.330 09:49:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:22.330 09:49:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:22.330 09:49:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:22.330 09:49:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:22.330 09:49:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:22.330 09:49:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:22.330 09:49:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:22.330 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:22.330 09:49:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:22.330 09:49:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:22.330 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:22.330 09:49:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:22.330 09:49:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:22.330 09:49:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:22.330 09:49:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:22.330 09:49:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:22.588 09:49:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:22.588 09:49:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:22.588 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:22.588 09:49:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:22.588 09:49:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:22.588 09:49:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:22.588 09:49:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:22.588 09:49:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:22.588 09:49:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:22.588 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:22.588 09:49:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:22.588 09:49:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:22.588 09:49:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:22.588 09:49:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:22.588 09:49:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:22.588 09:49:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:22.588 09:49:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:22.589 09:49:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:22.589 09:49:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:22.589 09:49:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:22.589 09:49:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:22.589 09:49:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:22.589 09:49:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:22.589 09:49:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:22.589 09:49:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:22.589 09:49:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:22.589 09:49:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:22.589 09:49:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:22.589 09:49:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:22.589 09:49:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:22.589 09:49:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:22.589 09:49:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:22.589 09:49:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:22.589 09:49:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:22.589 09:49:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:22.589 09:49:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:22.589 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:22.589 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.150 ms 00:26:22.589 00:26:22.589 --- 10.0.0.2 ping statistics --- 00:26:22.589 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:22.589 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:26:22.589 09:49:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:22.589 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:22.589 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:26:22.589 00:26:22.589 --- 10.0.0.1 ping statistics --- 00:26:22.589 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:22.589 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:26:22.589 09:49:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:22.589 09:49:45 -- nvmf/common.sh@410 -- # return 0 00:26:22.589 09:49:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:22.589 09:49:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:22.589 09:49:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:22.589 09:49:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:22.589 09:49:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:22.589 09:49:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:22.589 09:49:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:22.589 09:49:45 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:22.589 09:49:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:22.589 09:49:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:22.589 09:49:45 -- common/autotest_common.sh@10 -- # set +x 00:26:22.589 09:49:45 -- nvmf/common.sh@469 -- # nvmfpid=134400 00:26:22.589 09:49:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:22.589 09:49:45 -- nvmf/common.sh@470 -- # waitforlisten 134400 00:26:22.589 09:49:45 -- common/autotest_common.sh@829 -- # '[' -z 134400 ']' 00:26:22.589 09:49:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:22.589 09:49:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:22.589 09:49:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:22.589 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:22.589 09:49:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:22.589 09:49:45 -- common/autotest_common.sh@10 -- # set +x 00:26:22.589 [2024-11-29 09:49:45.368712] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:22.589 [2024-11-29 09:49:45.368812] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:22.589 EAL: No free 2048 kB hugepages reported on node 1 00:26:22.847 [2024-11-29 09:49:45.436953] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:22.847 [2024-11-29 09:49:45.550631] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:22.847 [2024-11-29 09:49:45.550815] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:22.847 [2024-11-29 09:49:45.550842] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:22.847 [2024-11-29 09:49:45.550857] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:22.847 [2024-11-29 09:49:45.550889] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:23.781 09:49:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:23.781 09:49:46 -- common/autotest_common.sh@862 -- # return 0 00:26:23.781 09:49:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:23.781 09:49:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:23.781 09:49:46 -- common/autotest_common.sh@10 -- # set +x 00:26:23.781 09:49:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:23.781 09:49:46 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:23.781 09:49:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.781 09:49:46 -- common/autotest_common.sh@10 -- # set +x 00:26:23.781 [2024-11-29 09:49:46.361188] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:23.781 [2024-11-29 09:49:46.369370] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:23.781 null0 00:26:23.781 [2024-11-29 09:49:46.401345] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:23.781 09:49:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.781 09:49:46 -- host/discovery_remove_ifc.sh@59 -- # hostpid=134553 00:26:23.781 09:49:46 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:23.781 09:49:46 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 134553 /tmp/host.sock 00:26:23.781 09:49:46 -- common/autotest_common.sh@829 -- # '[' -z 134553 ']' 00:26:23.781 09:49:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:23.781 09:49:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:23.781 09:49:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:23.781 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:23.781 09:49:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:23.781 09:49:46 -- common/autotest_common.sh@10 -- # set +x 00:26:23.781 [2024-11-29 09:49:46.461730] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:23.781 [2024-11-29 09:49:46.461821] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid134553 ] 00:26:23.781 EAL: No free 2048 kB hugepages reported on node 1 00:26:23.781 [2024-11-29 09:49:46.523839] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:24.041 [2024-11-29 09:49:46.638691] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:24.041 [2024-11-29 09:49:46.638853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:24.041 09:49:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:24.041 09:49:46 -- common/autotest_common.sh@862 -- # return 0 00:26:24.041 09:49:46 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:24.041 09:49:46 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:24.041 09:49:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.041 09:49:46 -- common/autotest_common.sh@10 -- # set +x 00:26:24.041 09:49:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.041 09:49:46 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:24.041 09:49:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.041 09:49:46 -- common/autotest_common.sh@10 -- # set +x 00:26:24.041 09:49:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.041 09:49:46 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:24.041 09:49:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.041 09:49:46 -- common/autotest_common.sh@10 -- # set +x 00:26:25.424 [2024-11-29 09:49:47.849065] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:25.424 [2024-11-29 09:49:47.849094] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:25.424 [2024-11-29 09:49:47.849116] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:25.424 [2024-11-29 09:49:47.975561] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:25.424 [2024-11-29 09:49:48.040102] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:25.424 [2024-11-29 09:49:48.040158] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:25.424 [2024-11-29 09:49:48.040200] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:25.424 [2024-11-29 09:49:48.040224] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:25.424 [2024-11-29 09:49:48.040250] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:25.424 09:49:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.424 09:49:48 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:25.424 09:49:48 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:25.424 09:49:48 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:25.424 09:49:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.424 09:49:48 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:25.424 09:49:48 -- common/autotest_common.sh@10 -- # set +x 00:26:25.424 09:49:48 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:25.424 09:49:48 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:25.424 [2024-11-29 09:49:48.047191] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x2219d40 was disconnected and freed. delete nvme_qpair. 00:26:25.424 09:49:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.424 09:49:48 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:25.424 09:49:48 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:25.424 09:49:48 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:25.424 09:49:48 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:25.424 09:49:48 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:25.424 09:49:48 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:25.424 09:49:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.424 09:49:48 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:25.424 09:49:48 -- common/autotest_common.sh@10 -- # set +x 00:26:25.424 09:49:48 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:25.425 09:49:48 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:25.425 09:49:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.425 09:49:48 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:25.425 09:49:48 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:26.360 09:49:49 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:26.360 09:49:49 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:26.360 09:49:49 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:26.360 09:49:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.360 09:49:49 -- common/autotest_common.sh@10 -- # set +x 00:26:26.360 09:49:49 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:26.360 09:49:49 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:26.360 09:49:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.618 09:49:49 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:26.618 09:49:49 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:27.555 09:49:50 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:27.555 09:49:50 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:27.555 09:49:50 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:27.555 09:49:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.555 09:49:50 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:27.555 09:49:50 -- common/autotest_common.sh@10 -- # set +x 00:26:27.555 09:49:50 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:27.555 09:49:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.555 09:49:50 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:27.555 09:49:50 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:28.494 09:49:51 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:28.494 09:49:51 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:28.494 09:49:51 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:28.494 09:49:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.494 09:49:51 -- common/autotest_common.sh@10 -- # set +x 00:26:28.494 09:49:51 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:28.494 09:49:51 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:28.494 09:49:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.494 09:49:51 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:28.494 09:49:51 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:29.870 09:49:52 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:29.870 09:49:52 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:29.870 09:49:52 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:29.870 09:49:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:29.870 09:49:52 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:29.870 09:49:52 -- common/autotest_common.sh@10 -- # set +x 00:26:29.870 09:49:52 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:29.870 09:49:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:29.870 09:49:52 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:29.870 09:49:52 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:30.804 09:49:53 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:30.804 09:49:53 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:30.804 09:49:53 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:30.804 09:49:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.804 09:49:53 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:30.804 09:49:53 -- common/autotest_common.sh@10 -- # set +x 00:26:30.804 09:49:53 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:30.804 09:49:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:30.804 09:49:53 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:30.804 09:49:53 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:30.804 [2024-11-29 09:49:53.481417] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:30.804 [2024-11-29 09:49:53.481504] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:30.804 [2024-11-29 09:49:53.481526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:30.804 [2024-11-29 09:49:53.481542] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:30.804 [2024-11-29 09:49:53.481555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:30.804 [2024-11-29 09:49:53.481568] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:30.804 [2024-11-29 09:49:53.481580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:30.804 [2024-11-29 09:49:53.481593] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:30.804 [2024-11-29 09:49:53.481606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:30.804 [2024-11-29 09:49:53.481619] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:30.804 [2024-11-29 09:49:53.481632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:30.804 [2024-11-29 09:49:53.481645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0430 is same with the state(5) to be set 00:26:30.804 [2024-11-29 09:49:53.491444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21e0430 (9): Bad file descriptor 00:26:30.804 [2024-11-29 09:49:53.501489] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:31.739 09:49:54 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:31.739 09:49:54 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:31.739 09:49:54 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:31.739 09:49:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:31.739 09:49:54 -- common/autotest_common.sh@10 -- # set +x 00:26:31.739 09:49:54 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:31.739 09:49:54 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:31.739 [2024-11-29 09:49:54.538422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:33.114 [2024-11-29 09:49:55.562431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:33.114 [2024-11-29 09:49:55.562495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21e0430 with addr=10.0.0.2, port=4420 00:26:33.114 [2024-11-29 09:49:55.562521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e0430 is same with the state(5) to be set 00:26:33.114 [2024-11-29 09:49:55.562556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:33.114 [2024-11-29 09:49:55.562573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:33.114 [2024-11-29 09:49:55.562587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:33.114 [2024-11-29 09:49:55.562604] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:33.114 [2024-11-29 09:49:55.562974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21e0430 (9): Bad file descriptor 00:26:33.114 [2024-11-29 09:49:55.563015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:33.114 [2024-11-29 09:49:55.563054] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:33.114 [2024-11-29 09:49:55.563092] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:33.114 [2024-11-29 09:49:55.563115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:33.114 [2024-11-29 09:49:55.563134] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:33.114 [2024-11-29 09:49:55.563150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:33.114 [2024-11-29 09:49:55.563165] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:33.114 [2024-11-29 09:49:55.563180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:33.114 [2024-11-29 09:49:55.563194] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:33.114 [2024-11-29 09:49:55.563209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:33.114 [2024-11-29 09:49:55.563225] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:33.114 [2024-11-29 09:49:55.563239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:33.114 [2024-11-29 09:49:55.563254] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:33.114 [2024-11-29 09:49:55.563557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21e0840 (9): Bad file descriptor 00:26:33.114 [2024-11-29 09:49:55.564576] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:33.114 [2024-11-29 09:49:55.564598] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:33.114 09:49:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.114 09:49:55 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:33.114 09:49:55 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:34.054 09:49:56 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:34.054 09:49:56 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:34.054 09:49:56 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:34.054 09:49:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.054 09:49:56 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:34.054 09:49:56 -- common/autotest_common.sh@10 -- # set +x 00:26:34.054 09:49:56 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:34.054 09:49:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.054 09:49:56 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:34.055 09:49:56 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:34.055 09:49:56 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:34.055 09:49:56 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:34.055 09:49:56 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:34.055 09:49:56 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:34.055 09:49:56 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:34.055 09:49:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.055 09:49:56 -- common/autotest_common.sh@10 -- # set +x 00:26:34.055 09:49:56 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:34.055 09:49:56 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:34.055 09:49:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.055 09:49:56 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:34.055 09:49:56 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:34.996 [2024-11-29 09:49:57.574417] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:34.996 [2024-11-29 09:49:57.574486] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:34.996 [2024-11-29 09:49:57.574509] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:34.996 [2024-11-29 09:49:57.660766] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:34.996 09:49:57 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:34.996 09:49:57 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:34.996 09:49:57 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:34.996 09:49:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.996 09:49:57 -- common/autotest_common.sh@10 -- # set +x 00:26:34.996 09:49:57 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:34.996 09:49:57 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:34.996 09:49:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.996 09:49:57 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:34.996 09:49:57 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:35.256 [2024-11-29 09:49:57.838145] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:35.256 [2024-11-29 09:49:57.838201] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:35.256 [2024-11-29 09:49:57.838237] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:35.256 [2024-11-29 09:49:57.838261] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:35.256 [2024-11-29 09:49:57.838275] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:35.256 [2024-11-29 09:49:57.843443] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x21eeef0 was disconnected and freed. delete nvme_qpair. 00:26:36.192 09:49:58 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:36.192 09:49:58 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:36.192 09:49:58 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:36.192 09:49:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.192 09:49:58 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:36.192 09:49:58 -- common/autotest_common.sh@10 -- # set +x 00:26:36.192 09:49:58 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:36.192 09:49:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:36.192 09:49:58 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:36.192 09:49:58 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:36.192 09:49:58 -- host/discovery_remove_ifc.sh@90 -- # killprocess 134553 00:26:36.192 09:49:58 -- common/autotest_common.sh@936 -- # '[' -z 134553 ']' 00:26:36.192 09:49:58 -- common/autotest_common.sh@940 -- # kill -0 134553 00:26:36.192 09:49:58 -- common/autotest_common.sh@941 -- # uname 00:26:36.192 09:49:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:36.192 09:49:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 134553 00:26:36.192 09:49:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:36.192 09:49:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:36.192 09:49:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 134553' 00:26:36.192 killing process with pid 134553 00:26:36.192 09:49:58 -- common/autotest_common.sh@955 -- # kill 134553 00:26:36.192 09:49:58 -- common/autotest_common.sh@960 -- # wait 134553 00:26:36.450 09:49:59 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:36.450 09:49:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:36.450 09:49:59 -- nvmf/common.sh@116 -- # sync 00:26:36.450 09:49:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:36.450 09:49:59 -- nvmf/common.sh@119 -- # set +e 00:26:36.450 09:49:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:36.450 09:49:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:36.450 rmmod nvme_tcp 00:26:36.450 rmmod nvme_fabrics 00:26:36.450 rmmod nvme_keyring 00:26:36.450 09:49:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:36.450 09:49:59 -- nvmf/common.sh@123 -- # set -e 00:26:36.450 09:49:59 -- nvmf/common.sh@124 -- # return 0 00:26:36.450 09:49:59 -- nvmf/common.sh@477 -- # '[' -n 134400 ']' 00:26:36.450 09:49:59 -- nvmf/common.sh@478 -- # killprocess 134400 00:26:36.450 09:49:59 -- common/autotest_common.sh@936 -- # '[' -z 134400 ']' 00:26:36.450 09:49:59 -- common/autotest_common.sh@940 -- # kill -0 134400 00:26:36.450 09:49:59 -- common/autotest_common.sh@941 -- # uname 00:26:36.450 09:49:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:36.450 09:49:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 134400 00:26:36.450 09:49:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:36.450 09:49:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:36.450 09:49:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 134400' 00:26:36.450 killing process with pid 134400 00:26:36.450 09:49:59 -- common/autotest_common.sh@955 -- # kill 134400 00:26:36.450 09:49:59 -- common/autotest_common.sh@960 -- # wait 134400 00:26:36.709 09:49:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:36.709 09:49:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:36.709 09:49:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:36.709 09:49:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:36.709 09:49:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:36.709 09:49:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:36.709 09:49:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:36.709 09:49:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:39.243 09:50:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:39.243 00:26:39.243 real 0m18.545s 00:26:39.243 user 0m25.661s 00:26:39.243 sys 0m2.962s 00:26:39.243 09:50:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:39.243 09:50:01 -- common/autotest_common.sh@10 -- # set +x 00:26:39.243 ************************************ 00:26:39.243 END TEST nvmf_discovery_remove_ifc 00:26:39.243 ************************************ 00:26:39.243 09:50:01 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:39.243 09:50:01 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:39.243 09:50:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:39.243 09:50:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:39.243 09:50:01 -- common/autotest_common.sh@10 -- # set +x 00:26:39.243 ************************************ 00:26:39.243 START TEST nvmf_digest 00:26:39.243 ************************************ 00:26:39.243 09:50:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:39.243 * Looking for test storage... 00:26:39.243 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:39.243 09:50:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:39.243 09:50:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:39.243 09:50:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:39.243 09:50:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:39.243 09:50:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:39.243 09:50:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:39.243 09:50:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:39.243 09:50:01 -- scripts/common.sh@335 -- # IFS=.-: 00:26:39.243 09:50:01 -- scripts/common.sh@335 -- # read -ra ver1 00:26:39.243 09:50:01 -- scripts/common.sh@336 -- # IFS=.-: 00:26:39.243 09:50:01 -- scripts/common.sh@336 -- # read -ra ver2 00:26:39.243 09:50:01 -- scripts/common.sh@337 -- # local 'op=<' 00:26:39.243 09:50:01 -- scripts/common.sh@339 -- # ver1_l=2 00:26:39.243 09:50:01 -- scripts/common.sh@340 -- # ver2_l=1 00:26:39.243 09:50:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:39.243 09:50:01 -- scripts/common.sh@343 -- # case "$op" in 00:26:39.243 09:50:01 -- scripts/common.sh@344 -- # : 1 00:26:39.243 09:50:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:39.243 09:50:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:39.243 09:50:01 -- scripts/common.sh@364 -- # decimal 1 00:26:39.243 09:50:01 -- scripts/common.sh@352 -- # local d=1 00:26:39.243 09:50:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:39.243 09:50:01 -- scripts/common.sh@354 -- # echo 1 00:26:39.243 09:50:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:39.243 09:50:01 -- scripts/common.sh@365 -- # decimal 2 00:26:39.243 09:50:01 -- scripts/common.sh@352 -- # local d=2 00:26:39.243 09:50:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:39.243 09:50:01 -- scripts/common.sh@354 -- # echo 2 00:26:39.243 09:50:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:39.243 09:50:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:39.243 09:50:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:39.243 09:50:01 -- scripts/common.sh@367 -- # return 0 00:26:39.243 09:50:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:39.243 09:50:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:39.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:39.243 --rc genhtml_branch_coverage=1 00:26:39.243 --rc genhtml_function_coverage=1 00:26:39.243 --rc genhtml_legend=1 00:26:39.243 --rc geninfo_all_blocks=1 00:26:39.243 --rc geninfo_unexecuted_blocks=1 00:26:39.243 00:26:39.243 ' 00:26:39.243 09:50:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:39.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:39.243 --rc genhtml_branch_coverage=1 00:26:39.243 --rc genhtml_function_coverage=1 00:26:39.243 --rc genhtml_legend=1 00:26:39.243 --rc geninfo_all_blocks=1 00:26:39.243 --rc geninfo_unexecuted_blocks=1 00:26:39.243 00:26:39.243 ' 00:26:39.243 09:50:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:39.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:39.243 --rc genhtml_branch_coverage=1 00:26:39.243 --rc genhtml_function_coverage=1 00:26:39.243 --rc genhtml_legend=1 00:26:39.243 --rc geninfo_all_blocks=1 00:26:39.243 --rc geninfo_unexecuted_blocks=1 00:26:39.243 00:26:39.243 ' 00:26:39.243 09:50:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:39.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:39.243 --rc genhtml_branch_coverage=1 00:26:39.243 --rc genhtml_function_coverage=1 00:26:39.243 --rc genhtml_legend=1 00:26:39.243 --rc geninfo_all_blocks=1 00:26:39.243 --rc geninfo_unexecuted_blocks=1 00:26:39.243 00:26:39.243 ' 00:26:39.243 09:50:01 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:39.243 09:50:01 -- nvmf/common.sh@7 -- # uname -s 00:26:39.243 09:50:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:39.243 09:50:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:39.244 09:50:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:39.244 09:50:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:39.244 09:50:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:39.244 09:50:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:39.244 09:50:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:39.244 09:50:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:39.244 09:50:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:39.244 09:50:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:39.244 09:50:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:39.244 09:50:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:39.244 09:50:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:39.244 09:50:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:39.244 09:50:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:39.244 09:50:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:39.244 09:50:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:39.244 09:50:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:39.244 09:50:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:39.244 09:50:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:39.244 09:50:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:39.244 09:50:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:39.244 09:50:01 -- paths/export.sh@5 -- # export PATH 00:26:39.244 09:50:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:39.244 09:50:01 -- nvmf/common.sh@46 -- # : 0 00:26:39.244 09:50:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:39.244 09:50:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:39.244 09:50:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:39.244 09:50:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:39.244 09:50:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:39.244 09:50:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:39.244 09:50:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:39.244 09:50:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:39.244 09:50:01 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:39.244 09:50:01 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:39.244 09:50:01 -- host/digest.sh@16 -- # runtime=2 00:26:39.244 09:50:01 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:39.244 09:50:01 -- host/digest.sh@132 -- # nvmftestinit 00:26:39.244 09:50:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:39.244 09:50:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:39.244 09:50:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:39.244 09:50:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:39.244 09:50:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:39.244 09:50:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:39.244 09:50:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:39.244 09:50:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:39.244 09:50:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:39.244 09:50:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:39.244 09:50:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:39.244 09:50:01 -- common/autotest_common.sh@10 -- # set +x 00:26:41.145 09:50:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:41.145 09:50:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:41.145 09:50:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:41.145 09:50:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:41.145 09:50:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:41.145 09:50:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:41.145 09:50:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:41.145 09:50:03 -- nvmf/common.sh@294 -- # net_devs=() 00:26:41.145 09:50:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:41.145 09:50:03 -- nvmf/common.sh@295 -- # e810=() 00:26:41.145 09:50:03 -- nvmf/common.sh@295 -- # local -ga e810 00:26:41.145 09:50:03 -- nvmf/common.sh@296 -- # x722=() 00:26:41.145 09:50:03 -- nvmf/common.sh@296 -- # local -ga x722 00:26:41.145 09:50:03 -- nvmf/common.sh@297 -- # mlx=() 00:26:41.145 09:50:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:41.145 09:50:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:41.145 09:50:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:41.145 09:50:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:41.145 09:50:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:41.145 09:50:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:41.145 09:50:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:41.145 09:50:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:41.145 09:50:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:41.145 09:50:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:41.145 09:50:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:41.145 09:50:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:41.145 09:50:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:41.145 09:50:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:41.145 09:50:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:41.145 09:50:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:41.145 09:50:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:41.145 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:41.145 09:50:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:41.145 09:50:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:41.145 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:41.145 09:50:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:41.145 09:50:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:41.145 09:50:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:41.145 09:50:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:41.145 09:50:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:41.145 09:50:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:41.145 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:41.145 09:50:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:41.145 09:50:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:41.145 09:50:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:41.145 09:50:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:41.145 09:50:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:41.145 09:50:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:41.145 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:41.145 09:50:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:41.145 09:50:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:41.145 09:50:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:41.145 09:50:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:41.145 09:50:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:41.145 09:50:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:41.145 09:50:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:41.145 09:50:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:41.145 09:50:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:41.145 09:50:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:41.145 09:50:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:41.145 09:50:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:41.145 09:50:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:41.145 09:50:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:41.145 09:50:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:41.145 09:50:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:41.145 09:50:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:41.145 09:50:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:41.145 09:50:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:41.145 09:50:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:41.145 09:50:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:41.145 09:50:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:41.145 09:50:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:41.145 09:50:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:41.145 09:50:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:41.145 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:41.146 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.176 ms 00:26:41.146 00:26:41.146 --- 10.0.0.2 ping statistics --- 00:26:41.146 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:41.146 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:26:41.146 09:50:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:41.146 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:41.146 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:26:41.146 00:26:41.146 --- 10.0.0.1 ping statistics --- 00:26:41.146 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:41.146 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:26:41.146 09:50:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:41.146 09:50:03 -- nvmf/common.sh@410 -- # return 0 00:26:41.146 09:50:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:41.146 09:50:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:41.146 09:50:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:41.146 09:50:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:41.146 09:50:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:41.146 09:50:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:41.146 09:50:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:41.146 09:50:03 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:41.146 09:50:03 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:41.146 09:50:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:41.146 09:50:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:41.146 09:50:03 -- common/autotest_common.sh@10 -- # set +x 00:26:41.146 ************************************ 00:26:41.146 START TEST nvmf_digest_clean 00:26:41.146 ************************************ 00:26:41.146 09:50:03 -- common/autotest_common.sh@1114 -- # run_digest 00:26:41.146 09:50:03 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:41.146 09:50:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:41.146 09:50:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:41.146 09:50:03 -- common/autotest_common.sh@10 -- # set +x 00:26:41.146 09:50:03 -- nvmf/common.sh@469 -- # nvmfpid=138081 00:26:41.146 09:50:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:41.146 09:50:03 -- nvmf/common.sh@470 -- # waitforlisten 138081 00:26:41.146 09:50:03 -- common/autotest_common.sh@829 -- # '[' -z 138081 ']' 00:26:41.146 09:50:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:41.146 09:50:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:41.146 09:50:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:41.146 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:41.146 09:50:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:41.146 09:50:03 -- common/autotest_common.sh@10 -- # set +x 00:26:41.146 [2024-11-29 09:50:03.937794] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:41.146 [2024-11-29 09:50:03.937873] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:41.146 EAL: No free 2048 kB hugepages reported on node 1 00:26:41.477 [2024-11-29 09:50:04.007132] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:41.477 [2024-11-29 09:50:04.123812] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:41.477 [2024-11-29 09:50:04.124002] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:41.477 [2024-11-29 09:50:04.124022] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:41.477 [2024-11-29 09:50:04.124037] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:41.477 [2024-11-29 09:50:04.124068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:41.477 09:50:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:41.477 09:50:04 -- common/autotest_common.sh@862 -- # return 0 00:26:41.477 09:50:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:41.477 09:50:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:41.477 09:50:04 -- common/autotest_common.sh@10 -- # set +x 00:26:41.477 09:50:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:41.477 09:50:04 -- host/digest.sh@120 -- # common_target_config 00:26:41.477 09:50:04 -- host/digest.sh@43 -- # rpc_cmd 00:26:41.477 09:50:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:41.477 09:50:04 -- common/autotest_common.sh@10 -- # set +x 00:26:41.477 null0 00:26:41.477 [2024-11-29 09:50:04.296005] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:41.734 [2024-11-29 09:50:04.320261] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:41.734 09:50:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:41.734 09:50:04 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:41.734 09:50:04 -- host/digest.sh@77 -- # local rw bs qd 00:26:41.734 09:50:04 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:41.734 09:50:04 -- host/digest.sh@80 -- # rw=randread 00:26:41.734 09:50:04 -- host/digest.sh@80 -- # bs=4096 00:26:41.734 09:50:04 -- host/digest.sh@80 -- # qd=128 00:26:41.734 09:50:04 -- host/digest.sh@82 -- # bperfpid=138113 00:26:41.734 09:50:04 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:41.734 09:50:04 -- host/digest.sh@83 -- # waitforlisten 138113 /var/tmp/bperf.sock 00:26:41.734 09:50:04 -- common/autotest_common.sh@829 -- # '[' -z 138113 ']' 00:26:41.734 09:50:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:41.734 09:50:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:41.734 09:50:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:41.734 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:41.734 09:50:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:41.734 09:50:04 -- common/autotest_common.sh@10 -- # set +x 00:26:41.734 [2024-11-29 09:50:04.363167] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:41.734 [2024-11-29 09:50:04.363236] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid138113 ] 00:26:41.734 EAL: No free 2048 kB hugepages reported on node 1 00:26:41.734 [2024-11-29 09:50:04.426401] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:41.734 [2024-11-29 09:50:04.548831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:41.992 09:50:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:41.992 09:50:04 -- common/autotest_common.sh@862 -- # return 0 00:26:41.992 09:50:04 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:41.992 09:50:04 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:41.992 09:50:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:42.249 09:50:04 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:42.249 09:50:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:42.816 nvme0n1 00:26:42.816 09:50:05 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:42.816 09:50:05 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:42.816 Running I/O for 2 seconds... 00:26:44.723 00:26:44.723 Latency(us) 00:26:44.723 [2024-11-29T08:50:07.566Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:44.723 [2024-11-29T08:50:07.566Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:44.723 nvme0n1 : 2.01 16388.16 64.02 0.00 0.00 7804.03 3349.62 17282.09 00:26:44.723 [2024-11-29T08:50:07.566Z] =================================================================================================================== 00:26:44.723 [2024-11-29T08:50:07.566Z] Total : 16388.16 64.02 0.00 0.00 7804.03 3349.62 17282.09 00:26:44.723 0 00:26:44.723 09:50:07 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:44.723 09:50:07 -- host/digest.sh@92 -- # get_accel_stats 00:26:44.723 09:50:07 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:44.723 09:50:07 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:44.723 | select(.opcode=="crc32c") 00:26:44.723 | "\(.module_name) \(.executed)"' 00:26:44.723 09:50:07 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:44.981 09:50:07 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:44.981 09:50:07 -- host/digest.sh@93 -- # exp_module=software 00:26:44.981 09:50:07 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:44.981 09:50:07 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:44.981 09:50:07 -- host/digest.sh@97 -- # killprocess 138113 00:26:44.981 09:50:07 -- common/autotest_common.sh@936 -- # '[' -z 138113 ']' 00:26:44.981 09:50:07 -- common/autotest_common.sh@940 -- # kill -0 138113 00:26:44.981 09:50:07 -- common/autotest_common.sh@941 -- # uname 00:26:44.981 09:50:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:44.981 09:50:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 138113 00:26:44.981 09:50:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:44.981 09:50:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:44.981 09:50:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 138113' 00:26:44.981 killing process with pid 138113 00:26:44.981 09:50:07 -- common/autotest_common.sh@955 -- # kill 138113 00:26:44.981 Received shutdown signal, test time was about 2.000000 seconds 00:26:44.981 00:26:44.981 Latency(us) 00:26:44.981 [2024-11-29T08:50:07.824Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:44.981 [2024-11-29T08:50:07.824Z] =================================================================================================================== 00:26:44.981 [2024-11-29T08:50:07.824Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:44.981 09:50:07 -- common/autotest_common.sh@960 -- # wait 138113 00:26:45.240 09:50:08 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:45.240 09:50:08 -- host/digest.sh@77 -- # local rw bs qd 00:26:45.240 09:50:08 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:45.240 09:50:08 -- host/digest.sh@80 -- # rw=randread 00:26:45.240 09:50:08 -- host/digest.sh@80 -- # bs=131072 00:26:45.240 09:50:08 -- host/digest.sh@80 -- # qd=16 00:26:45.240 09:50:08 -- host/digest.sh@82 -- # bperfpid=138648 00:26:45.240 09:50:08 -- host/digest.sh@83 -- # waitforlisten 138648 /var/tmp/bperf.sock 00:26:45.240 09:50:08 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:45.240 09:50:08 -- common/autotest_common.sh@829 -- # '[' -z 138648 ']' 00:26:45.240 09:50:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:45.240 09:50:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:45.240 09:50:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:45.240 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:45.240 09:50:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:45.240 09:50:08 -- common/autotest_common.sh@10 -- # set +x 00:26:45.498 [2024-11-29 09:50:08.088154] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:45.498 [2024-11-29 09:50:08.088242] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid138648 ] 00:26:45.498 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:45.498 Zero copy mechanism will not be used. 00:26:45.498 EAL: No free 2048 kB hugepages reported on node 1 00:26:45.498 [2024-11-29 09:50:08.146456] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:45.498 [2024-11-29 09:50:08.253194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:45.498 09:50:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:45.498 09:50:08 -- common/autotest_common.sh@862 -- # return 0 00:26:45.498 09:50:08 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:45.498 09:50:08 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:45.498 09:50:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:46.067 09:50:08 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:46.067 09:50:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:46.325 nvme0n1 00:26:46.325 09:50:09 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:46.325 09:50:09 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:46.583 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:46.583 Zero copy mechanism will not be used. 00:26:46.583 Running I/O for 2 seconds... 00:26:48.485 00:26:48.485 Latency(us) 00:26:48.485 [2024-11-29T08:50:11.328Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:48.485 [2024-11-29T08:50:11.328Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:48.485 nvme0n1 : 2.00 6015.76 751.97 0.00 0.00 2655.63 682.67 5995.33 00:26:48.485 [2024-11-29T08:50:11.328Z] =================================================================================================================== 00:26:48.485 [2024-11-29T08:50:11.328Z] Total : 6015.76 751.97 0.00 0.00 2655.63 682.67 5995.33 00:26:48.485 0 00:26:48.485 09:50:11 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:48.485 09:50:11 -- host/digest.sh@92 -- # get_accel_stats 00:26:48.485 09:50:11 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:48.485 09:50:11 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:48.485 | select(.opcode=="crc32c") 00:26:48.485 | "\(.module_name) \(.executed)"' 00:26:48.485 09:50:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:48.742 09:50:11 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:48.742 09:50:11 -- host/digest.sh@93 -- # exp_module=software 00:26:48.742 09:50:11 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:48.742 09:50:11 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:48.742 09:50:11 -- host/digest.sh@97 -- # killprocess 138648 00:26:48.742 09:50:11 -- common/autotest_common.sh@936 -- # '[' -z 138648 ']' 00:26:48.742 09:50:11 -- common/autotest_common.sh@940 -- # kill -0 138648 00:26:48.742 09:50:11 -- common/autotest_common.sh@941 -- # uname 00:26:48.742 09:50:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:48.742 09:50:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 138648 00:26:49.001 09:50:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:49.001 09:50:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:49.001 09:50:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 138648' 00:26:49.001 killing process with pid 138648 00:26:49.001 09:50:11 -- common/autotest_common.sh@955 -- # kill 138648 00:26:49.001 Received shutdown signal, test time was about 2.000000 seconds 00:26:49.001 00:26:49.001 Latency(us) 00:26:49.001 [2024-11-29T08:50:11.844Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:49.001 [2024-11-29T08:50:11.844Z] =================================================================================================================== 00:26:49.001 [2024-11-29T08:50:11.844Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:49.001 09:50:11 -- common/autotest_common.sh@960 -- # wait 138648 00:26:49.262 09:50:11 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:49.262 09:50:11 -- host/digest.sh@77 -- # local rw bs qd 00:26:49.262 09:50:11 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:49.262 09:50:11 -- host/digest.sh@80 -- # rw=randwrite 00:26:49.262 09:50:11 -- host/digest.sh@80 -- # bs=4096 00:26:49.262 09:50:11 -- host/digest.sh@80 -- # qd=128 00:26:49.262 09:50:11 -- host/digest.sh@82 -- # bperfpid=139078 00:26:49.262 09:50:11 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:49.262 09:50:11 -- host/digest.sh@83 -- # waitforlisten 139078 /var/tmp/bperf.sock 00:26:49.262 09:50:11 -- common/autotest_common.sh@829 -- # '[' -z 139078 ']' 00:26:49.262 09:50:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:49.262 09:50:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:49.262 09:50:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:49.262 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:49.262 09:50:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:49.262 09:50:11 -- common/autotest_common.sh@10 -- # set +x 00:26:49.262 [2024-11-29 09:50:11.898235] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:49.262 [2024-11-29 09:50:11.898327] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid139078 ] 00:26:49.262 EAL: No free 2048 kB hugepages reported on node 1 00:26:49.262 [2024-11-29 09:50:11.956211] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:49.262 [2024-11-29 09:50:12.062470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:49.523 09:50:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:49.523 09:50:12 -- common/autotest_common.sh@862 -- # return 0 00:26:49.523 09:50:12 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:49.523 09:50:12 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:49.523 09:50:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:49.782 09:50:12 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:49.782 09:50:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:50.039 nvme0n1 00:26:50.039 09:50:12 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:50.039 09:50:12 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:50.299 Running I/O for 2 seconds... 00:26:52.202 00:26:52.202 Latency(us) 00:26:52.202 [2024-11-29T08:50:15.045Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:52.202 [2024-11-29T08:50:15.045Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:52.202 nvme0n1 : 2.00 20584.07 80.41 0.00 0.00 6212.46 3155.44 11553.75 00:26:52.202 [2024-11-29T08:50:15.045Z] =================================================================================================================== 00:26:52.202 [2024-11-29T08:50:15.045Z] Total : 20584.07 80.41 0.00 0.00 6212.46 3155.44 11553.75 00:26:52.202 0 00:26:52.202 09:50:14 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:52.202 09:50:14 -- host/digest.sh@92 -- # get_accel_stats 00:26:52.202 09:50:14 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:52.202 09:50:14 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:52.202 | select(.opcode=="crc32c") 00:26:52.202 | "\(.module_name) \(.executed)"' 00:26:52.202 09:50:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:52.469 09:50:15 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:52.469 09:50:15 -- host/digest.sh@93 -- # exp_module=software 00:26:52.469 09:50:15 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:52.469 09:50:15 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:52.469 09:50:15 -- host/digest.sh@97 -- # killprocess 139078 00:26:52.469 09:50:15 -- common/autotest_common.sh@936 -- # '[' -z 139078 ']' 00:26:52.469 09:50:15 -- common/autotest_common.sh@940 -- # kill -0 139078 00:26:52.469 09:50:15 -- common/autotest_common.sh@941 -- # uname 00:26:52.469 09:50:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:52.469 09:50:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 139078 00:26:52.469 09:50:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:52.469 09:50:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:52.469 09:50:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 139078' 00:26:52.469 killing process with pid 139078 00:26:52.469 09:50:15 -- common/autotest_common.sh@955 -- # kill 139078 00:26:52.469 Received shutdown signal, test time was about 2.000000 seconds 00:26:52.469 00:26:52.469 Latency(us) 00:26:52.469 [2024-11-29T08:50:15.312Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:52.469 [2024-11-29T08:50:15.312Z] =================================================================================================================== 00:26:52.469 [2024-11-29T08:50:15.312Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:52.469 09:50:15 -- common/autotest_common.sh@960 -- # wait 139078 00:26:52.727 09:50:15 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:26:52.727 09:50:15 -- host/digest.sh@77 -- # local rw bs qd 00:26:52.727 09:50:15 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:52.727 09:50:15 -- host/digest.sh@80 -- # rw=randwrite 00:26:52.727 09:50:15 -- host/digest.sh@80 -- # bs=131072 00:26:52.727 09:50:15 -- host/digest.sh@80 -- # qd=16 00:26:52.727 09:50:15 -- host/digest.sh@82 -- # bperfpid=139500 00:26:52.728 09:50:15 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:52.728 09:50:15 -- host/digest.sh@83 -- # waitforlisten 139500 /var/tmp/bperf.sock 00:26:52.728 09:50:15 -- common/autotest_common.sh@829 -- # '[' -z 139500 ']' 00:26:52.728 09:50:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:52.728 09:50:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:52.728 09:50:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:52.728 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:52.728 09:50:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:52.728 09:50:15 -- common/autotest_common.sh@10 -- # set +x 00:26:52.986 [2024-11-29 09:50:15.598546] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:52.986 [2024-11-29 09:50:15.598633] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid139500 ] 00:26:52.986 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:52.986 Zero copy mechanism will not be used. 00:26:52.986 EAL: No free 2048 kB hugepages reported on node 1 00:26:52.986 [2024-11-29 09:50:15.656588] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:52.986 [2024-11-29 09:50:15.762779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:52.986 09:50:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:52.986 09:50:15 -- common/autotest_common.sh@862 -- # return 0 00:26:52.986 09:50:15 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:52.986 09:50:15 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:52.986 09:50:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:53.555 09:50:16 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:53.555 09:50:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:53.814 nvme0n1 00:26:53.814 09:50:16 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:53.814 09:50:16 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:54.073 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:54.073 Zero copy mechanism will not be used. 00:26:54.073 Running I/O for 2 seconds... 00:26:55.976 00:26:55.976 Latency(us) 00:26:55.976 [2024-11-29T08:50:18.819Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:55.976 [2024-11-29T08:50:18.819Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:55.976 nvme0n1 : 2.00 7011.48 876.44 0.00 0.00 2274.83 1771.90 8301.23 00:26:55.976 [2024-11-29T08:50:18.819Z] =================================================================================================================== 00:26:55.976 [2024-11-29T08:50:18.819Z] Total : 7011.48 876.44 0.00 0.00 2274.83 1771.90 8301.23 00:26:55.976 0 00:26:55.976 09:50:18 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:55.976 09:50:18 -- host/digest.sh@92 -- # get_accel_stats 00:26:55.976 09:50:18 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:55.976 09:50:18 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:55.976 | select(.opcode=="crc32c") 00:26:55.976 | "\(.module_name) \(.executed)"' 00:26:55.976 09:50:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:56.236 09:50:19 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:56.236 09:50:19 -- host/digest.sh@93 -- # exp_module=software 00:26:56.236 09:50:19 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:56.236 09:50:19 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:56.236 09:50:19 -- host/digest.sh@97 -- # killprocess 139500 00:26:56.236 09:50:19 -- common/autotest_common.sh@936 -- # '[' -z 139500 ']' 00:26:56.236 09:50:19 -- common/autotest_common.sh@940 -- # kill -0 139500 00:26:56.236 09:50:19 -- common/autotest_common.sh@941 -- # uname 00:26:56.236 09:50:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:56.236 09:50:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 139500 00:26:56.236 09:50:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:56.236 09:50:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:56.236 09:50:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 139500' 00:26:56.236 killing process with pid 139500 00:26:56.236 09:50:19 -- common/autotest_common.sh@955 -- # kill 139500 00:26:56.236 Received shutdown signal, test time was about 2.000000 seconds 00:26:56.236 00:26:56.236 Latency(us) 00:26:56.236 [2024-11-29T08:50:19.079Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:56.236 [2024-11-29T08:50:19.079Z] =================================================================================================================== 00:26:56.236 [2024-11-29T08:50:19.079Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:56.236 09:50:19 -- common/autotest_common.sh@960 -- # wait 139500 00:26:56.495 09:50:19 -- host/digest.sh@126 -- # killprocess 138081 00:26:56.495 09:50:19 -- common/autotest_common.sh@936 -- # '[' -z 138081 ']' 00:26:56.495 09:50:19 -- common/autotest_common.sh@940 -- # kill -0 138081 00:26:56.495 09:50:19 -- common/autotest_common.sh@941 -- # uname 00:26:56.495 09:50:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:56.495 09:50:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 138081 00:26:56.756 09:50:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:56.756 09:50:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:56.756 09:50:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 138081' 00:26:56.756 killing process with pid 138081 00:26:56.756 09:50:19 -- common/autotest_common.sh@955 -- # kill 138081 00:26:56.756 09:50:19 -- common/autotest_common.sh@960 -- # wait 138081 00:26:57.015 00:26:57.015 real 0m15.750s 00:26:57.015 user 0m31.363s 00:26:57.015 sys 0m4.288s 00:26:57.015 09:50:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:57.015 09:50:19 -- common/autotest_common.sh@10 -- # set +x 00:26:57.015 ************************************ 00:26:57.015 END TEST nvmf_digest_clean 00:26:57.015 ************************************ 00:26:57.015 09:50:19 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:26:57.015 09:50:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:57.015 09:50:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:57.015 09:50:19 -- common/autotest_common.sh@10 -- # set +x 00:26:57.015 ************************************ 00:26:57.015 START TEST nvmf_digest_error 00:26:57.015 ************************************ 00:26:57.015 09:50:19 -- common/autotest_common.sh@1114 -- # run_digest_error 00:26:57.015 09:50:19 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:26:57.015 09:50:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:57.015 09:50:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:57.015 09:50:19 -- common/autotest_common.sh@10 -- # set +x 00:26:57.015 09:50:19 -- nvmf/common.sh@469 -- # nvmfpid=140064 00:26:57.015 09:50:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:57.015 09:50:19 -- nvmf/common.sh@470 -- # waitforlisten 140064 00:26:57.015 09:50:19 -- common/autotest_common.sh@829 -- # '[' -z 140064 ']' 00:26:57.015 09:50:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:57.015 09:50:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:57.015 09:50:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:57.015 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:57.015 09:50:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:57.015 09:50:19 -- common/autotest_common.sh@10 -- # set +x 00:26:57.015 [2024-11-29 09:50:19.718584] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:57.015 [2024-11-29 09:50:19.718666] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:57.015 EAL: No free 2048 kB hugepages reported on node 1 00:26:57.015 [2024-11-29 09:50:19.782435] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:57.274 [2024-11-29 09:50:19.894533] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:57.274 [2024-11-29 09:50:19.894709] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:57.274 [2024-11-29 09:50:19.894728] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:57.274 [2024-11-29 09:50:19.894752] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:57.274 [2024-11-29 09:50:19.894790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:57.274 09:50:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:57.274 09:50:19 -- common/autotest_common.sh@862 -- # return 0 00:26:57.274 09:50:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:57.274 09:50:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:57.274 09:50:19 -- common/autotest_common.sh@10 -- # set +x 00:26:57.274 09:50:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:57.274 09:50:19 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:26:57.274 09:50:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.274 09:50:19 -- common/autotest_common.sh@10 -- # set +x 00:26:57.274 [2024-11-29 09:50:19.967382] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:26:57.274 09:50:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.274 09:50:19 -- host/digest.sh@104 -- # common_target_config 00:26:57.274 09:50:19 -- host/digest.sh@43 -- # rpc_cmd 00:26:57.274 09:50:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.274 09:50:19 -- common/autotest_common.sh@10 -- # set +x 00:26:57.274 null0 00:26:57.274 [2024-11-29 09:50:20.090857] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:57.274 [2024-11-29 09:50:20.115150] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:57.533 09:50:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.533 09:50:20 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:26:57.533 09:50:20 -- host/digest.sh@54 -- # local rw bs qd 00:26:57.533 09:50:20 -- host/digest.sh@56 -- # rw=randread 00:26:57.533 09:50:20 -- host/digest.sh@56 -- # bs=4096 00:26:57.533 09:50:20 -- host/digest.sh@56 -- # qd=128 00:26:57.533 09:50:20 -- host/digest.sh@58 -- # bperfpid=140089 00:26:57.533 09:50:20 -- host/digest.sh@60 -- # waitforlisten 140089 /var/tmp/bperf.sock 00:26:57.533 09:50:20 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:26:57.533 09:50:20 -- common/autotest_common.sh@829 -- # '[' -z 140089 ']' 00:26:57.533 09:50:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:57.533 09:50:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:57.533 09:50:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:57.533 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:57.533 09:50:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:57.533 09:50:20 -- common/autotest_common.sh@10 -- # set +x 00:26:57.533 [2024-11-29 09:50:20.158602] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:57.533 [2024-11-29 09:50:20.158667] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid140089 ] 00:26:57.533 EAL: No free 2048 kB hugepages reported on node 1 00:26:57.533 [2024-11-29 09:50:20.220876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:57.533 [2024-11-29 09:50:20.335621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:58.469 09:50:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:58.469 09:50:21 -- common/autotest_common.sh@862 -- # return 0 00:26:58.469 09:50:21 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:58.469 09:50:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:58.727 09:50:21 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:58.727 09:50:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.727 09:50:21 -- common/autotest_common.sh@10 -- # set +x 00:26:58.727 09:50:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.727 09:50:21 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:58.727 09:50:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:58.985 nvme0n1 00:26:58.985 09:50:21 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:58.985 09:50:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.985 09:50:21 -- common/autotest_common.sh@10 -- # set +x 00:26:58.985 09:50:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.985 09:50:21 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:58.985 09:50:21 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:59.244 Running I/O for 2 seconds... 00:26:59.244 [2024-11-29 09:50:21.930605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.244 [2024-11-29 09:50:21.930656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19645 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.244 [2024-11-29 09:50:21.930675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.244 [2024-11-29 09:50:21.947670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.244 [2024-11-29 09:50:21.947720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20406 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.244 [2024-11-29 09:50:21.947741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.244 [2024-11-29 09:50:21.964648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.244 [2024-11-29 09:50:21.964679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4134 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.244 [2024-11-29 09:50:21.964714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.244 [2024-11-29 09:50:21.981564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.244 [2024-11-29 09:50:21.981593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20867 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.244 [2024-11-29 09:50:21.981610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.244 [2024-11-29 09:50:21.998164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.244 [2024-11-29 09:50:21.998200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:15750 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.244 [2024-11-29 09:50:21.998219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.244 [2024-11-29 09:50:22.015329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.244 [2024-11-29 09:50:22.015365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:11667 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.244 [2024-11-29 09:50:22.015384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.244 [2024-11-29 09:50:22.032444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.244 [2024-11-29 09:50:22.032475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:2259 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.244 [2024-11-29 09:50:22.032493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.244 [2024-11-29 09:50:22.049190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.244 [2024-11-29 09:50:22.049226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:2899 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.244 [2024-11-29 09:50:22.049245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.244 [2024-11-29 09:50:22.066068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.244 [2024-11-29 09:50:22.066103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:9617 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.244 [2024-11-29 09:50:22.066123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.244 [2024-11-29 09:50:22.082959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.244 [2024-11-29 09:50:22.082994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:16086 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.244 [2024-11-29 09:50:22.083013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.099927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.099963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:6075 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.099983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.116675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.116704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:8511 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.116736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.133113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.133149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:15291 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.133168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.149623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.149652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:4151 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.149667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.166405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.166461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:11604 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.166477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.182916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.182951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:17498 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.182977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.199620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.199650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8598 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.199667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.215740] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.215787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:25252 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.215806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.232529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.232558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:25545 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.232574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.249090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.249125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:1256 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.249144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.265769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.265803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:20833 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.265822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.282428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.282472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:3384 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.282488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.299091] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.299126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:238 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.299146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.315942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.315977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:93 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.315996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.505 [2024-11-29 09:50:22.332769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.505 [2024-11-29 09:50:22.332810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:10 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.505 [2024-11-29 09:50:22.332830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.349598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.349628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12095 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.349644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.366535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.366567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19532 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.366584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.382814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.382848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:860 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.382867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.399716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.399745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22322 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.399778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.415930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.415964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:6708 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.415984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.432542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.432572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15642 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.432588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.449303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.449339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:24505 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.449358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.465692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.465727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17193 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.465746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.482274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.482309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:9153 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.482328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.498857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.498891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20545 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.498910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.515511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.515539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:17015 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.515555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.526452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.526482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24812 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.526498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.541900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.541935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11204 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.541954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.558746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.558781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:598 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.558801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.575496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.766 [2024-11-29 09:50:22.575525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2506 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.766 [2024-11-29 09:50:22.575541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.766 [2024-11-29 09:50:22.592548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:26:59.767 [2024-11-29 09:50:22.592577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:15405 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.767 [2024-11-29 09:50:22.592593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.026 [2024-11-29 09:50:22.609138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.026 [2024-11-29 09:50:22.609174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15944 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.026 [2024-11-29 09:50:22.609199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.026 [2024-11-29 09:50:22.625981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.026 [2024-11-29 09:50:22.626016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5537 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.026 [2024-11-29 09:50:22.626035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.026 [2024-11-29 09:50:22.642956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.026 [2024-11-29 09:50:22.642990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:22292 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.026 [2024-11-29 09:50:22.643009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.026 [2024-11-29 09:50:22.659815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.026 [2024-11-29 09:50:22.659850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:22858 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.026 [2024-11-29 09:50:22.659869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.026 [2024-11-29 09:50:22.677456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.026 [2024-11-29 09:50:22.677487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:24967 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.026 [2024-11-29 09:50:22.677505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.026 [2024-11-29 09:50:22.693470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.026 [2024-11-29 09:50:22.693500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20507 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.026 [2024-11-29 09:50:22.693532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.026 [2024-11-29 09:50:22.710611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.026 [2024-11-29 09:50:22.710640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:2283 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.026 [2024-11-29 09:50:22.710656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.026 [2024-11-29 09:50:22.727521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.026 [2024-11-29 09:50:22.727551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13140 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.026 [2024-11-29 09:50:22.727568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.026 [2024-11-29 09:50:22.744623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.026 [2024-11-29 09:50:22.744653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:20462 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.026 [2024-11-29 09:50:22.744670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.026 [2024-11-29 09:50:22.761570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.026 [2024-11-29 09:50:22.761604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:10604 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.026 [2024-11-29 09:50:22.761624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.026 [2024-11-29 09:50:22.778616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.026 [2024-11-29 09:50:22.778647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:23824 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.026 [2024-11-29 09:50:22.778663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.026 [2024-11-29 09:50:22.794654] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.026 [2024-11-29 09:50:22.794683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:13833 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.026 [2024-11-29 09:50:22.794716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.026 [2024-11-29 09:50:22.811224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.026 [2024-11-29 09:50:22.811259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:21016 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.027 [2024-11-29 09:50:22.811277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.027 [2024-11-29 09:50:22.827607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.027 [2024-11-29 09:50:22.827636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:19690 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.027 [2024-11-29 09:50:22.827652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.027 [2024-11-29 09:50:22.844315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.027 [2024-11-29 09:50:22.844350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:7801 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.027 [2024-11-29 09:50:22.844368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.027 [2024-11-29 09:50:22.861149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.027 [2024-11-29 09:50:22.861183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:985 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.027 [2024-11-29 09:50:22.861201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.285 [2024-11-29 09:50:22.877940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.285 [2024-11-29 09:50:22.877974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:4303 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.285 [2024-11-29 09:50:22.877993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.285 [2024-11-29 09:50:22.894610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.285 [2024-11-29 09:50:22.894639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:21404 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.285 [2024-11-29 09:50:22.894661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.285 [2024-11-29 09:50:22.911174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.285 [2024-11-29 09:50:22.911208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:24391 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.285 [2024-11-29 09:50:22.911227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.285 [2024-11-29 09:50:22.927964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.285 [2024-11-29 09:50:22.927998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:18403 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.285 [2024-11-29 09:50:22.928018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.285 [2024-11-29 09:50:22.944640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.285 [2024-11-29 09:50:22.944668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:23313 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.285 [2024-11-29 09:50:22.944683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.285 [2024-11-29 09:50:22.961443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.285 [2024-11-29 09:50:22.961470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25146 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.285 [2024-11-29 09:50:22.961486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.285 [2024-11-29 09:50:22.978247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.285 [2024-11-29 09:50:22.978281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:6864 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.285 [2024-11-29 09:50:22.978300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.285 [2024-11-29 09:50:22.995522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.285 [2024-11-29 09:50:22.995551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8184 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.285 [2024-11-29 09:50:22.995567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.285 [2024-11-29 09:50:23.012058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.285 [2024-11-29 09:50:23.012092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11273 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.285 [2024-11-29 09:50:23.012111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.285 [2024-11-29 09:50:23.029116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.285 [2024-11-29 09:50:23.029151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:19245 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.285 [2024-11-29 09:50:23.029170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.285 [2024-11-29 09:50:23.045939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.285 [2024-11-29 09:50:23.045980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:20373 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.285 [2024-11-29 09:50:23.046000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.285 [2024-11-29 09:50:23.056923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.285 [2024-11-29 09:50:23.056958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:8854 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.285 [2024-11-29 09:50:23.056976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.286 [2024-11-29 09:50:23.072385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.286 [2024-11-29 09:50:23.072441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:12561 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.286 [2024-11-29 09:50:23.072457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.286 [2024-11-29 09:50:23.089012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.286 [2024-11-29 09:50:23.089048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:10379 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.286 [2024-11-29 09:50:23.089067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.286 [2024-11-29 09:50:23.105875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.286 [2024-11-29 09:50:23.105910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:8523 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.286 [2024-11-29 09:50:23.105930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.286 [2024-11-29 09:50:23.122948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.286 [2024-11-29 09:50:23.122983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:24813 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.286 [2024-11-29 09:50:23.123002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.544 [2024-11-29 09:50:23.146292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.544 [2024-11-29 09:50:23.146329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:24501 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.544 [2024-11-29 09:50:23.146348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.544 [2024-11-29 09:50:23.161344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.544 [2024-11-29 09:50:23.161378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:5659 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.544 [2024-11-29 09:50:23.161406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.544 [2024-11-29 09:50:23.172713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.544 [2024-11-29 09:50:23.172749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:1749 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.544 [2024-11-29 09:50:23.172768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.544 [2024-11-29 09:50:23.190204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.544 [2024-11-29 09:50:23.190238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:7388 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.544 [2024-11-29 09:50:23.190269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.544 [2024-11-29 09:50:23.206892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.544 [2024-11-29 09:50:23.206925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:13235 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.544 [2024-11-29 09:50:23.206944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.544 [2024-11-29 09:50:23.222387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.544 [2024-11-29 09:50:23.222446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:22357 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.544 [2024-11-29 09:50:23.222471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.544 [2024-11-29 09:50:23.238616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.544 [2024-11-29 09:50:23.238646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:6215 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.544 [2024-11-29 09:50:23.238686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.544 [2024-11-29 09:50:23.255337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.544 [2024-11-29 09:50:23.255372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:23284 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.544 [2024-11-29 09:50:23.255391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.544 [2024-11-29 09:50:23.272820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.544 [2024-11-29 09:50:23.272853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:14578 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.544 [2024-11-29 09:50:23.272873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.544 [2024-11-29 09:50:23.289243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.545 [2024-11-29 09:50:23.289278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:10594 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.545 [2024-11-29 09:50:23.289298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.545 [2024-11-29 09:50:23.306494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.545 [2024-11-29 09:50:23.306524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:2276 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.545 [2024-11-29 09:50:23.306540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.545 [2024-11-29 09:50:23.323166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.545 [2024-11-29 09:50:23.323200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:15476 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.545 [2024-11-29 09:50:23.323226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.545 [2024-11-29 09:50:23.339887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.545 [2024-11-29 09:50:23.339922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:23953 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.545 [2024-11-29 09:50:23.339941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.545 [2024-11-29 09:50:23.356574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.545 [2024-11-29 09:50:23.356602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20760 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.545 [2024-11-29 09:50:23.356622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.545 [2024-11-29 09:50:23.373618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.545 [2024-11-29 09:50:23.373645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:14624 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.545 [2024-11-29 09:50:23.373665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.805 [2024-11-29 09:50:23.390276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.805 [2024-11-29 09:50:23.390311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:18762 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.805 [2024-11-29 09:50:23.390336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.805 [2024-11-29 09:50:23.407406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.805 [2024-11-29 09:50:23.407452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:12250 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.805 [2024-11-29 09:50:23.407476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.805 [2024-11-29 09:50:23.424559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.805 [2024-11-29 09:50:23.424588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:12543 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.805 [2024-11-29 09:50:23.424610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.805 [2024-11-29 09:50:23.441079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.805 [2024-11-29 09:50:23.441108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:1182 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.805 [2024-11-29 09:50:23.441133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.805 [2024-11-29 09:50:23.458089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.805 [2024-11-29 09:50:23.458124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:21015 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.805 [2024-11-29 09:50:23.458142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.805 [2024-11-29 09:50:23.475047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.805 [2024-11-29 09:50:23.475081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1098 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.805 [2024-11-29 09:50:23.475100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.805 [2024-11-29 09:50:23.491837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.805 [2024-11-29 09:50:23.491872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12110 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.805 [2024-11-29 09:50:23.491891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.805 [2024-11-29 09:50:23.508515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.805 [2024-11-29 09:50:23.508543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:10289 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.805 [2024-11-29 09:50:23.508560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.805 [2024-11-29 09:50:23.525485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.805 [2024-11-29 09:50:23.525514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:17962 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.805 [2024-11-29 09:50:23.525529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.805 [2024-11-29 09:50:23.542313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.805 [2024-11-29 09:50:23.542348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:25482 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.805 [2024-11-29 09:50:23.542367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.805 [2024-11-29 09:50:23.558789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.805 [2024-11-29 09:50:23.558823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:13293 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.805 [2024-11-29 09:50:23.558842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.805 [2024-11-29 09:50:23.574966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.805 [2024-11-29 09:50:23.575000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:15326 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.805 [2024-11-29 09:50:23.575019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.806 [2024-11-29 09:50:23.591914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.806 [2024-11-29 09:50:23.591947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:1411 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.806 [2024-11-29 09:50:23.591966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.806 [2024-11-29 09:50:23.608927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.806 [2024-11-29 09:50:23.608962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:8312 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.806 [2024-11-29 09:50:23.608987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.806 [2024-11-29 09:50:23.626058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.806 [2024-11-29 09:50:23.626093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19059 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.806 [2024-11-29 09:50:23.626112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.806 [2024-11-29 09:50:23.643016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:00.806 [2024-11-29 09:50:23.643050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:6359 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.806 [2024-11-29 09:50:23.643068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.659720] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.659756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:4816 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.659775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.676060] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.676094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:12830 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.676113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.692780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.692814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:22568 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.692833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.709645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.709690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:14209 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.709709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.726316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.726350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9586 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.726369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.743234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.743268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:10680 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.743287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.760041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.760084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:5635 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.760104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.776391] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.776460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:10607 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.776476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.793200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.793236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:16248 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.793255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.809838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.809868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:20657 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.809884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.826570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.826599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:4780 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.826614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.843187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.843222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:13155 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.843240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.860793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.860828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:14241 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.860847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.877715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.877744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:9894 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.877776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.065 [2024-11-29 09:50:23.894688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.065 [2024-11-29 09:50:23.894737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:6265 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.065 [2024-11-29 09:50:23.894756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.325 [2024-11-29 09:50:23.911574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x20b4bb0) 00:27:01.325 [2024-11-29 09:50:23.911605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24402 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.325 [2024-11-29 09:50:23.911621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.325 00:27:01.325 Latency(us) 00:27:01.325 [2024-11-29T08:50:24.168Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:01.325 [2024-11-29T08:50:24.168Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:01.325 nvme0n1 : 2.01 15306.92 59.79 0.00 0.00 8355.73 3810.80 25631.86 00:27:01.325 [2024-11-29T08:50:24.168Z] =================================================================================================================== 00:27:01.325 [2024-11-29T08:50:24.168Z] Total : 15306.92 59.79 0.00 0.00 8355.73 3810.80 25631.86 00:27:01.325 0 00:27:01.325 09:50:23 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:01.325 09:50:23 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:01.325 09:50:23 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:01.325 | .driver_specific 00:27:01.325 | .nvme_error 00:27:01.325 | .status_code 00:27:01.325 | .command_transient_transport_error' 00:27:01.325 09:50:23 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:01.585 09:50:24 -- host/digest.sh@71 -- # (( 120 > 0 )) 00:27:01.585 09:50:24 -- host/digest.sh@73 -- # killprocess 140089 00:27:01.585 09:50:24 -- common/autotest_common.sh@936 -- # '[' -z 140089 ']' 00:27:01.585 09:50:24 -- common/autotest_common.sh@940 -- # kill -0 140089 00:27:01.585 09:50:24 -- common/autotest_common.sh@941 -- # uname 00:27:01.585 09:50:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:01.585 09:50:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 140089 00:27:01.585 09:50:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:01.585 09:50:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:01.585 09:50:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 140089' 00:27:01.585 killing process with pid 140089 00:27:01.585 09:50:24 -- common/autotest_common.sh@955 -- # kill 140089 00:27:01.585 Received shutdown signal, test time was about 2.000000 seconds 00:27:01.585 00:27:01.585 Latency(us) 00:27:01.585 [2024-11-29T08:50:24.428Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:01.585 [2024-11-29T08:50:24.428Z] =================================================================================================================== 00:27:01.585 [2024-11-29T08:50:24.428Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:01.585 09:50:24 -- common/autotest_common.sh@960 -- # wait 140089 00:27:01.844 09:50:24 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:01.844 09:50:24 -- host/digest.sh@54 -- # local rw bs qd 00:27:01.844 09:50:24 -- host/digest.sh@56 -- # rw=randread 00:27:01.844 09:50:24 -- host/digest.sh@56 -- # bs=131072 00:27:01.844 09:50:24 -- host/digest.sh@56 -- # qd=16 00:27:01.844 09:50:24 -- host/digest.sh@58 -- # bperfpid=140647 00:27:01.844 09:50:24 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:01.844 09:50:24 -- host/digest.sh@60 -- # waitforlisten 140647 /var/tmp/bperf.sock 00:27:01.844 09:50:24 -- common/autotest_common.sh@829 -- # '[' -z 140647 ']' 00:27:01.844 09:50:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:01.844 09:50:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:01.844 09:50:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:01.844 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:01.844 09:50:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:01.844 09:50:24 -- common/autotest_common.sh@10 -- # set +x 00:27:01.844 [2024-11-29 09:50:24.528906] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:01.844 [2024-11-29 09:50:24.528987] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid140647 ] 00:27:01.844 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:01.844 Zero copy mechanism will not be used. 00:27:01.844 EAL: No free 2048 kB hugepages reported on node 1 00:27:01.844 [2024-11-29 09:50:24.590856] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:02.102 [2024-11-29 09:50:24.703058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:02.667 09:50:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:02.667 09:50:25 -- common/autotest_common.sh@862 -- # return 0 00:27:02.667 09:50:25 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:02.667 09:50:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:02.946 09:50:25 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:02.946 09:50:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:02.946 09:50:25 -- common/autotest_common.sh@10 -- # set +x 00:27:02.946 09:50:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:02.946 09:50:25 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:02.946 09:50:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:03.515 nvme0n1 00:27:03.515 09:50:26 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:03.515 09:50:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:03.515 09:50:26 -- common/autotest_common.sh@10 -- # set +x 00:27:03.515 09:50:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:03.515 09:50:26 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:03.515 09:50:26 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:03.515 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:03.515 Zero copy mechanism will not be used. 00:27:03.515 Running I/O for 2 seconds... 00:27:03.515 [2024-11-29 09:50:26.323825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.515 [2024-11-29 09:50:26.323888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.515 [2024-11-29 09:50:26.323910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.515 [2024-11-29 09:50:26.329099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.515 [2024-11-29 09:50:26.329132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.515 [2024-11-29 09:50:26.329150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.515 [2024-11-29 09:50:26.334210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.515 [2024-11-29 09:50:26.334242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.515 [2024-11-29 09:50:26.334260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.515 [2024-11-29 09:50:26.338989] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.515 [2024-11-29 09:50:26.339021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.515 [2024-11-29 09:50:26.339049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.515 [2024-11-29 09:50:26.343257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.515 [2024-11-29 09:50:26.343288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.515 [2024-11-29 09:50:26.343305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.515 [2024-11-29 09:50:26.348449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.515 [2024-11-29 09:50:26.348481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.515 [2024-11-29 09:50:26.348499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.515 [2024-11-29 09:50:26.353914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.515 [2024-11-29 09:50:26.353946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.515 [2024-11-29 09:50:26.353963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.359139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.359172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.359189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.364627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.364659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.364692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.369576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.369608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.369626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.374598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.374628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.374645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.379447] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.379477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.379494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.384367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.384426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.384459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.389258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.389304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.389321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.394207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.394237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.394269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.399293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.399323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.399340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.404386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.404425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.404442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.409632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.409663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.409695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.414553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.414583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.414600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.419640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.419687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.419705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.424770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.424815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.424838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.429818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.429849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.429865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.434606] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.434637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.434654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.439538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.439568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.439585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.444449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.444479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.444496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.776 [2024-11-29 09:50:26.449356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.776 [2024-11-29 09:50:26.449387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.776 [2024-11-29 09:50:26.449415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.454520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.454552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.454569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.459629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.459659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.459691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.464679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.464709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.464740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.469732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.469784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.469802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.474855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.474885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.474902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.479651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.479695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.479714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.484545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.484575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.484593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.489584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.489613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.489630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.494445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.494484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.494501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.499302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.499332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.499348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.504173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.504204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.504220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.509242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.509287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.509303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.514170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.514215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.514233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.519240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.519271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.519289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.524113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.524145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.524177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.529472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.529503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.529521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.534253] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.534284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.534301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.539555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.539587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.539604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.544458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.544490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.544506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.549174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.549220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.549237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.554162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.777 [2024-11-29 09:50:26.554193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.777 [2024-11-29 09:50:26.554232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.777 [2024-11-29 09:50:26.559172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.778 [2024-11-29 09:50:26.559203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.778 [2024-11-29 09:50:26.559219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.778 [2024-11-29 09:50:26.564204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.778 [2024-11-29 09:50:26.564234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.778 [2024-11-29 09:50:26.564251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.778 [2024-11-29 09:50:26.568155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.778 [2024-11-29 09:50:26.568185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.778 [2024-11-29 09:50:26.568202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.778 [2024-11-29 09:50:26.571840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.778 [2024-11-29 09:50:26.571870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.778 [2024-11-29 09:50:26.571886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.778 [2024-11-29 09:50:26.575574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.778 [2024-11-29 09:50:26.575605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.778 [2024-11-29 09:50:26.575622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.778 [2024-11-29 09:50:26.579412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.778 [2024-11-29 09:50:26.579444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.778 [2024-11-29 09:50:26.579462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.778 [2024-11-29 09:50:26.583139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.778 [2024-11-29 09:50:26.583170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.778 [2024-11-29 09:50:26.583187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.778 [2024-11-29 09:50:26.587025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.778 [2024-11-29 09:50:26.587055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.778 [2024-11-29 09:50:26.587073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.778 [2024-11-29 09:50:26.591625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.778 [2024-11-29 09:50:26.591662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.778 [2024-11-29 09:50:26.591679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.778 [2024-11-29 09:50:26.596575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.778 [2024-11-29 09:50:26.596605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.778 [2024-11-29 09:50:26.596623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.778 [2024-11-29 09:50:26.601908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.778 [2024-11-29 09:50:26.601938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.778 [2024-11-29 09:50:26.601956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.778 [2024-11-29 09:50:26.607553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.778 [2024-11-29 09:50:26.607584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.778 [2024-11-29 09:50:26.607601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.778 [2024-11-29 09:50:26.613534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:03.778 [2024-11-29 09:50:26.613566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.778 [2024-11-29 09:50:26.613584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.039 [2024-11-29 09:50:26.619919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.039 [2024-11-29 09:50:26.619951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.039 [2024-11-29 09:50:26.619984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.039 [2024-11-29 09:50:26.627348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.039 [2024-11-29 09:50:26.627379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.039 [2024-11-29 09:50:26.627404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.039 [2024-11-29 09:50:26.634344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.039 [2024-11-29 09:50:26.634390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.039 [2024-11-29 09:50:26.634435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.039 [2024-11-29 09:50:26.641223] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.039 [2024-11-29 09:50:26.641270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.039 [2024-11-29 09:50:26.641288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.039 [2024-11-29 09:50:26.646564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.039 [2024-11-29 09:50:26.646595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.039 [2024-11-29 09:50:26.646613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.651185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.651217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.651234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.656214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.656246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.656263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.660811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.660842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.660860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.666451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.666482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.666499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.671897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.671928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.671945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.677320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.677356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.677374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.683017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.683049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.683066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.688349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.688401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.688427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.693784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.693815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.693833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.699258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.699289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.699307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.704448] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.704477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.704495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.709683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.709713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.709746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.714750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.714780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.714797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.720093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.720123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.720142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.725311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.725340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.725357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.730254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.730282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.730299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.735330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.735359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.735376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.740559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.740589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.740607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.745768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.745797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.745814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.750641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.750671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.750687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.755637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.755671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.755702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.760907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.760939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.760956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.766072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.766102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.766119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.771101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.771132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.771162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.776792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.776823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.776847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.782241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.782272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.040 [2024-11-29 09:50:26.782288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.040 [2024-11-29 09:50:26.788160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.040 [2024-11-29 09:50:26.788206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.788223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.793910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.793941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.793958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.799279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.799309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.799326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.803341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.803372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.803389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.808011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.808040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.808057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.813218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.813248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.813279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.818475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.818506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.818523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.823354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.823391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.823423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.828261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.828290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.828306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.833501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.833532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.833549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.838716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.838747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.838765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.843474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.843504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.843522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.847649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.847679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.847695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.852057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.852087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.852103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.857065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.857095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.857112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.862027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.862056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.862072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.866974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.867005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.867022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.872011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.872041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.872058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.041 [2024-11-29 09:50:26.876928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.041 [2024-11-29 09:50:26.876958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.041 [2024-11-29 09:50:26.876975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.303 [2024-11-29 09:50:26.882034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.303 [2024-11-29 09:50:26.882065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.303 [2024-11-29 09:50:26.882082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.303 [2024-11-29 09:50:26.886999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.303 [2024-11-29 09:50:26.887030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.303 [2024-11-29 09:50:26.887047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.303 [2024-11-29 09:50:26.892154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.303 [2024-11-29 09:50:26.892184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.303 [2024-11-29 09:50:26.892201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.303 [2024-11-29 09:50:26.897073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.303 [2024-11-29 09:50:26.897102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.303 [2024-11-29 09:50:26.897119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.303 [2024-11-29 09:50:26.902263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.303 [2024-11-29 09:50:26.902294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.303 [2024-11-29 09:50:26.902311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.303 [2024-11-29 09:50:26.907694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.303 [2024-11-29 09:50:26.907724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.303 [2024-11-29 09:50:26.907749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.303 [2024-11-29 09:50:26.913030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.303 [2024-11-29 09:50:26.913061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.303 [2024-11-29 09:50:26.913079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.303 [2024-11-29 09:50:26.918931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.303 [2024-11-29 09:50:26.918962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.303 [2024-11-29 09:50:26.918980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.303 [2024-11-29 09:50:26.924197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.303 [2024-11-29 09:50:26.924227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.303 [2024-11-29 09:50:26.924261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.303 [2024-11-29 09:50:26.929643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.303 [2024-11-29 09:50:26.929674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.303 [2024-11-29 09:50:26.929690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.303 [2024-11-29 09:50:26.934377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.303 [2024-11-29 09:50:26.934416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.303 [2024-11-29 09:50:26.934434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.303 [2024-11-29 09:50:26.938951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.303 [2024-11-29 09:50:26.938983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.303 [2024-11-29 09:50:26.939001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.303 [2024-11-29 09:50:26.945061] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.303 [2024-11-29 09:50:26.945093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:26.945112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:26.951785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:26.951817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:26.951834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:26.957920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:26.957962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:26.957981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:26.964148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:26.964179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:26.964196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:26.970725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:26.970757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:26.970775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:26.977181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:26.977213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:26.977231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:26.982929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:26.982962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:26.982980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:26.987569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:26.987600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:26.987618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:26.992554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:26.992586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:26.992604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:26.997505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:26.997536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:26.997554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.002901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.002932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.002950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.008778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.008809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.008827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.015077] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.015110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.015128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.020932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.020964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.020981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.026789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.026820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.026839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.031856] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.031888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.031905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.036943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.036974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.036992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.040416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.040446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.040463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.046162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.046208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.046226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.052030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.052062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.052087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.056768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.056799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.056816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.061471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.061502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.061520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.066892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.066924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.066942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.070310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.070340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.070358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.074492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.074523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.074540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.079342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.079388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.079414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.084810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.304 [2024-11-29 09:50:27.084842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.304 [2024-11-29 09:50:27.084876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.304 [2024-11-29 09:50:27.089952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.305 [2024-11-29 09:50:27.089983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.305 [2024-11-29 09:50:27.090002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.305 [2024-11-29 09:50:27.094377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.305 [2024-11-29 09:50:27.094416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.305 [2024-11-29 09:50:27.094436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.305 [2024-11-29 09:50:27.098623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.305 [2024-11-29 09:50:27.098654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.305 [2024-11-29 09:50:27.098671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.305 [2024-11-29 09:50:27.102908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.305 [2024-11-29 09:50:27.102939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.305 [2024-11-29 09:50:27.102956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.305 [2024-11-29 09:50:27.107087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.305 [2024-11-29 09:50:27.107117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.305 [2024-11-29 09:50:27.107135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.305 [2024-11-29 09:50:27.112027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.305 [2024-11-29 09:50:27.112072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.305 [2024-11-29 09:50:27.112089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.305 [2024-11-29 09:50:27.117826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.305 [2024-11-29 09:50:27.117859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.305 [2024-11-29 09:50:27.117878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.305 [2024-11-29 09:50:27.123171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.305 [2024-11-29 09:50:27.123201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.305 [2024-11-29 09:50:27.123218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.305 [2024-11-29 09:50:27.128462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.305 [2024-11-29 09:50:27.128493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.305 [2024-11-29 09:50:27.128511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.305 [2024-11-29 09:50:27.133466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.305 [2024-11-29 09:50:27.133496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.305 [2024-11-29 09:50:27.133520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.305 [2024-11-29 09:50:27.138508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.305 [2024-11-29 09:50:27.138539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.305 [2024-11-29 09:50:27.138557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.567 [2024-11-29 09:50:27.143663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.567 [2024-11-29 09:50:27.143695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.567 [2024-11-29 09:50:27.143727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.567 [2024-11-29 09:50:27.148677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.567 [2024-11-29 09:50:27.148708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.567 [2024-11-29 09:50:27.148740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.567 [2024-11-29 09:50:27.154157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.567 [2024-11-29 09:50:27.154203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.567 [2024-11-29 09:50:27.154219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.567 [2024-11-29 09:50:27.159745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.567 [2024-11-29 09:50:27.159777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.567 [2024-11-29 09:50:27.159795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.567 [2024-11-29 09:50:27.163541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.567 [2024-11-29 09:50:27.163572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.567 [2024-11-29 09:50:27.163589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.567 [2024-11-29 09:50:27.167454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.567 [2024-11-29 09:50:27.167485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.567 [2024-11-29 09:50:27.167501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.567 [2024-11-29 09:50:27.172390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.567 [2024-11-29 09:50:27.172430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.567 [2024-11-29 09:50:27.172447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.567 [2024-11-29 09:50:27.177003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.567 [2024-11-29 09:50:27.177049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.567 [2024-11-29 09:50:27.177071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.567 [2024-11-29 09:50:27.182355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.567 [2024-11-29 09:50:27.182386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.567 [2024-11-29 09:50:27.182412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.567 [2024-11-29 09:50:27.188694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.567 [2024-11-29 09:50:27.188726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.567 [2024-11-29 09:50:27.188751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.567 [2024-11-29 09:50:27.195858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.567 [2024-11-29 09:50:27.195891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.567 [2024-11-29 09:50:27.195909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.567 [2024-11-29 09:50:27.203592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.567 [2024-11-29 09:50:27.203624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.567 [2024-11-29 09:50:27.203642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.567 [2024-11-29 09:50:27.211790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.211822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.211840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.219172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.219211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.219231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.225207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.225242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.225262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.231354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.231391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.231422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.237552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.237583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.237601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.243630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.243661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.243694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.249370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.249412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.249433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.254935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.254966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.254983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.260483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.260515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.260546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.265929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.265961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.265978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.271802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.271833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.271867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.277257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.277292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.277313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.281942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.281976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.282002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.286361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.286406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.286446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.290390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.290460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.290477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.294307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.294339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.294358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.298262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.298294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.298314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.302523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.302553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.302569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.305899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.305932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.305951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.310556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.310587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.310603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.315683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.315728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.315747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.320864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.320902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.320921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.326507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.326550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.326566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.331757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.331790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.331809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.337164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.337212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.337230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.342208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.342243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.342262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.347755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.347790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.568 [2024-11-29 09:50:27.347809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.568 [2024-11-29 09:50:27.352864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.568 [2024-11-29 09:50:27.352898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.569 [2024-11-29 09:50:27.352917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.569 [2024-11-29 09:50:27.358267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.569 [2024-11-29 09:50:27.358316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.569 [2024-11-29 09:50:27.358334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.569 [2024-11-29 09:50:27.363346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.569 [2024-11-29 09:50:27.363378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.569 [2024-11-29 09:50:27.363406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.569 [2024-11-29 09:50:27.368652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.569 [2024-11-29 09:50:27.368695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.569 [2024-11-29 09:50:27.368711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.569 [2024-11-29 09:50:27.374123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.569 [2024-11-29 09:50:27.374156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.569 [2024-11-29 09:50:27.374175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.569 [2024-11-29 09:50:27.378638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.569 [2024-11-29 09:50:27.378667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.569 [2024-11-29 09:50:27.378683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.569 [2024-11-29 09:50:27.382918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.569 [2024-11-29 09:50:27.382951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.569 [2024-11-29 09:50:27.382970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.569 [2024-11-29 09:50:27.386895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.569 [2024-11-29 09:50:27.386925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.569 [2024-11-29 09:50:27.386960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.569 [2024-11-29 09:50:27.391519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.569 [2024-11-29 09:50:27.391549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.569 [2024-11-29 09:50:27.391566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.569 [2024-11-29 09:50:27.395569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.569 [2024-11-29 09:50:27.395598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.569 [2024-11-29 09:50:27.395614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.569 [2024-11-29 09:50:27.399653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.569 [2024-11-29 09:50:27.399683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.569 [2024-11-29 09:50:27.399699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.569 [2024-11-29 09:50:27.404638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.569 [2024-11-29 09:50:27.404672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.569 [2024-11-29 09:50:27.404704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.409938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.409973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.409992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.415302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.415335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.415353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.420544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.420573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.420604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.425771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.425803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.425822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.431100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.431132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.431150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.436233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.436266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.436285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.441598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.441643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.441659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.447079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.447113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.447133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.451297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.451330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.451349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.455640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.455670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.455686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.459380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.459437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.459455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.463143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.463176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.463194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.466990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.467024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.467043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.471011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.471044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.471063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.474948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.474981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.475000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.478821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.478850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.478867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.482684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.482713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.482735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.486329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.486361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.486379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.490466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.490495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.490513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.495850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.495883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.832 [2024-11-29 09:50:27.495901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.832 [2024-11-29 09:50:27.501410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.832 [2024-11-29 09:50:27.501470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.501487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.506894] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.506927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.506946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.512439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.512480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.512497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.518051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.518084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.518102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.523286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.523316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.523332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.528531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.528566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.528583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.533847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.533877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.533894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.539170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.539203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.539222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.544565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.544595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.544612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.549659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.549688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.549705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.555147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.555181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.555200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.560856] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.560890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.560910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.566288] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.566321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.566339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.571121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.571154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.571173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.574805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.574838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.574857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.579433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.579478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.579495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.584610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.584640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.584657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.589843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.589874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.589891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.595067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.595101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.595121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.600618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.600649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.600667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.606765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.606800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.606819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.611708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.611736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.611770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.617339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.617383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.617417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.623026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.623061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.623080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.628908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.628956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.628976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.634536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.634566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.634583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.639856] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.639889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.639907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.833 [2024-11-29 09:50:27.645035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.833 [2024-11-29 09:50:27.645068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.833 [2024-11-29 09:50:27.645088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.834 [2024-11-29 09:50:27.650866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.834 [2024-11-29 09:50:27.650899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.834 [2024-11-29 09:50:27.650918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.834 [2024-11-29 09:50:27.656738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.834 [2024-11-29 09:50:27.656785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.834 [2024-11-29 09:50:27.656804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.834 [2024-11-29 09:50:27.662611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.834 [2024-11-29 09:50:27.662643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.834 [2024-11-29 09:50:27.662661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.834 [2024-11-29 09:50:27.668017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:04.834 [2024-11-29 09:50:27.668051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.834 [2024-11-29 09:50:27.668070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.673435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.673484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.673503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.678958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.678992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.679011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.684472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.684505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.684523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.689841] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.689876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.689895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.695194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.695229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.695247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.700513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.700544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.700561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.705861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.705894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.705913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.711410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.711444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.711469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.716681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.716715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.716734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.722055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.722089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.722108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.727588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.727634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.727651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.733146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.733181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.733200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.739053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.739088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.739107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.744378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.744420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.744441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.749756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.749790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.749809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.755237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.755272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.755291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.759647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.759682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.759700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.763800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.763830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.763846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.096 [2024-11-29 09:50:27.767999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.096 [2024-11-29 09:50:27.768032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.096 [2024-11-29 09:50:27.768051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.771952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.771981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.771998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.775853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.775883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.775900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.779816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.779850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.779870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.783830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.783860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.783877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.787760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.787790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.787807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.791620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.791650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.791668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.795530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.795559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.795576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.799485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.799515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.799533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.803247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.803279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.803297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.807190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.807222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.807241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.811875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.811922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.811941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.817332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.817364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.817383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.822675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.822705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.822723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.827732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.827780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.827800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.832380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.832435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.832460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.837419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.837476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.837494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.842680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.842725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.842744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.848207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.848241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.848262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.852868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.852917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.852937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.857389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.857455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.857473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.862365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.862422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.862468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.867682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.867711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.867744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.872997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.873043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.873062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.878232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.878264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.878283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.883512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.883541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.883558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.888565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.888594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.097 [2024-11-29 09:50:27.888611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.097 [2024-11-29 09:50:27.893869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.097 [2024-11-29 09:50:27.893901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.098 [2024-11-29 09:50:27.893920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.098 [2024-11-29 09:50:27.899351] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.098 [2024-11-29 09:50:27.899384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.098 [2024-11-29 09:50:27.899414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.098 [2024-11-29 09:50:27.904404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.098 [2024-11-29 09:50:27.904459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.098 [2024-11-29 09:50:27.904476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.098 [2024-11-29 09:50:27.909617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.098 [2024-11-29 09:50:27.909648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.098 [2024-11-29 09:50:27.909665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.098 [2024-11-29 09:50:27.914669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.098 [2024-11-29 09:50:27.914699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.098 [2024-11-29 09:50:27.914716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.098 [2024-11-29 09:50:27.919665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.098 [2024-11-29 09:50:27.919695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.098 [2024-11-29 09:50:27.919718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.098 [2024-11-29 09:50:27.924892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.098 [2024-11-29 09:50:27.924923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.098 [2024-11-29 09:50:27.924940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.098 [2024-11-29 09:50:27.930519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.098 [2024-11-29 09:50:27.930549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.098 [2024-11-29 09:50:27.930566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.098 [2024-11-29 09:50:27.935842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.098 [2024-11-29 09:50:27.935873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.098 [2024-11-29 09:50:27.935890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:27.941360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:27.941403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:27.941426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:27.946721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:27.946755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:27.946774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:27.951716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:27.951746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:27.951763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:27.956493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:27.956523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:27.956540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:27.960527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:27.960557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:27.960574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:27.964419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:27.964473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:27.964491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:27.968216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:27.968247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:27.968265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:27.972386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:27.972426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:27.972460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:27.977227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:27.977262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:27.977281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:27.982728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:27.982776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:27.982796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:27.988220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:27.988254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:27.988274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:27.993613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:27.993645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:27.993663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:27.999015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:27.999049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:27.999068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:28.004419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:28.004450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:28.004467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:28.009722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:28.009753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:28.009770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:28.015417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:28.015447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:28.015465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:28.020837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:28.020869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:28.020886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:28.026121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:28.026151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:28.026168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:28.031521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:28.031553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:28.031570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:28.036594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:28.036624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:28.036641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:28.041842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:28.041889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:28.041908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:28.046960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:28.047005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:28.047022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:28.052020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:28.052050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.360 [2024-11-29 09:50:28.052090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.360 [2024-11-29 09:50:28.057317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.360 [2024-11-29 09:50:28.057347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.057378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.062681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.062711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.062727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.067966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.067996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.068013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.073442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.073472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.073490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.078847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.078895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.078913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.084509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.084540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.084557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.089758] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.089803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.089823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.095149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.095180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.095196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.099905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.099936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.099953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.105485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.105517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.105534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.111475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.111505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.111522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.115924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.115957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.115975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.123376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.123420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.123455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.131611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.131642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.131659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.138663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.138711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.138731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.146210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.146244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.146263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.153902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.153937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.153963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.161590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.161621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.161638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.169020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.169055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.169074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.176439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.176470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.176488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.183923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.183957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.183977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.191742] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.191777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.191796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.361 [2024-11-29 09:50:28.200133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.361 [2024-11-29 09:50:28.200169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.361 [2024-11-29 09:50:28.200189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.621 [2024-11-29 09:50:28.206968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.621 [2024-11-29 09:50:28.207004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.621 [2024-11-29 09:50:28.207024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.621 [2024-11-29 09:50:28.213987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.621 [2024-11-29 09:50:28.214022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.621 [2024-11-29 09:50:28.214041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.621 [2024-11-29 09:50:28.220442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.621 [2024-11-29 09:50:28.220479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.621 [2024-11-29 09:50:28.220497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.621 [2024-11-29 09:50:28.225790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.621 [2024-11-29 09:50:28.225821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.621 [2024-11-29 09:50:28.225838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.621 [2024-11-29 09:50:28.230282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.621 [2024-11-29 09:50:28.230313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.621 [2024-11-29 09:50:28.230330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.621 [2024-11-29 09:50:28.235100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.621 [2024-11-29 09:50:28.235132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.621 [2024-11-29 09:50:28.235148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.621 [2024-11-29 09:50:28.240043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.621 [2024-11-29 09:50:28.240073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.621 [2024-11-29 09:50:28.240091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.621 [2024-11-29 09:50:28.245133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.621 [2024-11-29 09:50:28.245163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.621 [2024-11-29 09:50:28.245180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.621 [2024-11-29 09:50:28.250145] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.621 [2024-11-29 09:50:28.250176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.621 [2024-11-29 09:50:28.250193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.621 [2024-11-29 09:50:28.255354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.621 [2024-11-29 09:50:28.255385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.621 [2024-11-29 09:50:28.255411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.621 [2024-11-29 09:50:28.260414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.621 [2024-11-29 09:50:28.260445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.622 [2024-11-29 09:50:28.260462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.622 [2024-11-29 09:50:28.265418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.622 [2024-11-29 09:50:28.265464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.622 [2024-11-29 09:50:28.265481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.622 [2024-11-29 09:50:28.270335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.622 [2024-11-29 09:50:28.270366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.622 [2024-11-29 09:50:28.270383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.622 [2024-11-29 09:50:28.275423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.622 [2024-11-29 09:50:28.275453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.622 [2024-11-29 09:50:28.275471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.622 [2024-11-29 09:50:28.280522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.622 [2024-11-29 09:50:28.280552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.622 [2024-11-29 09:50:28.280569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.622 [2024-11-29 09:50:28.285762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.622 [2024-11-29 09:50:28.285792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.622 [2024-11-29 09:50:28.285809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.622 [2024-11-29 09:50:28.290422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.622 [2024-11-29 09:50:28.290470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.622 [2024-11-29 09:50:28.290488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.622 [2024-11-29 09:50:28.294566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.622 [2024-11-29 09:50:28.294596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.622 [2024-11-29 09:50:28.294612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.622 [2024-11-29 09:50:28.299537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.622 [2024-11-29 09:50:28.299567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.622 [2024-11-29 09:50:28.299585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.622 [2024-11-29 09:50:28.304696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.622 [2024-11-29 09:50:28.304741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.622 [2024-11-29 09:50:28.304781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.622 [2024-11-29 09:50:28.310033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.622 [2024-11-29 09:50:28.310066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.622 [2024-11-29 09:50:28.310085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.622 [2024-11-29 09:50:28.315143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.622 [2024-11-29 09:50:28.315177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.622 [2024-11-29 09:50:28.315196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.622 [2024-11-29 09:50:28.320413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1655bb0) 00:27:05.622 [2024-11-29 09:50:28.320442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.622 [2024-11-29 09:50:28.320458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.622 00:27:05.622 Latency(us) 00:27:05.622 [2024-11-29T08:50:28.465Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:05.622 [2024-11-29T08:50:28.465Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:05.622 nvme0n1 : 2.00 5978.73 747.34 0.00 0.00 2671.58 552.20 8495.41 00:27:05.622 [2024-11-29T08:50:28.465Z] =================================================================================================================== 00:27:05.622 [2024-11-29T08:50:28.465Z] Total : 5978.73 747.34 0.00 0.00 2671.58 552.20 8495.41 00:27:05.622 0 00:27:05.622 09:50:28 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:05.622 09:50:28 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:05.622 09:50:28 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:05.622 | .driver_specific 00:27:05.622 | .nvme_error 00:27:05.622 | .status_code 00:27:05.622 | .command_transient_transport_error' 00:27:05.622 09:50:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:05.881 09:50:28 -- host/digest.sh@71 -- # (( 386 > 0 )) 00:27:05.881 09:50:28 -- host/digest.sh@73 -- # killprocess 140647 00:27:05.881 09:50:28 -- common/autotest_common.sh@936 -- # '[' -z 140647 ']' 00:27:05.881 09:50:28 -- common/autotest_common.sh@940 -- # kill -0 140647 00:27:05.881 09:50:28 -- common/autotest_common.sh@941 -- # uname 00:27:05.881 09:50:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:05.881 09:50:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 140647 00:27:05.881 09:50:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:05.881 09:50:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:05.881 09:50:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 140647' 00:27:05.881 killing process with pid 140647 00:27:05.881 09:50:28 -- common/autotest_common.sh@955 -- # kill 140647 00:27:05.881 Received shutdown signal, test time was about 2.000000 seconds 00:27:05.881 00:27:05.881 Latency(us) 00:27:05.881 [2024-11-29T08:50:28.724Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:05.881 [2024-11-29T08:50:28.724Z] =================================================================================================================== 00:27:05.881 [2024-11-29T08:50:28.724Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:05.881 09:50:28 -- common/autotest_common.sh@960 -- # wait 140647 00:27:06.140 09:50:28 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:06.140 09:50:28 -- host/digest.sh@54 -- # local rw bs qd 00:27:06.140 09:50:28 -- host/digest.sh@56 -- # rw=randwrite 00:27:06.140 09:50:28 -- host/digest.sh@56 -- # bs=4096 00:27:06.140 09:50:28 -- host/digest.sh@56 -- # qd=128 00:27:06.140 09:50:28 -- host/digest.sh@58 -- # bperfpid=141193 00:27:06.140 09:50:28 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:06.140 09:50:28 -- host/digest.sh@60 -- # waitforlisten 141193 /var/tmp/bperf.sock 00:27:06.140 09:50:28 -- common/autotest_common.sh@829 -- # '[' -z 141193 ']' 00:27:06.140 09:50:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:06.140 09:50:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:06.140 09:50:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:06.140 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:06.140 09:50:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:06.140 09:50:28 -- common/autotest_common.sh@10 -- # set +x 00:27:06.140 [2024-11-29 09:50:28.922281] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:06.140 [2024-11-29 09:50:28.922372] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid141193 ] 00:27:06.140 EAL: No free 2048 kB hugepages reported on node 1 00:27:06.400 [2024-11-29 09:50:28.985554] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:06.400 [2024-11-29 09:50:29.103604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:07.336 09:50:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:07.336 09:50:29 -- common/autotest_common.sh@862 -- # return 0 00:27:07.336 09:50:29 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:07.336 09:50:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:07.594 09:50:30 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:07.594 09:50:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:07.594 09:50:30 -- common/autotest_common.sh@10 -- # set +x 00:27:07.594 09:50:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:07.594 09:50:30 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:07.594 09:50:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:07.852 nvme0n1 00:27:07.852 09:50:30 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:07.852 09:50:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:07.852 09:50:30 -- common/autotest_common.sh@10 -- # set +x 00:27:07.852 09:50:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:07.852 09:50:30 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:07.852 09:50:30 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:08.112 Running I/O for 2 seconds... 00:27:08.112 [2024-11-29 09:50:30.772178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190eea00 00:27:08.112 [2024-11-29 09:50:30.773647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:1200 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.112 [2024-11-29 09:50:30.773715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.112 [2024-11-29 09:50:30.785349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190eea00 00:27:08.112 [2024-11-29 09:50:30.786406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:12558 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.112 [2024-11-29 09:50:30.786469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:08.112 [2024-11-29 09:50:30.797231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e7c50 00:27:08.112 [2024-11-29 09:50:30.799170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:1842 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.112 [2024-11-29 09:50:30.799205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:08.112 [2024-11-29 09:50:30.809807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e1b48 00:27:08.112 [2024-11-29 09:50:30.810968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:3648 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.112 [2024-11-29 09:50:30.811003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.112 [2024-11-29 09:50:30.821561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e4de8 00:27:08.112 [2024-11-29 09:50:30.822949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:3727 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.112 [2024-11-29 09:50:30.822985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:08.112 [2024-11-29 09:50:30.834160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190efae0 00:27:08.112 [2024-11-29 09:50:30.835084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:5193 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.112 [2024-11-29 09:50:30.835118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.112 [2024-11-29 09:50:30.846412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f35f0 00:27:08.112 [2024-11-29 09:50:30.847072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:13069 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.112 [2024-11-29 09:50:30.847107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:08.112 [2024-11-29 09:50:30.858617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e6300 00:27:08.112 [2024-11-29 09:50:30.859221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:5481 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.112 [2024-11-29 09:50:30.859255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:08.112 [2024-11-29 09:50:30.870875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e12d8 00:27:08.112 [2024-11-29 09:50:30.871456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:529 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.112 [2024-11-29 09:50:30.871486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:08.112 [2024-11-29 09:50:30.883094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e1710 00:27:08.112 [2024-11-29 09:50:30.883613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:11189 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.112 [2024-11-29 09:50:30.883643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:08.112 [2024-11-29 09:50:30.895199] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5658 00:27:08.112 [2024-11-29 09:50:30.895692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24399 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.112 [2024-11-29 09:50:30.895722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:08.112 [2024-11-29 09:50:30.907200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f6890 00:27:08.112 [2024-11-29 09:50:30.907617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:18380 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.112 [2024-11-29 09:50:30.907649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:08.112 [2024-11-29 09:50:30.919623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190df988 00:27:08.112 [2024-11-29 09:50:30.920458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:12536 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.112 [2024-11-29 09:50:30.920489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:08.113 [2024-11-29 09:50:30.931790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190de8a8 00:27:08.113 [2024-11-29 09:50:30.933370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:6784 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.113 [2024-11-29 09:50:30.933412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:08.113 [2024-11-29 09:50:30.943336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ef270 00:27:08.113 [2024-11-29 09:50:30.944343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:4849 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.113 [2024-11-29 09:50:30.944377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:27:08.373 [2024-11-29 09:50:30.957798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ecc78 00:27:08.373 [2024-11-29 09:50:30.959576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:22927 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.373 [2024-11-29 09:50:30.959607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:08.373 [2024-11-29 09:50:30.970285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5658 00:27:08.373 [2024-11-29 09:50:30.971585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:247 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.373 [2024-11-29 09:50:30.971615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:08.373 [2024-11-29 09:50:30.982574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f7100 00:27:08.373 [2024-11-29 09:50:30.983587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:2889 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.373 [2024-11-29 09:50:30.983632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:08.373 [2024-11-29 09:50:30.994677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190fa3a0 00:27:08.373 [2024-11-29 09:50:30.995620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:2011 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.373 [2024-11-29 09:50:30.995665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:08.373 [2024-11-29 09:50:31.006956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ea680 00:27:08.373 [2024-11-29 09:50:31.007875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:3399 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.373 [2024-11-29 09:50:31.007909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:08.373 [2024-11-29 09:50:31.019119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e3060 00:27:08.373 [2024-11-29 09:50:31.019966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:14765 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.020000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.031414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e6b70 00:27:08.374 [2024-11-29 09:50:31.032214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:540 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.032249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.042758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f1ca0 00:27:08.374 [2024-11-29 09:50:31.044135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:3307 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.044169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.055389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190eb760 00:27:08.374 [2024-11-29 09:50:31.056254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:11771 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.056288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.067672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190de470 00:27:08.374 [2024-11-29 09:50:31.068626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:6831 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.068658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.079848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190fb480 00:27:08.374 [2024-11-29 09:50:31.080845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:10870 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.080879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.092054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f4f40 00:27:08.374 [2024-11-29 09:50:31.092757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:7141 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.092791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.104195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f0ff8 00:27:08.374 [2024-11-29 09:50:31.105222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:16671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.105262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.116290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f9f68 00:27:08.374 [2024-11-29 09:50:31.116992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:8570 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.117027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.128620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f5378 00:27:08.374 [2024-11-29 09:50:31.129360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:9541 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.129401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.140783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f5378 00:27:08.374 [2024-11-29 09:50:31.141535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:12166 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.141565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.152980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f9f68 00:27:08.374 [2024-11-29 09:50:31.153713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:23705 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.153759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.165108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f0ff8 00:27:08.374 [2024-11-29 09:50:31.165902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:4995 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.165937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.177088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f4f40 00:27:08.374 [2024-11-29 09:50:31.177975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:5864 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.178010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.188688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e6b70 00:27:08.374 [2024-11-29 09:50:31.189800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:10616 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.189835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.200885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e0a68 00:27:08.374 [2024-11-29 09:50:31.202024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:20671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.202058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:27:08.374 [2024-11-29 09:50:31.213121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f46d0 00:27:08.374 [2024-11-29 09:50:31.214266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:15402 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.374 [2024-11-29 09:50:31.214307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.225401] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e6fa8 00:27:08.635 [2024-11-29 09:50:31.226590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:18729 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.226621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.237726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f8618 00:27:08.635 [2024-11-29 09:50:31.238887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:4177 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.238921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.249951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e4140 00:27:08.635 [2024-11-29 09:50:31.251165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:20053 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.251199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.262205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f46d0 00:27:08.635 [2024-11-29 09:50:31.263370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:23233 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.263413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.274748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ec408 00:27:08.635 [2024-11-29 09:50:31.275511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:21834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.275542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.287050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e0630 00:27:08.635 [2024-11-29 09:50:31.287478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:6558 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.287523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.299104] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f0350 00:27:08.635 [2024-11-29 09:50:31.299491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:3219 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.299537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.311159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f92c0 00:27:08.635 [2024-11-29 09:50:31.311532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:10378 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.311561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.323374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5ec8 00:27:08.635 [2024-11-29 09:50:31.323668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:13813 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.323712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.337772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190fd640 00:27:08.635 [2024-11-29 09:50:31.339610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:21463 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.339638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.350501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e27f0 00:27:08.635 [2024-11-29 09:50:31.351447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:14108 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.351480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.361266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190eaab8 00:27:08.635 [2024-11-29 09:50:31.362551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:12981 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.362581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.373511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190eaab8 00:27:08.635 [2024-11-29 09:50:31.375043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:8521 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.375076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.385668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190eaab8 00:27:08.635 [2024-11-29 09:50:31.387242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:9317 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.387276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.397250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ec408 00:27:08.635 [2024-11-29 09:50:31.398381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:21510 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.398424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.409533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190eaab8 00:27:08.635 [2024-11-29 09:50:31.410579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:1125 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.410611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.421756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ebfd0 00:27:08.635 [2024-11-29 09:50:31.422859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:23251 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.422893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.433883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ed920 00:27:08.635 [2024-11-29 09:50:31.435014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:8610 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.435049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.446090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ecc78 00:27:08.635 [2024-11-29 09:50:31.447220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:11736 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.447254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.458829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.635 [2024-11-29 09:50:31.459615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:20650 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.459659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:08.635 [2024-11-29 09:50:31.471483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.635 [2024-11-29 09:50:31.472553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:21905 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.635 [2024-11-29 09:50:31.472584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:08.894 [2024-11-29 09:50:31.483799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.895 [2024-11-29 09:50:31.484884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:20696 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.484919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.496215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.895 [2024-11-29 09:50:31.497306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:5510 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.497339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.508596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.895 [2024-11-29 09:50:31.509686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:1159 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.509717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.521102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.895 [2024-11-29 09:50:31.522182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:14833 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.522215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.533550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.895 [2024-11-29 09:50:31.534648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:13376 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.534702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.545994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.895 [2024-11-29 09:50:31.547124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:6262 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.547157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.558381] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.895 [2024-11-29 09:50:31.559658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:13548 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.559707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.570918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.895 [2024-11-29 09:50:31.572100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:20430 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.572133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.583321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.895 [2024-11-29 09:50:31.584633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:12548 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.584679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.595921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.895 [2024-11-29 09:50:31.597115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:4733 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.597148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.608356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.895 [2024-11-29 09:50:31.609708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:8381 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.609741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.620832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.895 [2024-11-29 09:50:31.622081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:2169 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.622115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.633286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.895 [2024-11-29 09:50:31.634557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:17725 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.634601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.644983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f0350 00:27:08.895 [2024-11-29 09:50:31.646189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:21474 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.646222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.657523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5ec8 00:27:08.895 [2024-11-29 09:50:31.658288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:17096 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.658321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.670127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:08.895 [2024-11-29 09:50:31.671016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:9389 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.671049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.682273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ff3c8 00:27:08.895 [2024-11-29 09:50:31.683750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:12788 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.683782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.695445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e0a68 00:27:08.895 [2024-11-29 09:50:31.696022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:14169 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.696055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.707805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e0630 00:27:08.895 [2024-11-29 09:50:31.708628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:14290 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.708677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.719870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f7970 00:27:08.895 [2024-11-29 09:50:31.720640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:8857 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.720670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:08.895 [2024-11-29 09:50:31.732126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e84c0 00:27:08.895 [2024-11-29 09:50:31.732929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:13604 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.895 [2024-11-29 09:50:31.732963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:09.154 [2024-11-29 09:50:31.744357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e38d0 00:27:09.154 [2024-11-29 09:50:31.745048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:8200 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.154 [2024-11-29 09:50:31.745082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:09.154 [2024-11-29 09:50:31.756768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190fda78 00:27:09.154 [2024-11-29 09:50:31.757451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:19594 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.154 [2024-11-29 09:50:31.757482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.769098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f0350 00:27:09.155 [2024-11-29 09:50:31.769705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:24536 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.769736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.781378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190df118 00:27:09.155 [2024-11-29 09:50:31.781983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:10165 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.782017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.794049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f8e88 00:27:09.155 [2024-11-29 09:50:31.795013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:13188 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.795047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.806629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:09.155 [2024-11-29 09:50:31.807474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:15251 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.807519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.818795] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e6300 00:27:09.155 [2024-11-29 09:50:31.819584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:21371 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.819615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.831025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ea680 00:27:09.155 [2024-11-29 09:50:31.831765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:11138 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.831799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.843391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e1b48 00:27:09.155 [2024-11-29 09:50:31.844108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:19412 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.844142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.855703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f0788 00:27:09.155 [2024-11-29 09:50:31.856357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:14206 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.856408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.868026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ecc78 00:27:09.155 [2024-11-29 09:50:31.868645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:22524 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.868675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.880258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e2c28 00:27:09.155 [2024-11-29 09:50:31.880923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:10578 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.880956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.892539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e4de8 00:27:09.155 [2024-11-29 09:50:31.893186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:363 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.893219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.904617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5658 00:27:09.155 [2024-11-29 09:50:31.905317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:15563 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.905350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.916741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e2c28 00:27:09.155 [2024-11-29 09:50:31.917521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:22860 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.917552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.928653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f7538 00:27:09.155 [2024-11-29 09:50:31.930345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:21217 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.930378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.941770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190feb58 00:27:09.155 [2024-11-29 09:50:31.943529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:20785 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.943559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.954714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ed0b0 00:27:09.155 [2024-11-29 09:50:31.956185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:13294 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.956217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.965301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f9f68 00:27:09.155 [2024-11-29 09:50:31.966321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:3781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.966354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.977174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190df550 00:27:09.155 [2024-11-29 09:50:31.978526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:22744 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.978556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:27:09.155 [2024-11-29 09:50:31.988907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190de8a8 00:27:09.155 [2024-11-29 09:50:31.989348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:12923 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.155 [2024-11-29 09:50:31.989381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0020 p:0 m:0 dnr:0 00:27:09.414 [2024-11-29 09:50:32.001278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f5be8 00:27:09.414 [2024-11-29 09:50:32.002288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:2886 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.414 [2024-11-29 09:50:32.002323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0030 p:0 m:0 dnr:0 00:27:09.414 [2024-11-29 09:50:32.013781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ecc78 00:27:09.414 [2024-11-29 09:50:32.014544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:13624 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.414 [2024-11-29 09:50:32.014588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:27:09.414 [2024-11-29 09:50:32.025614] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f7970 00:27:09.414 [2024-11-29 09:50:32.026163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:3279 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.414 [2024-11-29 09:50:32.026193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.414 [2024-11-29 09:50:32.036796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190fb480 00:27:09.414 [2024-11-29 09:50:32.037155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:20748 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.414 [2024-11-29 09:50:32.037185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:09.414 [2024-11-29 09:50:32.047836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190fa7d8 00:27:09.414 [2024-11-29 09:50:32.048311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:1320 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.414 [2024-11-29 09:50:32.048341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:09.414 [2024-11-29 09:50:32.059655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f7538 00:27:09.414 [2024-11-29 09:50:32.061134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:16608 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.414 [2024-11-29 09:50:32.061164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:09.414 [2024-11-29 09:50:32.071825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e0ea0 00:27:09.414 [2024-11-29 09:50:32.073034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24402 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.414 [2024-11-29 09:50:32.073068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:09.414 [2024-11-29 09:50:32.084948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e0ea0 00:27:09.414 [2024-11-29 09:50:32.086602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:12062 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.414 [2024-11-29 09:50:32.086631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.414 [2024-11-29 09:50:32.097936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ec408 00:27:09.414 [2024-11-29 09:50:32.099205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:19921 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.414 [2024-11-29 09:50:32.099238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:09.414 [2024-11-29 09:50:32.110569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190fc128 00:27:09.414 [2024-11-29 09:50:32.111854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:8043 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.414 [2024-11-29 09:50:32.111886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.414 [2024-11-29 09:50:32.122573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f0ff8 00:27:09.414 [2024-11-29 09:50:32.124353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:9688 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.414 [2024-11-29 09:50:32.124386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.414 [2024-11-29 09:50:32.134744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190edd58 00:27:09.414 [2024-11-29 09:50:32.136516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:21330 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.414 [2024-11-29 09:50:32.136545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:09.414 [2024-11-29 09:50:32.147456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f7100 00:27:09.414 [2024-11-29 09:50:32.149144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:20854 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.414 [2024-11-29 09:50:32.149177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:09.414 [2024-11-29 09:50:32.159590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e7818 00:27:09.414 [2024-11-29 09:50:32.161292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:22007 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.414 [2024-11-29 09:50:32.161325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:09.415 [2024-11-29 09:50:32.171899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e9e10 00:27:09.415 [2024-11-29 09:50:32.173649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:6348 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.415 [2024-11-29 09:50:32.173697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:09.415 [2024-11-29 09:50:32.184234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e1b48 00:27:09.415 [2024-11-29 09:50:32.185966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:5825 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.415 [2024-11-29 09:50:32.185999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:09.415 [2024-11-29 09:50:32.196389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f96f8 00:27:09.415 [2024-11-29 09:50:32.198159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:17976 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.415 [2024-11-29 09:50:32.198193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:09.415 [2024-11-29 09:50:32.207306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e88f8 00:27:09.415 [2024-11-29 09:50:32.208356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25361 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.415 [2024-11-29 09:50:32.208390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:09.415 [2024-11-29 09:50:32.219369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e88f8 00:27:09.415 [2024-11-29 09:50:32.220909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:16775 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.415 [2024-11-29 09:50:32.220943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:09.415 [2024-11-29 09:50:32.231174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e7818 00:27:09.415 [2024-11-29 09:50:32.232232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:22253 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.415 [2024-11-29 09:50:32.232266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:27:09.415 [2024-11-29 09:50:32.243512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ebfd0 00:27:09.415 [2024-11-29 09:50:32.244593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:24103 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.415 [2024-11-29 09:50:32.244622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:27:09.680 [2024-11-29 09:50:32.255773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e1b48 00:27:09.680 [2024-11-29 09:50:32.256870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:10422 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.680 [2024-11-29 09:50:32.256904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:27:09.680 [2024-11-29 09:50:32.267912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e1f80 00:27:09.680 [2024-11-29 09:50:32.269048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:5203 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.680 [2024-11-29 09:50:32.269082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:27:09.680 [2024-11-29 09:50:32.280174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e4de8 00:27:09.680 [2024-11-29 09:50:32.281296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:20432 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.680 [2024-11-29 09:50:32.281330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:09.680 [2024-11-29 09:50:32.292340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e1b48 00:27:09.680 [2024-11-29 09:50:32.293493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:4422 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.680 [2024-11-29 09:50:32.293524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:27:09.680 [2024-11-29 09:50:32.304969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e23b8 00:27:09.680 [2024-11-29 09:50:32.305701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:20054 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.680 [2024-11-29 09:50:32.305748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:09.680 [2024-11-29 09:50:32.317162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f81e0 00:27:09.680 [2024-11-29 09:50:32.317580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:8809 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.680 [2024-11-29 09:50:32.317611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:27:09.680 [2024-11-29 09:50:32.329221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e9e10 00:27:09.680 [2024-11-29 09:50:32.329618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:5580 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.680 [2024-11-29 09:50:32.329648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:27:09.680 [2024-11-29 09:50:32.341313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f0788 00:27:09.680 [2024-11-29 09:50:32.341658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:16261 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.680 [2024-11-29 09:50:32.341702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:27:09.680 [2024-11-29 09:50:32.353571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190feb58 00:27:09.680 [2024-11-29 09:50:32.353978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:1740 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.680 [2024-11-29 09:50:32.354012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:27:09.680 [2024-11-29 09:50:32.365677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f0788 00:27:09.680 [2024-11-29 09:50:32.365978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:23538 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.680 [2024-11-29 09:50:32.366011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:27:09.680 [2024-11-29 09:50:32.380020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e9e10 00:27:09.680 [2024-11-29 09:50:32.381806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:24503 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.680 [2024-11-29 09:50:32.381840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.681 [2024-11-29 09:50:32.392308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190edd58 00:27:09.681 [2024-11-29 09:50:32.394158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:3783 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.681 [2024-11-29 09:50:32.394192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:09.681 [2024-11-29 09:50:32.404567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f7da8 00:27:09.681 [2024-11-29 09:50:32.406384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23141 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.681 [2024-11-29 09:50:32.406440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:09.681 [2024-11-29 09:50:32.416450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f4b08 00:27:09.681 [2024-11-29 09:50:32.417452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:9737 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.681 [2024-11-29 09:50:32.417482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:27:09.681 [2024-11-29 09:50:32.428979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e99d8 00:27:09.681 [2024-11-29 09:50:32.430506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:7383 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.681 [2024-11-29 09:50:32.430537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:09.681 [2024-11-29 09:50:32.441143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ebb98 00:27:09.681 [2024-11-29 09:50:32.442655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:18652 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.681 [2024-11-29 09:50:32.442685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:09.681 [2024-11-29 09:50:32.453612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ff3c8 00:27:09.681 [2024-11-29 09:50:32.454916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:22753 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.681 [2024-11-29 09:50:32.454949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:09.681 [2024-11-29 09:50:32.464248] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f8a50 00:27:09.681 [2024-11-29 09:50:32.465155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:20662 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.681 [2024-11-29 09:50:32.465188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:09.681 [2024-11-29 09:50:32.476622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ddc00 00:27:09.681 [2024-11-29 09:50:32.477495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:9954 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.681 [2024-11-29 09:50:32.477525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:09.681 [2024-11-29 09:50:32.488577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e1710 00:27:09.681 [2024-11-29 09:50:32.489621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:18823 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.681 [2024-11-29 09:50:32.489651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:27:09.681 [2024-11-29 09:50:32.501028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f4b08 00:27:09.681 [2024-11-29 09:50:32.502073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:11116 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.681 [2024-11-29 09:50:32.502113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:27:09.681 [2024-11-29 09:50:32.513253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f7538 00:27:09.681 [2024-11-29 09:50:32.514292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:7411 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.681 [2024-11-29 09:50:32.514324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:27:09.942 [2024-11-29 09:50:32.525662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f92c0 00:27:09.942 [2024-11-29 09:50:32.526744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:23548 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.942 [2024-11-29 09:50:32.526777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:27:09.942 [2024-11-29 09:50:32.537870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190ddc00 00:27:09.942 [2024-11-29 09:50:32.538964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:7289 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.942 [2024-11-29 09:50:32.538997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:27:09.942 [2024-11-29 09:50:32.550492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190fc560 00:27:09.942 [2024-11-29 09:50:32.551177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:4772 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.942 [2024-11-29 09:50:32.551209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:27:09.942 [2024-11-29 09:50:32.562801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190de470 00:27:09.942 [2024-11-29 09:50:32.563793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:16042 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.942 [2024-11-29 09:50:32.563826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:09.942 [2024-11-29 09:50:32.575202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:09.942 [2024-11-29 09:50:32.576188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:5308 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.942 [2024-11-29 09:50:32.576221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:09.942 [2024-11-29 09:50:32.587472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:09.942 [2024-11-29 09:50:32.588439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:13140 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.942 [2024-11-29 09:50:32.588486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:09.942 [2024-11-29 09:50:32.599956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:09.943 [2024-11-29 09:50:32.600997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:2198 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.943 [2024-11-29 09:50:32.601039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:09.943 [2024-11-29 09:50:32.612458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:09.943 [2024-11-29 09:50:32.613542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:10932 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.943 [2024-11-29 09:50:32.613574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:09.943 [2024-11-29 09:50:32.624851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:09.943 [2024-11-29 09:50:32.625932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:20008 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.943 [2024-11-29 09:50:32.625964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:09.943 [2024-11-29 09:50:32.637479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:09.943 [2024-11-29 09:50:32.638545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:9128 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.943 [2024-11-29 09:50:32.638574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:09.943 [2024-11-29 09:50:32.649876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:09.943 [2024-11-29 09:50:32.651046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:2751 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.943 [2024-11-29 09:50:32.651078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:09.943 [2024-11-29 09:50:32.662350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:09.943 [2024-11-29 09:50:32.663453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:6362 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.943 [2024-11-29 09:50:32.663483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:09.943 [2024-11-29 09:50:32.674750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:09.943 [2024-11-29 09:50:32.675962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:9139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.943 [2024-11-29 09:50:32.675995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:09.943 [2024-11-29 09:50:32.687209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:09.943 [2024-11-29 09:50:32.688303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:248 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.943 [2024-11-29 09:50:32.688336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:09.943 [2024-11-29 09:50:32.699665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:09.943 [2024-11-29 09:50:32.700809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:16398 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.943 [2024-11-29 09:50:32.700841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:09.943 [2024-11-29 09:50:32.712128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:09.943 [2024-11-29 09:50:32.713278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:3543 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.943 [2024-11-29 09:50:32.713310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:09.943 [2024-11-29 09:50:32.724612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e5a90 00:27:09.943 [2024-11-29 09:50:32.725796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:2373 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.943 [2024-11-29 09:50:32.725829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:09.943 [2024-11-29 09:50:32.736451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e3d08 00:27:09.943 [2024-11-29 09:50:32.736708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:22195 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.943 [2024-11-29 09:50:32.736735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0039 p:0 m:0 dnr:0 00:27:09.943 [2024-11-29 09:50:32.749029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190e6738 00:27:09.943 [2024-11-29 09:50:32.749972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:18144 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.943 [2024-11-29 09:50:32.750005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:09.943 [2024-11-29 09:50:32.761264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5faad0) with pdu=0x2000190f6cc8 00:27:09.943 [2024-11-29 09:50:32.761659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:5460 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.943 [2024-11-29 09:50:32.761706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:09.943 00:27:09.943 Latency(us) 00:27:09.943 [2024-11-29T08:50:32.786Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:09.943 [2024-11-29T08:50:32.786Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:09.943 nvme0n1 : 2.00 20756.76 81.08 0.00 0.00 6158.95 3046.21 14854.83 00:27:09.943 [2024-11-29T08:50:32.786Z] =================================================================================================================== 00:27:09.943 [2024-11-29T08:50:32.786Z] Total : 20756.76 81.08 0.00 0.00 6158.95 3046.21 14854.83 00:27:09.943 0 00:27:09.943 09:50:32 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:09.943 09:50:32 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:09.943 09:50:32 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:09.943 | .driver_specific 00:27:09.943 | .nvme_error 00:27:09.943 | .status_code 00:27:09.943 | .command_transient_transport_error' 00:27:09.943 09:50:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:10.513 09:50:33 -- host/digest.sh@71 -- # (( 163 > 0 )) 00:27:10.513 09:50:33 -- host/digest.sh@73 -- # killprocess 141193 00:27:10.513 09:50:33 -- common/autotest_common.sh@936 -- # '[' -z 141193 ']' 00:27:10.513 09:50:33 -- common/autotest_common.sh@940 -- # kill -0 141193 00:27:10.513 09:50:33 -- common/autotest_common.sh@941 -- # uname 00:27:10.513 09:50:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:10.513 09:50:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 141193 00:27:10.513 09:50:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:10.513 09:50:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:10.513 09:50:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 141193' 00:27:10.513 killing process with pid 141193 00:27:10.513 09:50:33 -- common/autotest_common.sh@955 -- # kill 141193 00:27:10.513 Received shutdown signal, test time was about 2.000000 seconds 00:27:10.513 00:27:10.513 Latency(us) 00:27:10.513 [2024-11-29T08:50:33.356Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:10.513 [2024-11-29T08:50:33.356Z] =================================================================================================================== 00:27:10.513 [2024-11-29T08:50:33.356Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:10.513 09:50:33 -- common/autotest_common.sh@960 -- # wait 141193 00:27:10.773 09:50:33 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:10.773 09:50:33 -- host/digest.sh@54 -- # local rw bs qd 00:27:10.773 09:50:33 -- host/digest.sh@56 -- # rw=randwrite 00:27:10.773 09:50:33 -- host/digest.sh@56 -- # bs=131072 00:27:10.773 09:50:33 -- host/digest.sh@56 -- # qd=16 00:27:10.773 09:50:33 -- host/digest.sh@58 -- # bperfpid=141744 00:27:10.773 09:50:33 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:10.773 09:50:33 -- host/digest.sh@60 -- # waitforlisten 141744 /var/tmp/bperf.sock 00:27:10.773 09:50:33 -- common/autotest_common.sh@829 -- # '[' -z 141744 ']' 00:27:10.773 09:50:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:10.773 09:50:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:10.773 09:50:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:10.773 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:10.773 09:50:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:10.773 09:50:33 -- common/autotest_common.sh@10 -- # set +x 00:27:10.773 [2024-11-29 09:50:33.407558] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:10.773 [2024-11-29 09:50:33.407636] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid141744 ] 00:27:10.773 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:10.773 Zero copy mechanism will not be used. 00:27:10.773 EAL: No free 2048 kB hugepages reported on node 1 00:27:10.773 [2024-11-29 09:50:33.468740] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:10.773 [2024-11-29 09:50:33.579885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:11.708 09:50:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:11.708 09:50:34 -- common/autotest_common.sh@862 -- # return 0 00:27:11.708 09:50:34 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:11.708 09:50:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:11.966 09:50:34 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:11.966 09:50:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:11.966 09:50:34 -- common/autotest_common.sh@10 -- # set +x 00:27:11.966 09:50:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:11.966 09:50:34 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:11.966 09:50:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:12.225 nvme0n1 00:27:12.225 09:50:34 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:12.225 09:50:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:12.225 09:50:34 -- common/autotest_common.sh@10 -- # set +x 00:27:12.225 09:50:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:12.225 09:50:34 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:12.225 09:50:34 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:12.486 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:12.486 Zero copy mechanism will not be used. 00:27:12.486 Running I/O for 2 seconds... 00:27:12.486 [2024-11-29 09:50:35.101484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.101809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.101850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.106455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.106610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.106642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.111007] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.111155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.111201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.115608] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.115729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.115759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.120300] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.120412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.120440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.125618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.125719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.125749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.130068] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.130227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.130258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.134632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.134859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.134888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.139050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.139285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.139321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.143554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.143696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.143724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.147965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.148099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.148129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.152276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.152426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.152455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.156656] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.156773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.156801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.161021] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.161180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.161209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.165478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.165612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.165641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.169996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.170244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.170274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.174381] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.174643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.174673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.178838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.179006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.179035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.183231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.183375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.183413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.187585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.187685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.187714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.191900] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.192037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.192066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.196334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.196500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.196529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.200759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.200913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.200942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.205285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.205545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.205575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.209678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.209931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.209961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.214056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.214223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.214252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.487 [2024-11-29 09:50:35.218498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.487 [2024-11-29 09:50:35.218622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.487 [2024-11-29 09:50:35.218651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.222901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.223025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.223055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.227288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.227443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.227472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.231654] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.231790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.231819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.236005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.236162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.236192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.240514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.240740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.240769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.244858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.245107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.245136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.249277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.249465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.249495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.253732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.253876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.253910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.258115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.258250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.258279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.262495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.262592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.262620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.266911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.267095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.267124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.271315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.271505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.271534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.275888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.276112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.276141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.280265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.280522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.280552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.284623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.284782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.284811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.289031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.289183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.289212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.293386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.293537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.293566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.297773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.297903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.297932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.302186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.302372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.302411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.306547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.306683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.306711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.311028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.311275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.311304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.315307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.315557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.315587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.319737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.319924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.319954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.488 [2024-11-29 09:50:35.324150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.488 [2024-11-29 09:50:35.324305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.488 [2024-11-29 09:50:35.324334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.747 [2024-11-29 09:50:35.328522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.328641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.328670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.332856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.332979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.333009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.337266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.337462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.337492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.341618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.341752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.341781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.346138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.346383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.346420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.350470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.350668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.350698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.354848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.355030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.355058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.359098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.359208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.359237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.363345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.363490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.363520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.367673] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.367773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.367806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.371788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.371972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.372002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.376007] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.376182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.376211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.380384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.380517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.380547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.384863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.385068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.385098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.389179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.389360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.389390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.393551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.393673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.393703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.397828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.397966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.397995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.402168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.402300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.402328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.406527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.406691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.406721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.410835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.410968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.410997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.415351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.415605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.415635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.419676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.419915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.419944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.424017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.424183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.424211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.428373] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.428548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.428577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.432769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.432915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.432944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.437092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.437218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.437246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.748 [2024-11-29 09:50:35.441518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.748 [2024-11-29 09:50:35.441682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.748 [2024-11-29 09:50:35.441711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.445832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.446003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.446031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.450279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.450533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.450562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.454610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.454833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.454862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.459035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.459215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.459244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.463403] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.463533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.463562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.467786] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.467908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.467938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.472082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.472216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.472245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.476503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.476644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.476673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.480886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.481062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.481096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.485341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.485592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.485623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.489748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.489977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.490007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.494159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.494331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.494379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.498629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.498733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.498763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.502979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.503103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.503132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.507313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.507449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.507482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.511728] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.511914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.511944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.516110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.516273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.516302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.520570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.520794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.520823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.524871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.525079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.525108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.529316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.529497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.529526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.533722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.533853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.533882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.538084] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.538219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.538247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.542415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.542539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.542568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.546781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.546965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.546994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.551128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.551271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.551300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.555598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.555843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.749 [2024-11-29 09:50:35.555878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.749 [2024-11-29 09:50:35.559959] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.749 [2024-11-29 09:50:35.560204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.750 [2024-11-29 09:50:35.560233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.750 [2024-11-29 09:50:35.564305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.750 [2024-11-29 09:50:35.564516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.750 [2024-11-29 09:50:35.564546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.750 [2024-11-29 09:50:35.568591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.750 [2024-11-29 09:50:35.568697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.750 [2024-11-29 09:50:35.568725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.750 [2024-11-29 09:50:35.572918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.750 [2024-11-29 09:50:35.573050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.750 [2024-11-29 09:50:35.573078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.750 [2024-11-29 09:50:35.577206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.750 [2024-11-29 09:50:35.577346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.750 [2024-11-29 09:50:35.577374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.750 [2024-11-29 09:50:35.581610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.750 [2024-11-29 09:50:35.581770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.750 [2024-11-29 09:50:35.581798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.750 [2024-11-29 09:50:35.585946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:12.750 [2024-11-29 09:50:35.586100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.750 [2024-11-29 09:50:35.586128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.590493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.590719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.590747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.594747] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.594940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.594969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.599086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.599255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.599287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.603534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.603646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.603675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.607879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.607998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.608028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.612059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.612146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.612173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.616477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.616618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.616646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.620812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.620963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.620994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.625334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.625588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.625617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.629717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.629976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.630007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.634168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.634385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.634447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.638535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.638656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.638685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.642913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.643026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.643057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.647222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.647350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.647382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.651670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.651863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.651894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.656036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.656190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.656222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.660564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.660816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.660847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.664958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.665165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.665197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.669347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.669525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.669560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.673728] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.673881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.673913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.678065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.678178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.678209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.682442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.682549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.682578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.686835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.687015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.687047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.691264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.691371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.691414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.695762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.696018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.696050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.009 [2024-11-29 09:50:35.700191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.009 [2024-11-29 09:50:35.700389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.009 [2024-11-29 09:50:35.700448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.704587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.704750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.704782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.708994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.709120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.709152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.713486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.713590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.713618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.717819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.717938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.717971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.722269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.722477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.722507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.726917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.727109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.727142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.732754] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.733062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.733095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.738084] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.738264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.738296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.744588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.744821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.744853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.751230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.751501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.751530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.757562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.757730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.757762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.763283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.763437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.763466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.769069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.769316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.769344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.774613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.774783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.774812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.780656] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.780924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.780952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.786623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.786882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.786910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.792592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.792802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.792831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.798361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.798607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.798637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.804171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.804304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.804338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.810286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.810446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.810476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.816452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.816719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.816747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.822362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.822608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.822637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.828162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.828430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.828459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.833267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.833520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.833550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.838592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.838794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.838823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.010 [2024-11-29 09:50:35.844590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.010 [2024-11-29 09:50:35.844697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.010 [2024-11-29 09:50:35.844725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.269 [2024-11-29 09:50:35.850102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.850248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.850276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.855601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.855688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.855719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.861361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.861581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.861610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.866586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.866714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.866753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.872042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.872263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.872291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.877756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.877979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.878007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.883348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.883554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.883584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.888865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.888996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.889025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.894505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.894583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.894611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.900034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.900135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.900161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.905543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.905731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.905761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.910944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.911072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.911102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.916415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.916643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.916671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.921802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.922042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.922072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.927518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.927683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.927711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.932906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.933045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.933073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.938512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.938592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.938621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.944241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.944341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.944368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.949729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.949907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.949941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.955153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.955282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.955311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.960757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.960986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.961015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.966244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.966478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.966507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.971572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.971730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.971758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.976975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.977122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.977150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.982333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.982435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.982461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.987690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.987793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.270 [2024-11-29 09:50:35.987819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.270 [2024-11-29 09:50:35.992984] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.270 [2024-11-29 09:50:35.993175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:35.993204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:35.998369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:35.998508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:35.998537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.003971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.004199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.004228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.009460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.009688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.009717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.014938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.015103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.015132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.020317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.020464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.020493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.025813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.025936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.025964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.031412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.031563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.031592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.036890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.037063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.037092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.042331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.042467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.042496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.047862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.048088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.048117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.053317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.053553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.053582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.058677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.058855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.058883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.063911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.064041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.064070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.069291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.069401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.069429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.074672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.074782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.074809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.080137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.080298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.080327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.085465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.085597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.085626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.090894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.091025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.091058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.096417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.096636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.096666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.101880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.102080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.102107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.271 [2024-11-29 09:50:36.107281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.271 [2024-11-29 09:50:36.107425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.271 [2024-11-29 09:50:36.107454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.531 [2024-11-29 09:50:36.112755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.531 [2024-11-29 09:50:36.112857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.531 [2024-11-29 09:50:36.112895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.531 [2024-11-29 09:50:36.118014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.531 [2024-11-29 09:50:36.118095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.531 [2024-11-29 09:50:36.118121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.531 [2024-11-29 09:50:36.123471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.531 [2024-11-29 09:50:36.123613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.531 [2024-11-29 09:50:36.123642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.531 [2024-11-29 09:50:36.128782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.531 [2024-11-29 09:50:36.128919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.531 [2024-11-29 09:50:36.128948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.531 [2024-11-29 09:50:36.134482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.531 [2024-11-29 09:50:36.134684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.531 [2024-11-29 09:50:36.134712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.531 [2024-11-29 09:50:36.140076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.531 [2024-11-29 09:50:36.140291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.531 [2024-11-29 09:50:36.140320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.531 [2024-11-29 09:50:36.145620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.531 [2024-11-29 09:50:36.145783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.531 [2024-11-29 09:50:36.145811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.531 [2024-11-29 09:50:36.150978] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.531 [2024-11-29 09:50:36.151116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.531 [2024-11-29 09:50:36.151145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.531 [2024-11-29 09:50:36.156539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.531 [2024-11-29 09:50:36.156661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.156690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.161998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.162083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.162125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.167619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.167763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.167791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.172913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.173014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.173040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.178600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.178803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.178832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.184118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.184293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.184321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.189383] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.189551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.189579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.194739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.194868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.194896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.200229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.200347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.200373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.205589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.205665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.205693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.211252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.211427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.211456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.216708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.216864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.216893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.222033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.222257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.222285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.227382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.227564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.227594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.232740] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.232951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.232985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.238099] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.238247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.238277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.243612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.243720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.243748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.248973] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.249098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.249126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.255039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.255247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.255279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.260511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.260590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.260618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.265964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.266188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.266218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.271423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.271625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.271654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.276968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.277147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.277175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.282277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.282418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.282447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.287867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.287972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.287999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.293476] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.293556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.293584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.298895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.299075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.532 [2024-11-29 09:50:36.299103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.532 [2024-11-29 09:50:36.304152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.532 [2024-11-29 09:50:36.304290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.533 [2024-11-29 09:50:36.304319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.533 [2024-11-29 09:50:36.309686] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.533 [2024-11-29 09:50:36.309926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.533 [2024-11-29 09:50:36.309955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.533 [2024-11-29 09:50:36.315154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.533 [2024-11-29 09:50:36.315367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.533 [2024-11-29 09:50:36.315407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.533 [2024-11-29 09:50:36.320816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.533 [2024-11-29 09:50:36.320983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.533 [2024-11-29 09:50:36.321012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.533 [2024-11-29 09:50:36.326147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.533 [2024-11-29 09:50:36.326242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.533 [2024-11-29 09:50:36.326272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.533 [2024-11-29 09:50:36.331843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.533 [2024-11-29 09:50:36.331947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.533 [2024-11-29 09:50:36.331974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.533 [2024-11-29 09:50:36.337743] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.533 [2024-11-29 09:50:36.337852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.533 [2024-11-29 09:50:36.337880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.533 [2024-11-29 09:50:36.343373] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.533 [2024-11-29 09:50:36.343558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.533 [2024-11-29 09:50:36.343586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.533 [2024-11-29 09:50:36.348846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.533 [2024-11-29 09:50:36.348944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.533 [2024-11-29 09:50:36.348971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.533 [2024-11-29 09:50:36.354519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.533 [2024-11-29 09:50:36.354721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.533 [2024-11-29 09:50:36.354750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.533 [2024-11-29 09:50:36.360191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.533 [2024-11-29 09:50:36.360447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.533 [2024-11-29 09:50:36.360476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.533 [2024-11-29 09:50:36.366047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.533 [2024-11-29 09:50:36.366240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.533 [2024-11-29 09:50:36.366270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.533 [2024-11-29 09:50:36.371121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.533 [2024-11-29 09:50:36.371203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.533 [2024-11-29 09:50:36.371231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.376363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.376488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.376520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.381806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.381906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.381933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.387328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.387538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.387567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.392825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.392926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.392953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.398299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.398536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.398566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.403610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.403798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.403826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.409118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.409309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.409338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.414437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.414562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.414590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.419848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.419954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.419981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.425321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.425469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.425504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.430862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.431027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.431055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.436260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.436423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.436452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.441904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.442154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.442183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.447242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.447455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.447484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.452770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.452935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.452963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.458091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.458212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.826 [2024-11-29 09:50:36.458242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.826 [2024-11-29 09:50:36.463616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.826 [2024-11-29 09:50:36.463745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.463773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.468812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.468896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.468939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.474115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.474325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.474356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.479551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.479660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.479690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.484856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.485083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.485112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.490309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.490518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.490547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.495695] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.495909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.495937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.501158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.501286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.501315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.506569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.506672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.506701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.512108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.512233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.512261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.517537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.517682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.517711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.522960] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.523088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.523118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.528375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.528484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.528511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.533953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.534178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.534207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.539358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.539561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.539591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.544676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.544859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.544888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.550182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.550295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.550321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.555534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.555611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.555640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.560948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.561151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.561180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.566309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.566464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.566499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.571837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.572064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.572093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.577327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.577537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.577566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.582837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.583006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.583034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.588259] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.588442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.588471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.593497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.593576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.593603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.598833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.598943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.598970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.604556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.604700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.827 [2024-11-29 09:50:36.604728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.827 [2024-11-29 09:50:36.609945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.827 [2024-11-29 09:50:36.610073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.828 [2024-11-29 09:50:36.610101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.828 [2024-11-29 09:50:36.615597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.828 [2024-11-29 09:50:36.615806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.828 [2024-11-29 09:50:36.615834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.828 [2024-11-29 09:50:36.620859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.828 [2024-11-29 09:50:36.621093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.828 [2024-11-29 09:50:36.621122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.828 [2024-11-29 09:50:36.626046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.828 [2024-11-29 09:50:36.626218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.828 [2024-11-29 09:50:36.626247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.828 [2024-11-29 09:50:36.631275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.828 [2024-11-29 09:50:36.631436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.828 [2024-11-29 09:50:36.631464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.828 [2024-11-29 09:50:36.636500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.828 [2024-11-29 09:50:36.636626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.828 [2024-11-29 09:50:36.636654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.828 [2024-11-29 09:50:36.641951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.828 [2024-11-29 09:50:36.642050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.828 [2024-11-29 09:50:36.642077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.828 [2024-11-29 09:50:36.647422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.828 [2024-11-29 09:50:36.647605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.828 [2024-11-29 09:50:36.647633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.828 [2024-11-29 09:50:36.652668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.828 [2024-11-29 09:50:36.652804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.828 [2024-11-29 09:50:36.652833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.828 [2024-11-29 09:50:36.658319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.828 [2024-11-29 09:50:36.658550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.828 [2024-11-29 09:50:36.658579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.828 [2024-11-29 09:50:36.663670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:13.828 [2024-11-29 09:50:36.663891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.828 [2024-11-29 09:50:36.663920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.669140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.669331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.669359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.674465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.674604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.674633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.680131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.680249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.680276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.685703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.685810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.685837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.691258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.691439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.691468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.696519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.696628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.696655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.702189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.702423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.702452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.707645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.707816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.707854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.713212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.713401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.713430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.718557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.718661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.718690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.723947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.724050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.724076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.729121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.729225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.729251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.734597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.734741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.734769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.739935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.740061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.740090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.745262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.745515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.745544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.750862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.751018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.751047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.756281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.756486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.756514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.761581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.761719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.090 [2024-11-29 09:50:36.761747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.090 [2024-11-29 09:50:36.767114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.090 [2024-11-29 09:50:36.767212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.767238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.772531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.772621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.772649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.778075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.778238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.778267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.783382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.783528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.783556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.788890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.789114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.789142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.794452] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.794616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.794644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.799625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.799807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.799836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.805079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.805207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.805235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.810435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.810549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.810576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.815989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.816091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.816118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.821877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.822065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.822094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.827419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.827541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.827570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.833121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.833342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.833370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.838653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.838832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.838862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.844004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.844194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.844222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.849262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.849414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.849448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.854734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.854832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.854859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.860317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.860426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.860453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.865783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.865961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.865989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.871208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.871333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.871360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.876739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.876940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.876969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.882185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.882379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.882421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.887255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.887405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.887433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.892341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.892489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.892518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.897952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.898079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.898107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.903333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.903452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.903479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.909115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.909279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.091 [2024-11-29 09:50:36.909326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.091 [2024-11-29 09:50:36.914732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.091 [2024-11-29 09:50:36.914865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.092 [2024-11-29 09:50:36.914893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.092 [2024-11-29 09:50:36.920303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.092 [2024-11-29 09:50:36.920535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.092 [2024-11-29 09:50:36.920564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.092 [2024-11-29 09:50:36.925616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.092 [2024-11-29 09:50:36.925727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.092 [2024-11-29 09:50:36.925755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:36.931004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:36.931170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:36.931198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:36.936540] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:36.936639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:36.936668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:36.941827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:36.941936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:36.941963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:36.947124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:36.947227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:36.947255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:36.952956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:36.953160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:36.953189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:36.958617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:36.958754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:36.958783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:36.964288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:36.964517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:36.964546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:36.969731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:36.969946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:36.969974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:36.975109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:36.975275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:36.975304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:36.980613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:36.980698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:36.980727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:36.985988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:36.986092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:36.986119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:36.991513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:36.991591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:36.991625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:36.996968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:36.997173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:36.997201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:37.002273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:37.002446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:37.002474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:37.007845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:37.008071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:37.008100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:37.013222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:37.013427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:37.013456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:37.018812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:37.019013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.351 [2024-11-29 09:50:37.019042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.351 [2024-11-29 09:50:37.024441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.351 [2024-11-29 09:50:37.024596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.352 [2024-11-29 09:50:37.024624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.352 [2024-11-29 09:50:37.029878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.352 [2024-11-29 09:50:37.029980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.352 [2024-11-29 09:50:37.030007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.352 [2024-11-29 09:50:37.035369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.352 [2024-11-29 09:50:37.035502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.352 [2024-11-29 09:50:37.035531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.352 [2024-11-29 09:50:37.040940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.352 [2024-11-29 09:50:37.041150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.352 [2024-11-29 09:50:37.041179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.352 [2024-11-29 09:50:37.046422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.352 [2024-11-29 09:50:37.046592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.352 [2024-11-29 09:50:37.046621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.352 [2024-11-29 09:50:37.052003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.352 [2024-11-29 09:50:37.052234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.352 [2024-11-29 09:50:37.052264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.352 [2024-11-29 09:50:37.057828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.352 [2024-11-29 09:50:37.058048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.352 [2024-11-29 09:50:37.058076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.352 [2024-11-29 09:50:37.063031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.352 [2024-11-29 09:50:37.063170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.352 [2024-11-29 09:50:37.063199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.352 [2024-11-29 09:50:37.068500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.352 [2024-11-29 09:50:37.068593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.352 [2024-11-29 09:50:37.068621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.352 [2024-11-29 09:50:37.073713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.352 [2024-11-29 09:50:37.073856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.352 [2024-11-29 09:50:37.073885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.352 [2024-11-29 09:50:37.079219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.352 [2024-11-29 09:50:37.079321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.352 [2024-11-29 09:50:37.079348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.352 [2024-11-29 09:50:37.084572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.352 [2024-11-29 09:50:37.084726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.352 [2024-11-29 09:50:37.084754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.352 [2024-11-29 09:50:37.090134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.352 [2024-11-29 09:50:37.090281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.352 [2024-11-29 09:50:37.090310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.352 [2024-11-29 09:50:37.095705] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5fafb0) with pdu=0x2000190fef90 00:27:14.352 [2024-11-29 09:50:37.095958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.352 [2024-11-29 09:50:37.095987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.352 00:27:14.352 Latency(us) 00:27:14.352 [2024-11-29T08:50:37.195Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:14.352 [2024-11-29T08:50:37.195Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:14.352 nvme0n1 : 2.00 6078.19 759.77 0.00 0.00 2624.93 1832.58 7621.59 00:27:14.352 [2024-11-29T08:50:37.195Z] =================================================================================================================== 00:27:14.352 [2024-11-29T08:50:37.195Z] Total : 6078.19 759.77 0.00 0.00 2624.93 1832.58 7621.59 00:27:14.352 0 00:27:14.352 09:50:37 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:14.352 09:50:37 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:14.352 09:50:37 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:14.352 | .driver_specific 00:27:14.352 | .nvme_error 00:27:14.352 | .status_code 00:27:14.352 | .command_transient_transport_error' 00:27:14.352 09:50:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:14.609 09:50:37 -- host/digest.sh@71 -- # (( 392 > 0 )) 00:27:14.609 09:50:37 -- host/digest.sh@73 -- # killprocess 141744 00:27:14.609 09:50:37 -- common/autotest_common.sh@936 -- # '[' -z 141744 ']' 00:27:14.609 09:50:37 -- common/autotest_common.sh@940 -- # kill -0 141744 00:27:14.609 09:50:37 -- common/autotest_common.sh@941 -- # uname 00:27:14.609 09:50:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:14.609 09:50:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 141744 00:27:14.609 09:50:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:14.609 09:50:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:14.609 09:50:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 141744' 00:27:14.609 killing process with pid 141744 00:27:14.609 09:50:37 -- common/autotest_common.sh@955 -- # kill 141744 00:27:14.609 Received shutdown signal, test time was about 2.000000 seconds 00:27:14.609 00:27:14.609 Latency(us) 00:27:14.609 [2024-11-29T08:50:37.452Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:14.609 [2024-11-29T08:50:37.452Z] =================================================================================================================== 00:27:14.609 [2024-11-29T08:50:37.452Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:14.609 09:50:37 -- common/autotest_common.sh@960 -- # wait 141744 00:27:14.866 09:50:37 -- host/digest.sh@115 -- # killprocess 140064 00:27:14.866 09:50:37 -- common/autotest_common.sh@936 -- # '[' -z 140064 ']' 00:27:14.866 09:50:37 -- common/autotest_common.sh@940 -- # kill -0 140064 00:27:14.866 09:50:37 -- common/autotest_common.sh@941 -- # uname 00:27:14.866 09:50:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:14.866 09:50:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 140064 00:27:15.124 09:50:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:15.124 09:50:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:15.124 09:50:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 140064' 00:27:15.124 killing process with pid 140064 00:27:15.124 09:50:37 -- common/autotest_common.sh@955 -- # kill 140064 00:27:15.124 09:50:37 -- common/autotest_common.sh@960 -- # wait 140064 00:27:15.383 00:27:15.383 real 0m18.310s 00:27:15.383 user 0m37.236s 00:27:15.383 sys 0m4.437s 00:27:15.383 09:50:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:15.383 09:50:37 -- common/autotest_common.sh@10 -- # set +x 00:27:15.383 ************************************ 00:27:15.383 END TEST nvmf_digest_error 00:27:15.383 ************************************ 00:27:15.383 09:50:38 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:15.383 09:50:38 -- host/digest.sh@139 -- # nvmftestfini 00:27:15.383 09:50:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:15.383 09:50:38 -- nvmf/common.sh@116 -- # sync 00:27:15.383 09:50:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:15.383 09:50:38 -- nvmf/common.sh@119 -- # set +e 00:27:15.383 09:50:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:15.383 09:50:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:15.383 rmmod nvme_tcp 00:27:15.383 rmmod nvme_fabrics 00:27:15.383 rmmod nvme_keyring 00:27:15.383 09:50:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:15.383 09:50:38 -- nvmf/common.sh@123 -- # set -e 00:27:15.383 09:50:38 -- nvmf/common.sh@124 -- # return 0 00:27:15.383 09:50:38 -- nvmf/common.sh@477 -- # '[' -n 140064 ']' 00:27:15.383 09:50:38 -- nvmf/common.sh@478 -- # killprocess 140064 00:27:15.383 09:50:38 -- common/autotest_common.sh@936 -- # '[' -z 140064 ']' 00:27:15.383 09:50:38 -- common/autotest_common.sh@940 -- # kill -0 140064 00:27:15.383 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (140064) - No such process 00:27:15.383 09:50:38 -- common/autotest_common.sh@963 -- # echo 'Process with pid 140064 is not found' 00:27:15.383 Process with pid 140064 is not found 00:27:15.383 09:50:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:15.383 09:50:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:15.383 09:50:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:15.383 09:50:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:15.383 09:50:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:15.383 09:50:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:15.383 09:50:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:15.383 09:50:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:17.293 09:50:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:17.293 00:27:17.293 real 0m38.608s 00:27:17.293 user 1m9.560s 00:27:17.293 sys 0m10.300s 00:27:17.293 09:50:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:17.293 09:50:40 -- common/autotest_common.sh@10 -- # set +x 00:27:17.293 ************************************ 00:27:17.293 END TEST nvmf_digest 00:27:17.293 ************************************ 00:27:17.553 09:50:40 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:17.553 09:50:40 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:17.553 09:50:40 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:17.553 09:50:40 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:17.553 09:50:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:17.553 09:50:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:17.553 09:50:40 -- common/autotest_common.sh@10 -- # set +x 00:27:17.553 ************************************ 00:27:17.553 START TEST nvmf_bdevperf 00:27:17.553 ************************************ 00:27:17.553 09:50:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:17.553 * Looking for test storage... 00:27:17.553 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:17.553 09:50:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:17.553 09:50:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:17.553 09:50:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:17.553 09:50:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:17.553 09:50:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:17.553 09:50:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:17.553 09:50:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:17.553 09:50:40 -- scripts/common.sh@335 -- # IFS=.-: 00:27:17.553 09:50:40 -- scripts/common.sh@335 -- # read -ra ver1 00:27:17.553 09:50:40 -- scripts/common.sh@336 -- # IFS=.-: 00:27:17.553 09:50:40 -- scripts/common.sh@336 -- # read -ra ver2 00:27:17.553 09:50:40 -- scripts/common.sh@337 -- # local 'op=<' 00:27:17.553 09:50:40 -- scripts/common.sh@339 -- # ver1_l=2 00:27:17.553 09:50:40 -- scripts/common.sh@340 -- # ver2_l=1 00:27:17.553 09:50:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:17.553 09:50:40 -- scripts/common.sh@343 -- # case "$op" in 00:27:17.553 09:50:40 -- scripts/common.sh@344 -- # : 1 00:27:17.553 09:50:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:17.553 09:50:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:17.553 09:50:40 -- scripts/common.sh@364 -- # decimal 1 00:27:17.553 09:50:40 -- scripts/common.sh@352 -- # local d=1 00:27:17.553 09:50:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:17.553 09:50:40 -- scripts/common.sh@354 -- # echo 1 00:27:17.553 09:50:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:17.553 09:50:40 -- scripts/common.sh@365 -- # decimal 2 00:27:17.553 09:50:40 -- scripts/common.sh@352 -- # local d=2 00:27:17.553 09:50:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:17.553 09:50:40 -- scripts/common.sh@354 -- # echo 2 00:27:17.553 09:50:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:17.553 09:50:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:17.553 09:50:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:17.553 09:50:40 -- scripts/common.sh@367 -- # return 0 00:27:17.553 09:50:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:17.553 09:50:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:17.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:17.553 --rc genhtml_branch_coverage=1 00:27:17.553 --rc genhtml_function_coverage=1 00:27:17.553 --rc genhtml_legend=1 00:27:17.553 --rc geninfo_all_blocks=1 00:27:17.553 --rc geninfo_unexecuted_blocks=1 00:27:17.553 00:27:17.553 ' 00:27:17.553 09:50:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:17.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:17.553 --rc genhtml_branch_coverage=1 00:27:17.553 --rc genhtml_function_coverage=1 00:27:17.553 --rc genhtml_legend=1 00:27:17.553 --rc geninfo_all_blocks=1 00:27:17.553 --rc geninfo_unexecuted_blocks=1 00:27:17.553 00:27:17.553 ' 00:27:17.553 09:50:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:17.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:17.553 --rc genhtml_branch_coverage=1 00:27:17.553 --rc genhtml_function_coverage=1 00:27:17.553 --rc genhtml_legend=1 00:27:17.553 --rc geninfo_all_blocks=1 00:27:17.553 --rc geninfo_unexecuted_blocks=1 00:27:17.553 00:27:17.553 ' 00:27:17.553 09:50:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:17.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:17.553 --rc genhtml_branch_coverage=1 00:27:17.553 --rc genhtml_function_coverage=1 00:27:17.553 --rc genhtml_legend=1 00:27:17.553 --rc geninfo_all_blocks=1 00:27:17.553 --rc geninfo_unexecuted_blocks=1 00:27:17.553 00:27:17.553 ' 00:27:17.553 09:50:40 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:17.553 09:50:40 -- nvmf/common.sh@7 -- # uname -s 00:27:17.553 09:50:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:17.553 09:50:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:17.553 09:50:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:17.553 09:50:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:17.553 09:50:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:17.553 09:50:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:17.553 09:50:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:17.553 09:50:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:17.553 09:50:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:17.553 09:50:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:17.553 09:50:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:17.553 09:50:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:17.553 09:50:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:17.553 09:50:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:17.553 09:50:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:17.553 09:50:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:17.553 09:50:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:17.553 09:50:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:17.554 09:50:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:17.554 09:50:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:17.554 09:50:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:17.554 09:50:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:17.554 09:50:40 -- paths/export.sh@5 -- # export PATH 00:27:17.554 09:50:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:17.554 09:50:40 -- nvmf/common.sh@46 -- # : 0 00:27:17.554 09:50:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:17.554 09:50:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:17.554 09:50:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:17.554 09:50:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:17.554 09:50:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:17.554 09:50:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:17.554 09:50:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:17.554 09:50:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:17.554 09:50:40 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:17.554 09:50:40 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:17.554 09:50:40 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:17.554 09:50:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:17.554 09:50:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:17.554 09:50:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:17.554 09:50:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:17.554 09:50:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:17.554 09:50:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:17.554 09:50:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:17.554 09:50:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:17.554 09:50:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:17.554 09:50:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:17.554 09:50:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:17.554 09:50:40 -- common/autotest_common.sh@10 -- # set +x 00:27:19.463 09:50:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:19.463 09:50:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:19.463 09:50:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:19.463 09:50:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:19.463 09:50:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:19.463 09:50:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:19.463 09:50:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:19.463 09:50:42 -- nvmf/common.sh@294 -- # net_devs=() 00:27:19.463 09:50:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:19.463 09:50:42 -- nvmf/common.sh@295 -- # e810=() 00:27:19.463 09:50:42 -- nvmf/common.sh@295 -- # local -ga e810 00:27:19.463 09:50:42 -- nvmf/common.sh@296 -- # x722=() 00:27:19.463 09:50:42 -- nvmf/common.sh@296 -- # local -ga x722 00:27:19.463 09:50:42 -- nvmf/common.sh@297 -- # mlx=() 00:27:19.463 09:50:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:19.463 09:50:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:19.463 09:50:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:19.463 09:50:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:19.463 09:50:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:19.464 09:50:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:19.464 09:50:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:19.464 09:50:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:19.464 09:50:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:19.464 09:50:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:19.464 09:50:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:19.464 09:50:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:19.464 09:50:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:19.464 09:50:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:19.464 09:50:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:19.464 09:50:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:19.464 09:50:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:19.464 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:19.464 09:50:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:19.464 09:50:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:19.464 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:19.464 09:50:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:19.464 09:50:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:19.464 09:50:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:19.464 09:50:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:19.464 09:50:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:19.464 09:50:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:19.464 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:19.464 09:50:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:19.464 09:50:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:19.464 09:50:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:19.464 09:50:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:19.464 09:50:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:19.464 09:50:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:19.464 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:19.464 09:50:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:19.464 09:50:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:19.464 09:50:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:19.464 09:50:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:19.464 09:50:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:19.464 09:50:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:19.464 09:50:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:19.464 09:50:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:19.464 09:50:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:19.464 09:50:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:19.464 09:50:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:19.464 09:50:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:19.464 09:50:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:19.464 09:50:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:19.464 09:50:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:19.464 09:50:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:19.464 09:50:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:19.464 09:50:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:19.464 09:50:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:19.464 09:50:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:19.464 09:50:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:19.464 09:50:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:19.726 09:50:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:19.726 09:50:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:19.726 09:50:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:19.726 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:19.726 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:27:19.726 00:27:19.726 --- 10.0.0.2 ping statistics --- 00:27:19.726 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:19.726 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:27:19.726 09:50:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:19.726 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:19.726 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:27:19.726 00:27:19.726 --- 10.0.0.1 ping statistics --- 00:27:19.726 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:19.726 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:27:19.726 09:50:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:19.726 09:50:42 -- nvmf/common.sh@410 -- # return 0 00:27:19.726 09:50:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:19.726 09:50:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:19.726 09:50:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:19.726 09:50:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:19.726 09:50:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:19.726 09:50:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:19.726 09:50:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:19.726 09:50:42 -- host/bdevperf.sh@25 -- # tgt_init 00:27:19.726 09:50:42 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:19.726 09:50:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:19.726 09:50:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:19.726 09:50:42 -- common/autotest_common.sh@10 -- # set +x 00:27:19.726 09:50:42 -- nvmf/common.sh@469 -- # nvmfpid=144260 00:27:19.726 09:50:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:19.726 09:50:42 -- nvmf/common.sh@470 -- # waitforlisten 144260 00:27:19.726 09:50:42 -- common/autotest_common.sh@829 -- # '[' -z 144260 ']' 00:27:19.726 09:50:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:19.726 09:50:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:19.726 09:50:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:19.726 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:19.726 09:50:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:19.726 09:50:42 -- common/autotest_common.sh@10 -- # set +x 00:27:19.726 [2024-11-29 09:50:42.429487] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:19.726 [2024-11-29 09:50:42.429587] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:19.726 EAL: No free 2048 kB hugepages reported on node 1 00:27:19.726 [2024-11-29 09:50:42.495347] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:19.989 [2024-11-29 09:50:42.605088] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:19.989 [2024-11-29 09:50:42.605257] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:19.989 [2024-11-29 09:50:42.605274] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:19.989 [2024-11-29 09:50:42.605291] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:19.989 [2024-11-29 09:50:42.605584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:19.989 [2024-11-29 09:50:42.605651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:19.989 [2024-11-29 09:50:42.605654] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:20.924 09:50:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:20.924 09:50:43 -- common/autotest_common.sh@862 -- # return 0 00:27:20.924 09:50:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:20.924 09:50:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:20.924 09:50:43 -- common/autotest_common.sh@10 -- # set +x 00:27:20.924 09:50:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:20.924 09:50:43 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:20.924 09:50:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.924 09:50:43 -- common/autotest_common.sh@10 -- # set +x 00:27:20.924 [2024-11-29 09:50:43.432621] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:20.924 09:50:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.924 09:50:43 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:20.924 09:50:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.924 09:50:43 -- common/autotest_common.sh@10 -- # set +x 00:27:20.924 Malloc0 00:27:20.924 09:50:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.924 09:50:43 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:20.924 09:50:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.924 09:50:43 -- common/autotest_common.sh@10 -- # set +x 00:27:20.924 09:50:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.924 09:50:43 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:20.924 09:50:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.924 09:50:43 -- common/autotest_common.sh@10 -- # set +x 00:27:20.924 09:50:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.924 09:50:43 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:20.924 09:50:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.924 09:50:43 -- common/autotest_common.sh@10 -- # set +x 00:27:20.924 [2024-11-29 09:50:43.493103] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:20.924 09:50:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.924 09:50:43 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:20.924 09:50:43 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:20.924 09:50:43 -- nvmf/common.sh@520 -- # config=() 00:27:20.924 09:50:43 -- nvmf/common.sh@520 -- # local subsystem config 00:27:20.925 09:50:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:20.925 09:50:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:20.925 { 00:27:20.925 "params": { 00:27:20.925 "name": "Nvme$subsystem", 00:27:20.925 "trtype": "$TEST_TRANSPORT", 00:27:20.925 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:20.925 "adrfam": "ipv4", 00:27:20.925 "trsvcid": "$NVMF_PORT", 00:27:20.925 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:20.925 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:20.925 "hdgst": ${hdgst:-false}, 00:27:20.925 "ddgst": ${ddgst:-false} 00:27:20.925 }, 00:27:20.925 "method": "bdev_nvme_attach_controller" 00:27:20.925 } 00:27:20.925 EOF 00:27:20.925 )") 00:27:20.925 09:50:43 -- nvmf/common.sh@542 -- # cat 00:27:20.925 09:50:43 -- nvmf/common.sh@544 -- # jq . 00:27:20.925 09:50:43 -- nvmf/common.sh@545 -- # IFS=, 00:27:20.925 09:50:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:20.925 "params": { 00:27:20.925 "name": "Nvme1", 00:27:20.925 "trtype": "tcp", 00:27:20.925 "traddr": "10.0.0.2", 00:27:20.925 "adrfam": "ipv4", 00:27:20.925 "trsvcid": "4420", 00:27:20.925 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:20.925 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:20.925 "hdgst": false, 00:27:20.925 "ddgst": false 00:27:20.925 }, 00:27:20.925 "method": "bdev_nvme_attach_controller" 00:27:20.925 }' 00:27:20.925 [2024-11-29 09:50:43.533922] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:20.925 [2024-11-29 09:50:43.533997] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid144418 ] 00:27:20.925 EAL: No free 2048 kB hugepages reported on node 1 00:27:20.925 [2024-11-29 09:50:43.593737] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:20.925 [2024-11-29 09:50:43.699948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:21.185 Running I/O for 1 seconds... 00:27:22.124 00:27:22.124 Latency(us) 00:27:22.124 [2024-11-29T08:50:44.967Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:22.124 [2024-11-29T08:50:44.967Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:22.124 Verification LBA range: start 0x0 length 0x4000 00:27:22.124 Nvme1n1 : 1.01 12787.67 49.95 0.00 0.00 9961.64 1377.47 16990.81 00:27:22.124 [2024-11-29T08:50:44.967Z] =================================================================================================================== 00:27:22.124 [2024-11-29T08:50:44.967Z] Total : 12787.67 49.95 0.00 0.00 9961.64 1377.47 16990.81 00:27:22.382 09:50:45 -- host/bdevperf.sh@30 -- # bdevperfpid=144572 00:27:22.382 09:50:45 -- host/bdevperf.sh@32 -- # sleep 3 00:27:22.382 09:50:45 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:22.382 09:50:45 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:22.382 09:50:45 -- nvmf/common.sh@520 -- # config=() 00:27:22.382 09:50:45 -- nvmf/common.sh@520 -- # local subsystem config 00:27:22.382 09:50:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:22.382 09:50:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:22.382 { 00:27:22.382 "params": { 00:27:22.382 "name": "Nvme$subsystem", 00:27:22.382 "trtype": "$TEST_TRANSPORT", 00:27:22.382 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:22.383 "adrfam": "ipv4", 00:27:22.383 "trsvcid": "$NVMF_PORT", 00:27:22.383 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:22.383 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:22.383 "hdgst": ${hdgst:-false}, 00:27:22.383 "ddgst": ${ddgst:-false} 00:27:22.383 }, 00:27:22.383 "method": "bdev_nvme_attach_controller" 00:27:22.383 } 00:27:22.383 EOF 00:27:22.383 )") 00:27:22.383 09:50:45 -- nvmf/common.sh@542 -- # cat 00:27:22.383 09:50:45 -- nvmf/common.sh@544 -- # jq . 00:27:22.383 09:50:45 -- nvmf/common.sh@545 -- # IFS=, 00:27:22.383 09:50:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:22.383 "params": { 00:27:22.383 "name": "Nvme1", 00:27:22.383 "trtype": "tcp", 00:27:22.383 "traddr": "10.0.0.2", 00:27:22.383 "adrfam": "ipv4", 00:27:22.383 "trsvcid": "4420", 00:27:22.383 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:22.383 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:22.383 "hdgst": false, 00:27:22.383 "ddgst": false 00:27:22.383 }, 00:27:22.383 "method": "bdev_nvme_attach_controller" 00:27:22.383 }' 00:27:22.383 [2024-11-29 09:50:45.213063] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:22.383 [2024-11-29 09:50:45.213141] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid144572 ] 00:27:22.641 EAL: No free 2048 kB hugepages reported on node 1 00:27:22.641 [2024-11-29 09:50:45.273486] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:22.641 [2024-11-29 09:50:45.377470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:22.918 Running I/O for 15 seconds... 00:27:25.493 09:50:48 -- host/bdevperf.sh@33 -- # kill -9 144260 00:27:25.493 09:50:48 -- host/bdevperf.sh@35 -- # sleep 3 00:27:25.493 [2024-11-29 09:50:48.190022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:125568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.493 [2024-11-29 09:50:48.190081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.493 [2024-11-29 09:50:48.190116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:125576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.493 [2024-11-29 09:50:48.190135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.493 [2024-11-29 09:50:48.190154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:125584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.493 [2024-11-29 09:50:48.190171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.493 [2024-11-29 09:50:48.190199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:125592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.493 [2024-11-29 09:50:48.190216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.493 [2024-11-29 09:50:48.190235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:125600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.493 [2024-11-29 09:50:48.190250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.493 [2024-11-29 09:50:48.190267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:125616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.493 [2024-11-29 09:50:48.190283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.493 [2024-11-29 09:50:48.190300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:125624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.493 [2024-11-29 09:50:48.190315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.493 [2024-11-29 09:50:48.190332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:125632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.493 [2024-11-29 09:50:48.190346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.493 [2024-11-29 09:50:48.190363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:125640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.493 [2024-11-29 09:50:48.190378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.493 [2024-11-29 09:50:48.190401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:125096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.493 [2024-11-29 09:50:48.190434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.493 [2024-11-29 09:50:48.190450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:125112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:125120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:125144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:125152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:125160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:125168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:125176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:125648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:125656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:125672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:125680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:125712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:125720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:125736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:125768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:125792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.494 [2024-11-29 09:50:48.190948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:125192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.190979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.190995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:125200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:125216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:125232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:125248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:125280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:125312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:125336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:125800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:125808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.494 [2024-11-29 09:50:48.191265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:125816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:125824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:125832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:125840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:125848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:125856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:125864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:125872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:125880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.494 [2024-11-29 09:50:48.191572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:125888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.494 [2024-11-29 09:50:48.191600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:125896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:125904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.494 [2024-11-29 09:50:48.191656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:125912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.494 [2024-11-29 09:50:48.191700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.494 [2024-11-29 09:50:48.191717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:125920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.191732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.191748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:125928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.191763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.191779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:125936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.191794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.191810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:125944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.191825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.191846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:125952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.191861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.191878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:125960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.191894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.191911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:125968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.191926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.191942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:125976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.191956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.191973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:125984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.191988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:125992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:126000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.192052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:126008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:126016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:126024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.192149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:126032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.192182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:126040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:125344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:125352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:125376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:125384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:125392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:125432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:125456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:125472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:126048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.192549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:126056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:126064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:126072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:126080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.192662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:126088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.192719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:126096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:126104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:126112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:126120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.192853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:126128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:126136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.192914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:126144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.192944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:126152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.192975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.192991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:126160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.495 [2024-11-29 09:50:48.193005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.193021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:126168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.495 [2024-11-29 09:50:48.193035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.495 [2024-11-29 09:50:48.193052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:126176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:126184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.496 [2024-11-29 09:50:48.193097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:126192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.496 [2024-11-29 09:50:48.193131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:125496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:125504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:125528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:125536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:125560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:125608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:125664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:125688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:126200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:126208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:126216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:126224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:126232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.496 [2024-11-29 09:50:48.193630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:126240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.496 [2024-11-29 09:50:48.193658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:126248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.496 [2024-11-29 09:50:48.193702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:126256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.496 [2024-11-29 09:50:48.193734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:126264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.496 [2024-11-29 09:50:48.193764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:126272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.496 [2024-11-29 09:50:48.193795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:126280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.496 [2024-11-29 09:50:48.193826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:126288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:126296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.496 [2024-11-29 09:50:48.193889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:126304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:126312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.496 [2024-11-29 09:50:48.193951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.193967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:126320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.193981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.194002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:126328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.496 [2024-11-29 09:50:48.194017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.194033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:126336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.194048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.194064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:126344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.194078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.194094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:126352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.194108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.194124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:125696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.194139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.194155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:125704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.194170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.194186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:125728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.194201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.194217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:125744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.194232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.194248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:125752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.194262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.194278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:125760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.194293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.194309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:125776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.496 [2024-11-29 09:50:48.194323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.496 [2024-11-29 09:50:48.194339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x748740 is same with the state(5) to be set 00:27:25.496 [2024-11-29 09:50:48.194358] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:25.496 [2024-11-29 09:50:48.194370] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:25.496 [2024-11-29 09:50:48.194382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:125784 len:8 PRP1 0x0 PRP2 0x0 00:27:25.496 [2024-11-29 09:50:48.194411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.497 [2024-11-29 09:50:48.194499] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x748740 was disconnected and freed. reset controller. 00:27:25.497 [2024-11-29 09:50:48.196959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.497 [2024-11-29 09:50:48.197037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.497 [2024-11-29 09:50:48.197613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.197745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.197774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.497 [2024-11-29 09:50:48.197792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.497 [2024-11-29 09:50:48.197905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.497 [2024-11-29 09:50:48.198040] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.497 [2024-11-29 09:50:48.198062] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.497 [2024-11-29 09:50:48.198082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.497 [2024-11-29 09:50:48.200625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.497 [2024-11-29 09:50:48.209662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.497 [2024-11-29 09:50:48.209981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.210157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.210186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.497 [2024-11-29 09:50:48.210203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.497 [2024-11-29 09:50:48.210351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.497 [2024-11-29 09:50:48.210533] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.497 [2024-11-29 09:50:48.210554] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.497 [2024-11-29 09:50:48.210567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.497 [2024-11-29 09:50:48.212959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.497 [2024-11-29 09:50:48.222149] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.497 [2024-11-29 09:50:48.222502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.222630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.222659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.497 [2024-11-29 09:50:48.222676] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.497 [2024-11-29 09:50:48.222861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.497 [2024-11-29 09:50:48.223013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.497 [2024-11-29 09:50:48.223037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.497 [2024-11-29 09:50:48.223060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.497 [2024-11-29 09:50:48.225467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.497 [2024-11-29 09:50:48.234540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.497 [2024-11-29 09:50:48.234865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.235002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.235027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.497 [2024-11-29 09:50:48.235043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.497 [2024-11-29 09:50:48.235208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.497 [2024-11-29 09:50:48.235342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.497 [2024-11-29 09:50:48.235365] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.497 [2024-11-29 09:50:48.235380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.497 [2024-11-29 09:50:48.237779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.497 [2024-11-29 09:50:48.246954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.497 [2024-11-29 09:50:48.247307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.247460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.247489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.497 [2024-11-29 09:50:48.247507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.497 [2024-11-29 09:50:48.247673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.497 [2024-11-29 09:50:48.247825] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.497 [2024-11-29 09:50:48.247848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.497 [2024-11-29 09:50:48.247862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.497 [2024-11-29 09:50:48.250096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.497 [2024-11-29 09:50:48.259622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.497 [2024-11-29 09:50:48.259934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.260040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.260068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.497 [2024-11-29 09:50:48.260086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.497 [2024-11-29 09:50:48.260251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.497 [2024-11-29 09:50:48.260415] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.497 [2024-11-29 09:50:48.260439] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.497 [2024-11-29 09:50:48.260454] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.497 [2024-11-29 09:50:48.262873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.497 [2024-11-29 09:50:48.272255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.497 [2024-11-29 09:50:48.272615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.272758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.272786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.497 [2024-11-29 09:50:48.272804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.497 [2024-11-29 09:50:48.272969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.497 [2024-11-29 09:50:48.273138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.497 [2024-11-29 09:50:48.273161] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.497 [2024-11-29 09:50:48.273176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.497 [2024-11-29 09:50:48.275493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.497 [2024-11-29 09:50:48.284885] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.497 [2024-11-29 09:50:48.285170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.285282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.285311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.497 [2024-11-29 09:50:48.285328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.497 [2024-11-29 09:50:48.285505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.497 [2024-11-29 09:50:48.285657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.497 [2024-11-29 09:50:48.285680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.497 [2024-11-29 09:50:48.285696] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.497 [2024-11-29 09:50:48.288056] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.497 [2024-11-29 09:50:48.297324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.497 [2024-11-29 09:50:48.297681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.297812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-29 09:50:48.297838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.497 [2024-11-29 09:50:48.297854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.497 [2024-11-29 09:50:48.298002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.497 [2024-11-29 09:50:48.298195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.497 [2024-11-29 09:50:48.298219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.497 [2024-11-29 09:50:48.298233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.497 [2024-11-29 09:50:48.300513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.497 [2024-11-29 09:50:48.309785] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.497 [2024-11-29 09:50:48.310099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-29 09:50:48.310264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-29 09:50:48.310292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.498 [2024-11-29 09:50:48.310309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.498 [2024-11-29 09:50:48.310469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.498 [2024-11-29 09:50:48.310639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.498 [2024-11-29 09:50:48.310662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.498 [2024-11-29 09:50:48.310677] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.498 [2024-11-29 09:50:48.312963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.498 [2024-11-29 09:50:48.322384] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.498 [2024-11-29 09:50:48.322773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-29 09:50:48.322938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-29 09:50:48.322967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.498 [2024-11-29 09:50:48.322984] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.498 [2024-11-29 09:50:48.323131] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.498 [2024-11-29 09:50:48.323282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.498 [2024-11-29 09:50:48.323305] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.498 [2024-11-29 09:50:48.323321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.498 [2024-11-29 09:50:48.325619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.759 [2024-11-29 09:50:48.335099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.759 [2024-11-29 09:50:48.335440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.759 [2024-11-29 09:50:48.335573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.759 [2024-11-29 09:50:48.335597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.759 [2024-11-29 09:50:48.335612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.759 [2024-11-29 09:50:48.335777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.759 [2024-11-29 09:50:48.335963] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.759 [2024-11-29 09:50:48.335985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.759 [2024-11-29 09:50:48.336000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.759 [2024-11-29 09:50:48.338182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.759 [2024-11-29 09:50:48.347748] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.759 [2024-11-29 09:50:48.348102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.759 [2024-11-29 09:50:48.348209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.759 [2024-11-29 09:50:48.348236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.759 [2024-11-29 09:50:48.348254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.759 [2024-11-29 09:50:48.348448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.759 [2024-11-29 09:50:48.348619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.759 [2024-11-29 09:50:48.348642] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.759 [2024-11-29 09:50:48.348657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.759 [2024-11-29 09:50:48.350944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.759 [2024-11-29 09:50:48.360343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.759 [2024-11-29 09:50:48.360651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.759 [2024-11-29 09:50:48.360792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.759 [2024-11-29 09:50:48.360819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.759 [2024-11-29 09:50:48.360835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.759 [2024-11-29 09:50:48.361026] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.759 [2024-11-29 09:50:48.361250] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.759 [2024-11-29 09:50:48.361272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.759 [2024-11-29 09:50:48.361288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.759 [2024-11-29 09:50:48.363624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.759 [2024-11-29 09:50:48.372840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.759 [2024-11-29 09:50:48.373162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.759 [2024-11-29 09:50:48.373313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.759 [2024-11-29 09:50:48.373338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.759 [2024-11-29 09:50:48.373354] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.759 [2024-11-29 09:50:48.373556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.759 [2024-11-29 09:50:48.373685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.759 [2024-11-29 09:50:48.373709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.760 [2024-11-29 09:50:48.373723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.760 [2024-11-29 09:50:48.375940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.760 [2024-11-29 09:50:48.385585] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.760 [2024-11-29 09:50:48.385907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.386081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.386133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.760 [2024-11-29 09:50:48.386151] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.760 [2024-11-29 09:50:48.386317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.760 [2024-11-29 09:50:48.386480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.760 [2024-11-29 09:50:48.386505] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.760 [2024-11-29 09:50:48.386520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.760 [2024-11-29 09:50:48.389038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.760 [2024-11-29 09:50:48.398258] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.760 [2024-11-29 09:50:48.398609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.398739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.398768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.760 [2024-11-29 09:50:48.398785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.760 [2024-11-29 09:50:48.398986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.760 [2024-11-29 09:50:48.399138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.760 [2024-11-29 09:50:48.399161] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.760 [2024-11-29 09:50:48.399176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.760 [2024-11-29 09:50:48.401696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.760 [2024-11-29 09:50:48.410796] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.760 [2024-11-29 09:50:48.411107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.411255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.411280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.760 [2024-11-29 09:50:48.411296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.760 [2024-11-29 09:50:48.411469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.760 [2024-11-29 09:50:48.411655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.760 [2024-11-29 09:50:48.411678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.760 [2024-11-29 09:50:48.411694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.760 [2024-11-29 09:50:48.414287] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.760 [2024-11-29 09:50:48.423420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.760 [2024-11-29 09:50:48.423760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.423890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.423918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.760 [2024-11-29 09:50:48.423941] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.760 [2024-11-29 09:50:48.424125] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.760 [2024-11-29 09:50:48.424295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.760 [2024-11-29 09:50:48.424318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.760 [2024-11-29 09:50:48.424333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.760 [2024-11-29 09:50:48.426701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.760 [2024-11-29 09:50:48.436088] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.760 [2024-11-29 09:50:48.436426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.436560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.436589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.760 [2024-11-29 09:50:48.436606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.760 [2024-11-29 09:50:48.436825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.760 [2024-11-29 09:50:48.436995] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.760 [2024-11-29 09:50:48.437018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.760 [2024-11-29 09:50:48.437033] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.760 [2024-11-29 09:50:48.439460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.760 [2024-11-29 09:50:48.448672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.760 [2024-11-29 09:50:48.449048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.449216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.449255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.760 [2024-11-29 09:50:48.449274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.760 [2024-11-29 09:50:48.449467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.760 [2024-11-29 09:50:48.449639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.760 [2024-11-29 09:50:48.449662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.760 [2024-11-29 09:50:48.449688] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.760 [2024-11-29 09:50:48.452156] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.760 [2024-11-29 09:50:48.461308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.760 [2024-11-29 09:50:48.461653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.461900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.461952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.760 [2024-11-29 09:50:48.461969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.760 [2024-11-29 09:50:48.462175] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.760 [2024-11-29 09:50:48.462328] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.760 [2024-11-29 09:50:48.462351] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.760 [2024-11-29 09:50:48.462365] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.760 [2024-11-29 09:50:48.464751] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.760 [2024-11-29 09:50:48.474032] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.760 [2024-11-29 09:50:48.474349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.474465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.474491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.760 [2024-11-29 09:50:48.474506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.760 [2024-11-29 09:50:48.474665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.760 [2024-11-29 09:50:48.474838] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.760 [2024-11-29 09:50:48.474861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.760 [2024-11-29 09:50:48.474876] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.760 [2024-11-29 09:50:48.477262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.760 [2024-11-29 09:50:48.486614] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.760 [2024-11-29 09:50:48.487102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.487286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.760 [2024-11-29 09:50:48.487314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.760 [2024-11-29 09:50:48.487332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.760 [2024-11-29 09:50:48.487542] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.760 [2024-11-29 09:50:48.487712] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.760 [2024-11-29 09:50:48.487735] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.760 [2024-11-29 09:50:48.487751] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.761 [2024-11-29 09:50:48.489926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.761 [2024-11-29 09:50:48.498981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.761 [2024-11-29 09:50:48.499303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.499442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.499471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.761 [2024-11-29 09:50:48.499489] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.761 [2024-11-29 09:50:48.499654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.761 [2024-11-29 09:50:48.499830] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.761 [2024-11-29 09:50:48.499854] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.761 [2024-11-29 09:50:48.499869] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.761 [2024-11-29 09:50:48.502210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.761 [2024-11-29 09:50:48.511711] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.761 [2024-11-29 09:50:48.512025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.512182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.512209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.761 [2024-11-29 09:50:48.512226] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.761 [2024-11-29 09:50:48.512391] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.761 [2024-11-29 09:50:48.512569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.761 [2024-11-29 09:50:48.512592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.761 [2024-11-29 09:50:48.512607] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.761 [2024-11-29 09:50:48.514984] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.761 [2024-11-29 09:50:48.524249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.761 [2024-11-29 09:50:48.524558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.524691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.524719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.761 [2024-11-29 09:50:48.524737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.761 [2024-11-29 09:50:48.524901] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.761 [2024-11-29 09:50:48.525053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.761 [2024-11-29 09:50:48.525076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.761 [2024-11-29 09:50:48.525091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.761 [2024-11-29 09:50:48.527472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.761 [2024-11-29 09:50:48.536778] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.761 [2024-11-29 09:50:48.537130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.537246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.537274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.761 [2024-11-29 09:50:48.537290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.761 [2024-11-29 09:50:48.537428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.761 [2024-11-29 09:50:48.537562] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.761 [2024-11-29 09:50:48.537595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.761 [2024-11-29 09:50:48.537611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.761 [2024-11-29 09:50:48.539875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.761 [2024-11-29 09:50:48.549294] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.761 [2024-11-29 09:50:48.549604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.549749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.549778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.761 [2024-11-29 09:50:48.549795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.761 [2024-11-29 09:50:48.549960] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.761 [2024-11-29 09:50:48.550093] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.761 [2024-11-29 09:50:48.550117] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.761 [2024-11-29 09:50:48.550132] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.761 [2024-11-29 09:50:48.552576] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.761 [2024-11-29 09:50:48.561960] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.761 [2024-11-29 09:50:48.562275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.562445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.562475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.761 [2024-11-29 09:50:48.562492] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.761 [2024-11-29 09:50:48.562675] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.761 [2024-11-29 09:50:48.562844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.761 [2024-11-29 09:50:48.562868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.761 [2024-11-29 09:50:48.562883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.761 [2024-11-29 09:50:48.565362] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.761 [2024-11-29 09:50:48.574618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.761 [2024-11-29 09:50:48.574978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.575144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.575172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.761 [2024-11-29 09:50:48.575190] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.761 [2024-11-29 09:50:48.575355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.761 [2024-11-29 09:50:48.575480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.761 [2024-11-29 09:50:48.575504] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.761 [2024-11-29 09:50:48.575526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.761 [2024-11-29 09:50:48.577865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.761 [2024-11-29 09:50:48.587323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.761 [2024-11-29 09:50:48.587681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.587888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.761 [2024-11-29 09:50:48.587949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:25.761 [2024-11-29 09:50:48.587967] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:25.761 [2024-11-29 09:50:48.588185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:25.761 [2024-11-29 09:50:48.588337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.761 [2024-11-29 09:50:48.588360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.761 [2024-11-29 09:50:48.588375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.761 [2024-11-29 09:50:48.590582] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.022 [2024-11-29 09:50:48.599927] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.022 [2024-11-29 09:50:48.600249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.022 [2024-11-29 09:50:48.600400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.022 [2024-11-29 09:50:48.600428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.022 [2024-11-29 09:50:48.600446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.022 [2024-11-29 09:50:48.600629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.022 [2024-11-29 09:50:48.600799] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.022 [2024-11-29 09:50:48.600822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.022 [2024-11-29 09:50:48.600837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.022 [2024-11-29 09:50:48.603246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.022 [2024-11-29 09:50:48.612458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.022 [2024-11-29 09:50:48.612871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.022 [2024-11-29 09:50:48.613003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.022 [2024-11-29 09:50:48.613028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.022 [2024-11-29 09:50:48.613043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.022 [2024-11-29 09:50:48.613174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.022 [2024-11-29 09:50:48.613352] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.022 [2024-11-29 09:50:48.613376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.022 [2024-11-29 09:50:48.613391] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.022 [2024-11-29 09:50:48.615767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.022 [2024-11-29 09:50:48.625124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.022 [2024-11-29 09:50:48.625456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.022 [2024-11-29 09:50:48.625611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.022 [2024-11-29 09:50:48.625637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.022 [2024-11-29 09:50:48.625653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.022 [2024-11-29 09:50:48.625814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.022 [2024-11-29 09:50:48.625981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.022 [2024-11-29 09:50:48.626005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.022 [2024-11-29 09:50:48.626020] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.022 [2024-11-29 09:50:48.628324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.022 [2024-11-29 09:50:48.637778] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.022 [2024-11-29 09:50:48.638077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.022 [2024-11-29 09:50:48.638256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.022 [2024-11-29 09:50:48.638281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.022 [2024-11-29 09:50:48.638296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.022 [2024-11-29 09:50:48.638540] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.022 [2024-11-29 09:50:48.638693] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.022 [2024-11-29 09:50:48.638716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.022 [2024-11-29 09:50:48.638731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.022 [2024-11-29 09:50:48.641050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.022 [2024-11-29 09:50:48.650350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.022 [2024-11-29 09:50:48.650672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.022 [2024-11-29 09:50:48.650882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.022 [2024-11-29 09:50:48.650931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.022 [2024-11-29 09:50:48.650948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.022 [2024-11-29 09:50:48.651132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.022 [2024-11-29 09:50:48.651265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.022 [2024-11-29 09:50:48.651288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.022 [2024-11-29 09:50:48.651303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.022 [2024-11-29 09:50:48.653657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.022 [2024-11-29 09:50:48.662849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.022 [2024-11-29 09:50:48.663144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.022 [2024-11-29 09:50:48.663284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.022 [2024-11-29 09:50:48.663313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.022 [2024-11-29 09:50:48.663330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.022 [2024-11-29 09:50:48.663470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.022 [2024-11-29 09:50:48.663695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.022 [2024-11-29 09:50:48.663719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.022 [2024-11-29 09:50:48.663734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.022 [2024-11-29 09:50:48.666254] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.022 [2024-11-29 09:50:48.675372] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.022 [2024-11-29 09:50:48.675680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.022 [2024-11-29 09:50:48.675850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.022 [2024-11-29 09:50:48.675878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.022 [2024-11-29 09:50:48.675896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.022 [2024-11-29 09:50:48.676078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.022 [2024-11-29 09:50:48.676247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.022 [2024-11-29 09:50:48.676270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.023 [2024-11-29 09:50:48.676285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.023 [2024-11-29 09:50:48.678454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.023 [2024-11-29 09:50:48.688018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.023 [2024-11-29 09:50:48.688332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.688498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.688528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.023 [2024-11-29 09:50:48.688545] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.023 [2024-11-29 09:50:48.688727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.023 [2024-11-29 09:50:48.688933] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.023 [2024-11-29 09:50:48.688956] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.023 [2024-11-29 09:50:48.688971] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.023 [2024-11-29 09:50:48.691346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.023 [2024-11-29 09:50:48.700606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.023 [2024-11-29 09:50:48.700898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.701048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.701097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.023 [2024-11-29 09:50:48.701115] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.023 [2024-11-29 09:50:48.701262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.023 [2024-11-29 09:50:48.701408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.023 [2024-11-29 09:50:48.701432] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.023 [2024-11-29 09:50:48.701447] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.023 [2024-11-29 09:50:48.703756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.023 [2024-11-29 09:50:48.713006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.023 [2024-11-29 09:50:48.713466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.713600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.713628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.023 [2024-11-29 09:50:48.713645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.023 [2024-11-29 09:50:48.713792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.023 [2024-11-29 09:50:48.713962] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.023 [2024-11-29 09:50:48.713985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.023 [2024-11-29 09:50:48.714000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.023 [2024-11-29 09:50:48.716373] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.023 [2024-11-29 09:50:48.725551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.023 [2024-11-29 09:50:48.725847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.725960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.725989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.023 [2024-11-29 09:50:48.726007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.023 [2024-11-29 09:50:48.726171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.023 [2024-11-29 09:50:48.726340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.023 [2024-11-29 09:50:48.726363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.023 [2024-11-29 09:50:48.726378] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.023 [2024-11-29 09:50:48.728853] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.023 [2024-11-29 09:50:48.738213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.023 [2024-11-29 09:50:48.738569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.738661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.738694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.023 [2024-11-29 09:50:48.738713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.023 [2024-11-29 09:50:48.738804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.023 [2024-11-29 09:50:48.739009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.023 [2024-11-29 09:50:48.739033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.023 [2024-11-29 09:50:48.739047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.023 [2024-11-29 09:50:48.741414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.023 [2024-11-29 09:50:48.750877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.023 [2024-11-29 09:50:48.751178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.751327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.751353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.023 [2024-11-29 09:50:48.751369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.023 [2024-11-29 09:50:48.751500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.023 [2024-11-29 09:50:48.751689] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.023 [2024-11-29 09:50:48.751712] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.023 [2024-11-29 09:50:48.751727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.023 [2024-11-29 09:50:48.754085] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.023 [2024-11-29 09:50:48.763595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.023 [2024-11-29 09:50:48.763931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.764082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.764111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.023 [2024-11-29 09:50:48.764128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.023 [2024-11-29 09:50:48.764258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.023 [2024-11-29 09:50:48.764457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.023 [2024-11-29 09:50:48.764481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.023 [2024-11-29 09:50:48.764497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.023 [2024-11-29 09:50:48.766767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.023 [2024-11-29 09:50:48.776310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.023 [2024-11-29 09:50:48.776659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.776786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.776812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.023 [2024-11-29 09:50:48.776833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.023 [2024-11-29 09:50:48.776931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.023 [2024-11-29 09:50:48.777120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.023 [2024-11-29 09:50:48.777142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.023 [2024-11-29 09:50:48.777157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.023 [2024-11-29 09:50:48.779352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.023 [2024-11-29 09:50:48.788664] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.023 [2024-11-29 09:50:48.789064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.789264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.023 [2024-11-29 09:50:48.789292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.023 [2024-11-29 09:50:48.789309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.023 [2024-11-29 09:50:48.789466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.023 [2024-11-29 09:50:48.789636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.023 [2024-11-29 09:50:48.789659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.023 [2024-11-29 09:50:48.789675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.023 [2024-11-29 09:50:48.792094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.023 [2024-11-29 09:50:48.801296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.023 [2024-11-29 09:50:48.801586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.024 [2024-11-29 09:50:48.801738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.024 [2024-11-29 09:50:48.801764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.024 [2024-11-29 09:50:48.801780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.024 [2024-11-29 09:50:48.801955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.024 [2024-11-29 09:50:48.802142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.024 [2024-11-29 09:50:48.802165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.024 [2024-11-29 09:50:48.802180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.024 [2024-11-29 09:50:48.804511] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.024 [2024-11-29 09:50:48.814018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.024 [2024-11-29 09:50:48.814322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.024 [2024-11-29 09:50:48.814458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.024 [2024-11-29 09:50:48.814487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.024 [2024-11-29 09:50:48.814504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.024 [2024-11-29 09:50:48.814621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.024 [2024-11-29 09:50:48.814790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.024 [2024-11-29 09:50:48.814814] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.024 [2024-11-29 09:50:48.814829] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.024 [2024-11-29 09:50:48.817267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.024 [2024-11-29 09:50:48.826557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.024 [2024-11-29 09:50:48.826825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.024 [2024-11-29 09:50:48.826994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.024 [2024-11-29 09:50:48.827020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.024 [2024-11-29 09:50:48.827036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.024 [2024-11-29 09:50:48.827201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.024 [2024-11-29 09:50:48.827384] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.024 [2024-11-29 09:50:48.827419] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.024 [2024-11-29 09:50:48.827434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.024 [2024-11-29 09:50:48.829885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.024 [2024-11-29 09:50:48.839301] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.024 [2024-11-29 09:50:48.839637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.024 [2024-11-29 09:50:48.839784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.024 [2024-11-29 09:50:48.839831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.024 [2024-11-29 09:50:48.839848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.024 [2024-11-29 09:50:48.840031] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.024 [2024-11-29 09:50:48.840183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.024 [2024-11-29 09:50:48.840206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.024 [2024-11-29 09:50:48.840221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.024 [2024-11-29 09:50:48.842575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.024 [2024-11-29 09:50:48.851786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.024 [2024-11-29 09:50:48.852110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.024 [2024-11-29 09:50:48.852223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.024 [2024-11-29 09:50:48.852252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.024 [2024-11-29 09:50:48.852269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.024 [2024-11-29 09:50:48.852442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.024 [2024-11-29 09:50:48.852582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.024 [2024-11-29 09:50:48.852605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.024 [2024-11-29 09:50:48.852620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.024 [2024-11-29 09:50:48.854814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.284 [2024-11-29 09:50:48.864300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.284 [2024-11-29 09:50:48.864547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.284 [2024-11-29 09:50:48.864701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.284 [2024-11-29 09:50:48.864726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.284 [2024-11-29 09:50:48.864742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.284 [2024-11-29 09:50:48.864940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.284 [2024-11-29 09:50:48.865128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.284 [2024-11-29 09:50:48.865151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.284 [2024-11-29 09:50:48.865166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.284 [2024-11-29 09:50:48.867625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.284 [2024-11-29 09:50:48.876814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.284 [2024-11-29 09:50:48.877180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.284 [2024-11-29 09:50:48.877311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.284 [2024-11-29 09:50:48.877339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.284 [2024-11-29 09:50:48.877356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.284 [2024-11-29 09:50:48.877530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.284 [2024-11-29 09:50:48.877760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.284 [2024-11-29 09:50:48.877793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.284 [2024-11-29 09:50:48.877808] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.284 [2024-11-29 09:50:48.880117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.284 [2024-11-29 09:50:48.889263] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.284 [2024-11-29 09:50:48.889564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.284 [2024-11-29 09:50:48.889732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.284 [2024-11-29 09:50:48.889757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.284 [2024-11-29 09:50:48.889772] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.284 [2024-11-29 09:50:48.889968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.284 [2024-11-29 09:50:48.890167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.284 [2024-11-29 09:50:48.890196] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.284 [2024-11-29 09:50:48.890212] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.284 [2024-11-29 09:50:48.892538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.284 [2024-11-29 09:50:48.902008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.284 [2024-11-29 09:50:48.902332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.284 [2024-11-29 09:50:48.902474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.284 [2024-11-29 09:50:48.902501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.284 [2024-11-29 09:50:48.902517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.284 [2024-11-29 09:50:48.902666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.284 [2024-11-29 09:50:48.902802] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.284 [2024-11-29 09:50:48.902825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.285 [2024-11-29 09:50:48.902840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.285 [2024-11-29 09:50:48.905203] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.285 [2024-11-29 09:50:48.914438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.285 [2024-11-29 09:50:48.914708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.285 [2024-11-29 09:50:48.914843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.285 [2024-11-29 09:50:48.914871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.285 [2024-11-29 09:50:48.914888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.285 [2024-11-29 09:50:48.915035] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.285 [2024-11-29 09:50:48.915221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.285 [2024-11-29 09:50:48.915244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.285 [2024-11-29 09:50:48.915259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.285 [2024-11-29 09:50:48.917534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.285 [2024-11-29 09:50:48.927040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.285 [2024-11-29 09:50:48.927418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.285 [2024-11-29 09:50:48.927538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.285 [2024-11-29 09:50:48.927565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.285 [2024-11-29 09:50:48.927582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.285 [2024-11-29 09:50:48.927729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.285 [2024-11-29 09:50:48.927899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.285 [2024-11-29 09:50:48.927922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.285 [2024-11-29 09:50:48.927942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.285 [2024-11-29 09:50:48.930227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.285 [2024-11-29 09:50:48.939557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.285 [2024-11-29 09:50:48.939935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.285 [2024-11-29 09:50:48.940098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.285 [2024-11-29 09:50:48.940126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.285 [2024-11-29 09:50:48.940143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.285 [2024-11-29 09:50:48.940272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.285 [2024-11-29 09:50:48.940468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.285 [2024-11-29 09:50:48.940492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.285 [2024-11-29 09:50:48.940507] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.285 [2024-11-29 09:50:48.942820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.285 [2024-11-29 09:50:48.952107] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.285 [2024-11-29 09:50:48.952398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.285 [2024-11-29 09:50:48.952501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.285 [2024-11-29 09:50:48.952527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.285 [2024-11-29 09:50:48.952543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.285 [2024-11-29 09:50:48.952665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.285 [2024-11-29 09:50:48.952853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.285 [2024-11-29 09:50:48.952876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.285 [2024-11-29 09:50:48.952891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.285 [2024-11-29 09:50:48.955118] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.285 [2024-11-29 09:50:48.964683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.285 [2024-11-29 09:50:48.964969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.285 [2024-11-29 09:50:48.965132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.285 [2024-11-29 09:50:48.965182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.285 [2024-11-29 09:50:48.965199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.285 [2024-11-29 09:50:48.965363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.285 [2024-11-29 09:50:48.965543] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.285 [2024-11-29 09:50:48.965567] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.285 [2024-11-29 09:50:48.965581] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.285 [2024-11-29 09:50:48.967890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.285 [2024-11-29 09:50:48.977423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.285 [2024-11-29 09:50:48.977733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.285 [2024-11-29 09:50:48.977903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.285 [2024-11-29 09:50:48.977931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.285 [2024-11-29 09:50:48.977949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.285 [2024-11-29 09:50:48.978095] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.285 [2024-11-29 09:50:48.978300] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.285 [2024-11-29 09:50:48.978323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.285 [2024-11-29 09:50:48.978338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.285 [2024-11-29 09:50:48.980846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.285 [2024-11-29 09:50:48.989957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.285 [2024-11-29 09:50:48.990243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.285 [2024-11-29 09:50:48.990416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.285 [2024-11-29 09:50:48.990446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.285 [2024-11-29 09:50:48.990463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.285 [2024-11-29 09:50:48.990646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.285 [2024-11-29 09:50:48.990852] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.285 [2024-11-29 09:50:48.990875] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.285 [2024-11-29 09:50:48.990890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.285 [2024-11-29 09:50:48.993173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.285 [2024-11-29 09:50:49.002438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.286 [2024-11-29 09:50:49.002724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.002879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.002908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.286 [2024-11-29 09:50:49.002925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.286 [2024-11-29 09:50:49.003054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.286 [2024-11-29 09:50:49.003224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.286 [2024-11-29 09:50:49.003247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.286 [2024-11-29 09:50:49.003261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.286 [2024-11-29 09:50:49.005519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.286 [2024-11-29 09:50:49.014867] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.286 [2024-11-29 09:50:49.015246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.015402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.015431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.286 [2024-11-29 09:50:49.015449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.286 [2024-11-29 09:50:49.015614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.286 [2024-11-29 09:50:49.015765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.286 [2024-11-29 09:50:49.015788] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.286 [2024-11-29 09:50:49.015803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.286 [2024-11-29 09:50:49.018098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.286 [2024-11-29 09:50:49.027518] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.286 [2024-11-29 09:50:49.027801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.027938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.027967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.286 [2024-11-29 09:50:49.027984] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.286 [2024-11-29 09:50:49.028168] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.286 [2024-11-29 09:50:49.028373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.286 [2024-11-29 09:50:49.028405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.286 [2024-11-29 09:50:49.028423] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.286 [2024-11-29 09:50:49.030600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.286 [2024-11-29 09:50:49.040036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.286 [2024-11-29 09:50:49.040316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.040480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.040509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.286 [2024-11-29 09:50:49.040527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.286 [2024-11-29 09:50:49.040710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.286 [2024-11-29 09:50:49.040915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.286 [2024-11-29 09:50:49.040938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.286 [2024-11-29 09:50:49.040953] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.286 [2024-11-29 09:50:49.043273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.286 [2024-11-29 09:50:49.052618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.286 [2024-11-29 09:50:49.052902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.053071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.053099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.286 [2024-11-29 09:50:49.053117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.286 [2024-11-29 09:50:49.053282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.286 [2024-11-29 09:50:49.053445] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.286 [2024-11-29 09:50:49.053469] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.286 [2024-11-29 09:50:49.053484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.286 [2024-11-29 09:50:49.055821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.286 [2024-11-29 09:50:49.065189] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.286 [2024-11-29 09:50:49.065519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.065656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.065685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.286 [2024-11-29 09:50:49.065702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.286 [2024-11-29 09:50:49.065904] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.286 [2024-11-29 09:50:49.066000] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.286 [2024-11-29 09:50:49.066023] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.286 [2024-11-29 09:50:49.066038] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.286 [2024-11-29 09:50:49.068442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.286 [2024-11-29 09:50:49.077810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.286 [2024-11-29 09:50:49.078108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.078249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.078277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.286 [2024-11-29 09:50:49.078295] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.286 [2024-11-29 09:50:49.078471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.286 [2024-11-29 09:50:49.078677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.286 [2024-11-29 09:50:49.078700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.286 [2024-11-29 09:50:49.078715] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.286 [2024-11-29 09:50:49.080926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.286 [2024-11-29 09:50:49.090345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.286 [2024-11-29 09:50:49.090661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.286 [2024-11-29 09:50:49.090831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.287 [2024-11-29 09:50:49.090859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.287 [2024-11-29 09:50:49.090882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.287 [2024-11-29 09:50:49.091030] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.287 [2024-11-29 09:50:49.091199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.287 [2024-11-29 09:50:49.091222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.287 [2024-11-29 09:50:49.091237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.287 [2024-11-29 09:50:49.093704] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.287 [2024-11-29 09:50:49.102989] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.287 [2024-11-29 09:50:49.103302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.287 [2024-11-29 09:50:49.103488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.287 [2024-11-29 09:50:49.103537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.287 [2024-11-29 09:50:49.103554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.287 [2024-11-29 09:50:49.103702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.287 [2024-11-29 09:50:49.103889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.287 [2024-11-29 09:50:49.103912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.287 [2024-11-29 09:50:49.103926] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.287 [2024-11-29 09:50:49.106174] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.287 [2024-11-29 09:50:49.115592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.287 [2024-11-29 09:50:49.115936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.287 [2024-11-29 09:50:49.116094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.287 [2024-11-29 09:50:49.116122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.287 [2024-11-29 09:50:49.116139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.287 [2024-11-29 09:50:49.116339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.287 [2024-11-29 09:50:49.116483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.287 [2024-11-29 09:50:49.116507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.287 [2024-11-29 09:50:49.116521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.287 [2024-11-29 09:50:49.118716] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.549 [2024-11-29 09:50:49.128093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.549 [2024-11-29 09:50:49.128409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.549 [2024-11-29 09:50:49.128626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.549 [2024-11-29 09:50:49.128655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.549 [2024-11-29 09:50:49.128672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.549 [2024-11-29 09:50:49.128866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.549 [2024-11-29 09:50:49.129035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.549 [2024-11-29 09:50:49.129059] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.549 [2024-11-29 09:50:49.129074] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.549 [2024-11-29 09:50:49.131443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.549 [2024-11-29 09:50:49.140646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.549 [2024-11-29 09:50:49.141005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.549 [2024-11-29 09:50:49.141147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.549 [2024-11-29 09:50:49.141179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.549 [2024-11-29 09:50:49.141212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.549 [2024-11-29 09:50:49.141376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.549 [2024-11-29 09:50:49.141594] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.549 [2024-11-29 09:50:49.141618] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.549 [2024-11-29 09:50:49.141633] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.549 [2024-11-29 09:50:49.143970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.549 [2024-11-29 09:50:49.153503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.549 [2024-11-29 09:50:49.153859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.549 [2024-11-29 09:50:49.154068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.549 [2024-11-29 09:50:49.154116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.549 [2024-11-29 09:50:49.154134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.549 [2024-11-29 09:50:49.154298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.549 [2024-11-29 09:50:49.154497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.549 [2024-11-29 09:50:49.154521] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.549 [2024-11-29 09:50:49.154536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.549 [2024-11-29 09:50:49.156931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.549 [2024-11-29 09:50:49.166302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.549 [2024-11-29 09:50:49.166664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.549 [2024-11-29 09:50:49.166779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.549 [2024-11-29 09:50:49.166809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.549 [2024-11-29 09:50:49.166826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.549 [2024-11-29 09:50:49.167009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.549 [2024-11-29 09:50:49.167167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.549 [2024-11-29 09:50:49.167190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.549 [2024-11-29 09:50:49.167205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.549 [2024-11-29 09:50:49.169773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.549 [2024-11-29 09:50:49.178759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.549 [2024-11-29 09:50:49.179109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.549 [2024-11-29 09:50:49.179242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.549 [2024-11-29 09:50:49.179271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.549 [2024-11-29 09:50:49.179288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.549 [2024-11-29 09:50:49.179467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.549 [2024-11-29 09:50:49.179637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.549 [2024-11-29 09:50:49.179661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.549 [2024-11-29 09:50:49.179676] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.549 [2024-11-29 09:50:49.181801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.549 [2024-11-29 09:50:49.191293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.549 [2024-11-29 09:50:49.191602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.549 [2024-11-29 09:50:49.191701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.549 [2024-11-29 09:50:49.191727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.549 [2024-11-29 09:50:49.191742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.549 [2024-11-29 09:50:49.191911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.549 [2024-11-29 09:50:49.192063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.549 [2024-11-29 09:50:49.192086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.549 [2024-11-29 09:50:49.192101] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.549 [2024-11-29 09:50:49.194261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.549 [2024-11-29 09:50:49.203932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.549 [2024-11-29 09:50:49.204240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.549 [2024-11-29 09:50:49.204411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.549 [2024-11-29 09:50:49.204441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.549 [2024-11-29 09:50:49.204458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.549 [2024-11-29 09:50:49.204658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.549 [2024-11-29 09:50:49.204846] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.549 [2024-11-29 09:50:49.204875] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.549 [2024-11-29 09:50:49.204891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.550 [2024-11-29 09:50:49.207219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.550 [2024-11-29 09:50:49.216427] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.550 [2024-11-29 09:50:49.216782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.550 [2024-11-29 09:50:49.216891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.550 [2024-11-29 09:50:49.216919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.550 [2024-11-29 09:50:49.216936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.550 [2024-11-29 09:50:49.217065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.550 [2024-11-29 09:50:49.217253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.550 [2024-11-29 09:50:49.217276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.550 [2024-11-29 09:50:49.217291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.550 [2024-11-29 09:50:49.219791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.550 [2024-11-29 09:50:49.228930] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.550 [2024-11-29 09:50:49.229249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.550 [2024-11-29 09:50:49.229372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.550 [2024-11-29 09:50:49.229405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.550 [2024-11-29 09:50:49.229422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.550 [2024-11-29 09:50:49.229555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.550 [2024-11-29 09:50:49.229690] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.550 [2024-11-29 09:50:49.229713] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.550 [2024-11-29 09:50:49.229728] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.550 [2024-11-29 09:50:49.231958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.550 [2024-11-29 09:50:49.241558] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.550 [2024-11-29 09:50:49.241885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.550 [2024-11-29 09:50:49.242045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.550 [2024-11-29 09:50:49.242072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.550 [2024-11-29 09:50:49.242088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.550 [2024-11-29 09:50:49.242265] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.550 [2024-11-29 09:50:49.242431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.550 [2024-11-29 09:50:49.242456] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.550 [2024-11-29 09:50:49.242477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.550 [2024-11-29 09:50:49.244891] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.550 [2024-11-29 09:50:49.254089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.550 [2024-11-29 09:50:49.254391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.550 [2024-11-29 09:50:49.254559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.550 [2024-11-29 09:50:49.254587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.550 [2024-11-29 09:50:49.254604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.550 [2024-11-29 09:50:49.254787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.550 [2024-11-29 09:50:49.254938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.550 [2024-11-29 09:50:49.254961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.550 [2024-11-29 09:50:49.254976] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.550 [2024-11-29 09:50:49.257255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.550 [2024-11-29 09:50:49.266835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.550 [2024-11-29 09:50:49.267094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.550 [2024-11-29 09:50:49.267236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.550 [2024-11-29 09:50:49.267264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.550 [2024-11-29 09:50:49.267281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.550 [2024-11-29 09:50:49.267421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.550 [2024-11-29 09:50:49.267556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.550 [2024-11-29 09:50:49.267578] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.550 [2024-11-29 09:50:49.267593] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.550 [2024-11-29 09:50:49.270003] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.550 [2024-11-29 09:50:49.279360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.550 [2024-11-29 09:50:49.279661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.550 [2024-11-29 09:50:49.279799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.550 [2024-11-29 09:50:49.279827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.550 [2024-11-29 09:50:49.279844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.550 [2024-11-29 09:50:49.280028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.550 [2024-11-29 09:50:49.280143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.550 [2024-11-29 09:50:49.280165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.550 [2024-11-29 09:50:49.280180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.550 [2024-11-29 09:50:49.282466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.550 [2024-11-29 09:50:49.291994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.550 [2024-11-29 09:50:49.292290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.550 [2024-11-29 09:50:49.292408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.550 [2024-11-29 09:50:49.292437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.550 [2024-11-29 09:50:49.292454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.550 [2024-11-29 09:50:49.292583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.550 [2024-11-29 09:50:49.292734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.550 [2024-11-29 09:50:49.292757] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.550 [2024-11-29 09:50:49.292772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.550 [2024-11-29 09:50:49.295093] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.551 [2024-11-29 09:50:49.304252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.551 [2024-11-29 09:50:49.304543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-29 09:50:49.304704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-29 09:50:49.304732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.551 [2024-11-29 09:50:49.304749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.551 [2024-11-29 09:50:49.304915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.551 [2024-11-29 09:50:49.305066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.551 [2024-11-29 09:50:49.305089] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.551 [2024-11-29 09:50:49.305104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.551 [2024-11-29 09:50:49.307598] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.551 [2024-11-29 09:50:49.316923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.551 [2024-11-29 09:50:49.317252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-29 09:50:49.317389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-29 09:50:49.317427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.551 [2024-11-29 09:50:49.317444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.551 [2024-11-29 09:50:49.317663] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.551 [2024-11-29 09:50:49.317814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.551 [2024-11-29 09:50:49.317837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.551 [2024-11-29 09:50:49.317851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.551 [2024-11-29 09:50:49.320208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.551 [2024-11-29 09:50:49.329404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.551 [2024-11-29 09:50:49.329738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-29 09:50:49.329871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-29 09:50:49.329900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.551 [2024-11-29 09:50:49.329918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.551 [2024-11-29 09:50:49.330101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.551 [2024-11-29 09:50:49.330271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.551 [2024-11-29 09:50:49.330294] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.551 [2024-11-29 09:50:49.330309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.551 [2024-11-29 09:50:49.332661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.551 [2024-11-29 09:50:49.342037] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.551 [2024-11-29 09:50:49.342376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-29 09:50:49.342512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-29 09:50:49.342538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.551 [2024-11-29 09:50:49.342554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.551 [2024-11-29 09:50:49.342726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.551 [2024-11-29 09:50:49.342896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.551 [2024-11-29 09:50:49.342919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.551 [2024-11-29 09:50:49.342934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.551 [2024-11-29 09:50:49.345295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.551 [2024-11-29 09:50:49.354764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.551 [2024-11-29 09:50:49.355106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-29 09:50:49.355289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-29 09:50:49.355318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.551 [2024-11-29 09:50:49.355335] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.551 [2024-11-29 09:50:49.355511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.551 [2024-11-29 09:50:49.355717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.551 [2024-11-29 09:50:49.355740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.551 [2024-11-29 09:50:49.355755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.551 [2024-11-29 09:50:49.357951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.551 [2024-11-29 09:50:49.367281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.551 [2024-11-29 09:50:49.367553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-29 09:50:49.367721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-29 09:50:49.367749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.551 [2024-11-29 09:50:49.367767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.551 [2024-11-29 09:50:49.367967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.551 [2024-11-29 09:50:49.368154] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.551 [2024-11-29 09:50:49.368177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.551 [2024-11-29 09:50:49.368192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.551 [2024-11-29 09:50:49.370506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.551 [2024-11-29 09:50:49.379873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.551 [2024-11-29 09:50:49.380191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-29 09:50:49.380341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.551 [2024-11-29 09:50:49.380371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.551 [2024-11-29 09:50:49.380389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.551 [2024-11-29 09:50:49.380583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.551 [2024-11-29 09:50:49.380717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.551 [2024-11-29 09:50:49.380739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.551 [2024-11-29 09:50:49.380754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.551 [2024-11-29 09:50:49.383133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.812 [2024-11-29 09:50:49.392576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.812 [2024-11-29 09:50:49.392857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.393015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.393062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.812 [2024-11-29 09:50:49.393079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.812 [2024-11-29 09:50:49.393208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.812 [2024-11-29 09:50:49.393358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.812 [2024-11-29 09:50:49.393381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.812 [2024-11-29 09:50:49.393409] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.812 [2024-11-29 09:50:49.395879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.812 [2024-11-29 09:50:49.405065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.812 [2024-11-29 09:50:49.405387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.405540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.405574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.812 [2024-11-29 09:50:49.405592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.812 [2024-11-29 09:50:49.405756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.812 [2024-11-29 09:50:49.405926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.812 [2024-11-29 09:50:49.405949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.812 [2024-11-29 09:50:49.405965] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.812 [2024-11-29 09:50:49.408424] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.812 [2024-11-29 09:50:49.417869] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.812 [2024-11-29 09:50:49.418204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.418387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.418424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.812 [2024-11-29 09:50:49.418442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.812 [2024-11-29 09:50:49.418570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.812 [2024-11-29 09:50:49.418740] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.812 [2024-11-29 09:50:49.418763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.812 [2024-11-29 09:50:49.418779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.812 [2024-11-29 09:50:49.421208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.812 [2024-11-29 09:50:49.430304] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.812 [2024-11-29 09:50:49.430615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.430807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.430853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.812 [2024-11-29 09:50:49.430870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.812 [2024-11-29 09:50:49.431070] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.812 [2024-11-29 09:50:49.431276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.812 [2024-11-29 09:50:49.431299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.812 [2024-11-29 09:50:49.431314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.812 [2024-11-29 09:50:49.433664] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.812 [2024-11-29 09:50:49.442811] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.812 [2024-11-29 09:50:49.443118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.443282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.443307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.812 [2024-11-29 09:50:49.443327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.812 [2024-11-29 09:50:49.443558] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.812 [2024-11-29 09:50:49.443765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.812 [2024-11-29 09:50:49.443788] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.812 [2024-11-29 09:50:49.443803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.812 [2024-11-29 09:50:49.446215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.812 [2024-11-29 09:50:49.455388] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.812 [2024-11-29 09:50:49.455771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.455906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.455935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.812 [2024-11-29 09:50:49.455953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.812 [2024-11-29 09:50:49.456136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.812 [2024-11-29 09:50:49.456324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.812 [2024-11-29 09:50:49.456347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.812 [2024-11-29 09:50:49.456362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.812 [2024-11-29 09:50:49.458551] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.812 [2024-11-29 09:50:49.467875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.812 [2024-11-29 09:50:49.468226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.468409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.468458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.812 [2024-11-29 09:50:49.468476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.812 [2024-11-29 09:50:49.468677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.812 [2024-11-29 09:50:49.468829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.812 [2024-11-29 09:50:49.468853] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.812 [2024-11-29 09:50:49.468868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.812 [2024-11-29 09:50:49.470987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.812 [2024-11-29 09:50:49.480503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.812 [2024-11-29 09:50:49.480781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.480991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.812 [2024-11-29 09:50:49.481017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.812 [2024-11-29 09:50:49.481033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.812 [2024-11-29 09:50:49.481180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.813 [2024-11-29 09:50:49.481411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.813 [2024-11-29 09:50:49.481435] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.813 [2024-11-29 09:50:49.481450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.813 [2024-11-29 09:50:49.483629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.813 [2024-11-29 09:50:49.493162] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.813 [2024-11-29 09:50:49.493454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.493583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.493609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.813 [2024-11-29 09:50:49.493624] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.813 [2024-11-29 09:50:49.493815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.813 [2024-11-29 09:50:49.494020] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.813 [2024-11-29 09:50:49.494043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.813 [2024-11-29 09:50:49.494057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.813 [2024-11-29 09:50:49.496475] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.813 [2024-11-29 09:50:49.505761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.813 [2024-11-29 09:50:49.506077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.506245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.506274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.813 [2024-11-29 09:50:49.506291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.813 [2024-11-29 09:50:49.506432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.813 [2024-11-29 09:50:49.506602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.813 [2024-11-29 09:50:49.506625] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.813 [2024-11-29 09:50:49.506640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.813 [2024-11-29 09:50:49.508981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.813 [2024-11-29 09:50:49.518527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.813 [2024-11-29 09:50:49.518884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.519061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.519087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.813 [2024-11-29 09:50:49.519102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.813 [2024-11-29 09:50:49.519290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.813 [2024-11-29 09:50:49.519430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.813 [2024-11-29 09:50:49.519455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.813 [2024-11-29 09:50:49.519470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.813 [2024-11-29 09:50:49.521672] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.813 [2024-11-29 09:50:49.531093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.813 [2024-11-29 09:50:49.531413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.531573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.531602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.813 [2024-11-29 09:50:49.531619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.813 [2024-11-29 09:50:49.531801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.813 [2024-11-29 09:50:49.531971] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.813 [2024-11-29 09:50:49.531994] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.813 [2024-11-29 09:50:49.532008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.813 [2024-11-29 09:50:49.534260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.813 [2024-11-29 09:50:49.543690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.813 [2024-11-29 09:50:49.544030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.544169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.544197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.813 [2024-11-29 09:50:49.544214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.813 [2024-11-29 09:50:49.544379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.813 [2024-11-29 09:50:49.544561] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.813 [2024-11-29 09:50:49.544584] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.813 [2024-11-29 09:50:49.544599] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.813 [2024-11-29 09:50:49.546810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.813 [2024-11-29 09:50:49.556240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.813 [2024-11-29 09:50:49.556531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.556666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.556694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.813 [2024-11-29 09:50:49.556711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.813 [2024-11-29 09:50:49.556858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.813 [2024-11-29 09:50:49.556991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.813 [2024-11-29 09:50:49.557019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.813 [2024-11-29 09:50:49.557036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.813 [2024-11-29 09:50:49.559420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.813 [2024-11-29 09:50:49.568749] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.813 [2024-11-29 09:50:49.569043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.569179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.569207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.813 [2024-11-29 09:50:49.569224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.813 [2024-11-29 09:50:49.569372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.813 [2024-11-29 09:50:49.569569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.813 [2024-11-29 09:50:49.569594] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.813 [2024-11-29 09:50:49.569610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.813 [2024-11-29 09:50:49.571804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.813 [2024-11-29 09:50:49.581306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.813 [2024-11-29 09:50:49.581619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.581773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.581798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.813 [2024-11-29 09:50:49.581813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.813 [2024-11-29 09:50:49.581977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.813 [2024-11-29 09:50:49.582103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.813 [2024-11-29 09:50:49.582126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.813 [2024-11-29 09:50:49.582142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.813 [2024-11-29 09:50:49.584442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.813 [2024-11-29 09:50:49.594075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.813 [2024-11-29 09:50:49.594423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.594576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.813 [2024-11-29 09:50:49.594624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.813 [2024-11-29 09:50:49.594641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.813 [2024-11-29 09:50:49.594824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.813 [2024-11-29 09:50:49.594976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.813 [2024-11-29 09:50:49.594999] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.813 [2024-11-29 09:50:49.595019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.813 [2024-11-29 09:50:49.597309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.814 [2024-11-29 09:50:49.606514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.814 [2024-11-29 09:50:49.606877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-29 09:50:49.606997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-29 09:50:49.607027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.814 [2024-11-29 09:50:49.607045] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.814 [2024-11-29 09:50:49.607210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.814 [2024-11-29 09:50:49.607361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.814 [2024-11-29 09:50:49.607384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.814 [2024-11-29 09:50:49.607410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.814 [2024-11-29 09:50:49.609626] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.814 [2024-11-29 09:50:49.619156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.814 [2024-11-29 09:50:49.619414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-29 09:50:49.619590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-29 09:50:49.619616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.814 [2024-11-29 09:50:49.619633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.814 [2024-11-29 09:50:49.619825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.814 [2024-11-29 09:50:49.620013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.814 [2024-11-29 09:50:49.620036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.814 [2024-11-29 09:50:49.620051] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.814 [2024-11-29 09:50:49.622476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.814 [2024-11-29 09:50:49.631720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.814 [2024-11-29 09:50:49.632044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-29 09:50:49.632181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-29 09:50:49.632210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.814 [2024-11-29 09:50:49.632227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.814 [2024-11-29 09:50:49.632438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.814 [2024-11-29 09:50:49.632627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.814 [2024-11-29 09:50:49.632650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.814 [2024-11-29 09:50:49.632666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.814 [2024-11-29 09:50:49.635002] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.814 [2024-11-29 09:50:49.644365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.814 [2024-11-29 09:50:49.644667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-29 09:50:49.644803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.814 [2024-11-29 09:50:49.644832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:26.814 [2024-11-29 09:50:49.644849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:26.814 [2024-11-29 09:50:49.645068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:26.814 [2024-11-29 09:50:49.645202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.814 [2024-11-29 09:50:49.645225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.814 [2024-11-29 09:50:49.645241] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.814 [2024-11-29 09:50:49.647661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.074 [2024-11-29 09:50:49.657126] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.074 [2024-11-29 09:50:49.657443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.074 [2024-11-29 09:50:49.657580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.074 [2024-11-29 09:50:49.657609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.074 [2024-11-29 09:50:49.657626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.074 [2024-11-29 09:50:49.657737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.074 [2024-11-29 09:50:49.657906] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.074 [2024-11-29 09:50:49.657930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.074 [2024-11-29 09:50:49.657945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.074 [2024-11-29 09:50:49.660191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.074 [2024-11-29 09:50:49.669546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.074 [2024-11-29 09:50:49.669864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.074 [2024-11-29 09:50:49.670006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.670035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.075 [2024-11-29 09:50:49.670052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.075 [2024-11-29 09:50:49.670162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.075 [2024-11-29 09:50:49.670349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.075 [2024-11-29 09:50:49.670372] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.075 [2024-11-29 09:50:49.670387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.075 [2024-11-29 09:50:49.672790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.075 [2024-11-29 09:50:49.681999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.075 [2024-11-29 09:50:49.682290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.682453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.682483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.075 [2024-11-29 09:50:49.682500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.075 [2024-11-29 09:50:49.682701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.075 [2024-11-29 09:50:49.682853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.075 [2024-11-29 09:50:49.682877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.075 [2024-11-29 09:50:49.682891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.075 [2024-11-29 09:50:49.685233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.075 [2024-11-29 09:50:49.694738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.075 [2024-11-29 09:50:49.695044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.695185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.695213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.075 [2024-11-29 09:50:49.695231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.075 [2024-11-29 09:50:49.695359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.075 [2024-11-29 09:50:49.695556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.075 [2024-11-29 09:50:49.695581] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.075 [2024-11-29 09:50:49.695595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.075 [2024-11-29 09:50:49.697917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.075 [2024-11-29 09:50:49.707445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.075 [2024-11-29 09:50:49.707789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.707902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.707933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.075 [2024-11-29 09:50:49.707951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.075 [2024-11-29 09:50:49.708116] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.075 [2024-11-29 09:50:49.708286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.075 [2024-11-29 09:50:49.708309] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.075 [2024-11-29 09:50:49.708324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.075 [2024-11-29 09:50:49.710603] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.075 [2024-11-29 09:50:49.719901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.075 [2024-11-29 09:50:49.720238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.720422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.720449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.075 [2024-11-29 09:50:49.720465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.075 [2024-11-29 09:50:49.720614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.075 [2024-11-29 09:50:49.720800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.075 [2024-11-29 09:50:49.720823] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.075 [2024-11-29 09:50:49.720838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.075 [2024-11-29 09:50:49.722909] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.075 [2024-11-29 09:50:49.732558] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.075 [2024-11-29 09:50:49.732885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.733067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.733093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.075 [2024-11-29 09:50:49.733109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.075 [2024-11-29 09:50:49.733256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.075 [2024-11-29 09:50:49.733478] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.075 [2024-11-29 09:50:49.733503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.075 [2024-11-29 09:50:49.733519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.075 [2024-11-29 09:50:49.735858] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.075 [2024-11-29 09:50:49.744935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.075 [2024-11-29 09:50:49.745281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.745436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.745467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.075 [2024-11-29 09:50:49.745484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.075 [2024-11-29 09:50:49.745649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.075 [2024-11-29 09:50:49.745819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.075 [2024-11-29 09:50:49.745842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.075 [2024-11-29 09:50:49.745857] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.075 [2024-11-29 09:50:49.748321] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.075 [2024-11-29 09:50:49.757239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.075 [2024-11-29 09:50:49.757583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.757722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.075 [2024-11-29 09:50:49.757751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.075 [2024-11-29 09:50:49.757774] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.075 [2024-11-29 09:50:49.757922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.075 [2024-11-29 09:50:49.758073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.075 [2024-11-29 09:50:49.758097] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.075 [2024-11-29 09:50:49.758111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.075 [2024-11-29 09:50:49.760459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.075 [2024-11-29 09:50:49.769804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.075 [2024-11-29 09:50:49.770165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.770281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.770310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-29 09:50:49.770327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.076 [2024-11-29 09:50:49.770486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.076 [2024-11-29 09:50:49.770675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-29 09:50:49.770698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-29 09:50:49.770713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-29 09:50:49.773233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-29 09:50:49.782512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-29 09:50:49.782838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.782951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.782980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-29 09:50:49.782997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.076 [2024-11-29 09:50:49.783161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.076 [2024-11-29 09:50:49.783295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-29 09:50:49.783318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-29 09:50:49.783333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-29 09:50:49.785779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-29 09:50:49.795027] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-29 09:50:49.795333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.795483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.795512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-29 09:50:49.795530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.076 [2024-11-29 09:50:49.795666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.076 [2024-11-29 09:50:49.795817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-29 09:50:49.795840] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-29 09:50:49.795855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-29 09:50:49.798268] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-29 09:50:49.807629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-29 09:50:49.807941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.808094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.808122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-29 09:50:49.808139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.076 [2024-11-29 09:50:49.808322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.076 [2024-11-29 09:50:49.808556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-29 09:50:49.808580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-29 09:50:49.808595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-29 09:50:49.810844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-29 09:50:49.820165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-29 09:50:49.820531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.820670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.820698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-29 09:50:49.820715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.076 [2024-11-29 09:50:49.820862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.076 [2024-11-29 09:50:49.821013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-29 09:50:49.821036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-29 09:50:49.821051] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-29 09:50:49.823219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-29 09:50:49.832898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-29 09:50:49.833241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.833474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.833503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-29 09:50:49.833520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.076 [2024-11-29 09:50:49.833703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.076 [2024-11-29 09:50:49.833860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-29 09:50:49.833884] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-29 09:50:49.833899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-29 09:50:49.836166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-29 09:50:49.845662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-29 09:50:49.845983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.846124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.846149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.076 [2024-11-29 09:50:49.846164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.076 [2024-11-29 09:50:49.846342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.076 [2024-11-29 09:50:49.846555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.076 [2024-11-29 09:50:49.846580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.076 [2024-11-29 09:50:49.846595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.076 [2024-11-29 09:50:49.849009] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.076 [2024-11-29 09:50:49.858126] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.076 [2024-11-29 09:50:49.858439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.076 [2024-11-29 09:50:49.858703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-29 09:50:49.858751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.077 [2024-11-29 09:50:49.858768] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.077 [2024-11-29 09:50:49.858898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.077 [2024-11-29 09:50:49.859103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.077 [2024-11-29 09:50:49.859126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.077 [2024-11-29 09:50:49.859141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.077 [2024-11-29 09:50:49.861507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.077 [2024-11-29 09:50:49.870897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.077 [2024-11-29 09:50:49.871199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-29 09:50:49.871363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-29 09:50:49.871401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.077 [2024-11-29 09:50:49.871421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.077 [2024-11-29 09:50:49.871623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.077 [2024-11-29 09:50:49.871774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.077 [2024-11-29 09:50:49.871803] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.077 [2024-11-29 09:50:49.871819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.077 [2024-11-29 09:50:49.874198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.077 [2024-11-29 09:50:49.883435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.077 [2024-11-29 09:50:49.883742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-29 09:50:49.883938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-29 09:50:49.883985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.077 [2024-11-29 09:50:49.884003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.077 [2024-11-29 09:50:49.884185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.077 [2024-11-29 09:50:49.884300] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.077 [2024-11-29 09:50:49.884323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.077 [2024-11-29 09:50:49.884338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.077 [2024-11-29 09:50:49.886706] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.077 [2024-11-29 09:50:49.896019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.077 [2024-11-29 09:50:49.896343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-29 09:50:49.896499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-29 09:50:49.896525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.077 [2024-11-29 09:50:49.896541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.077 [2024-11-29 09:50:49.896674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.077 [2024-11-29 09:50:49.896837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.077 [2024-11-29 09:50:49.896859] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.077 [2024-11-29 09:50:49.896874] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.077 [2024-11-29 09:50:49.899163] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.077 [2024-11-29 09:50:49.908540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.077 [2024-11-29 09:50:49.908898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-29 09:50:49.909108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.077 [2024-11-29 09:50:49.909136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.077 [2024-11-29 09:50:49.909154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.077 [2024-11-29 09:50:49.909318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.077 [2024-11-29 09:50:49.909482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.077 [2024-11-29 09:50:49.909506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.077 [2024-11-29 09:50:49.909527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.077 [2024-11-29 09:50:49.911856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.337 [2024-11-29 09:50:49.921285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.337 [2024-11-29 09:50:49.921578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.337 [2024-11-29 09:50:49.921751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.337 [2024-11-29 09:50:49.921803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.337 [2024-11-29 09:50:49.921820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.337 [2024-11-29 09:50:49.921984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.337 [2024-11-29 09:50:49.922136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.337 [2024-11-29 09:50:49.922158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.337 [2024-11-29 09:50:49.922173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.337 [2024-11-29 09:50:49.924640] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.337 [2024-11-29 09:50:49.933668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.337 [2024-11-29 09:50:49.934070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.337 [2024-11-29 09:50:49.934238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.337 [2024-11-29 09:50:49.934267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.337 [2024-11-29 09:50:49.934285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.337 [2024-11-29 09:50:49.934478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.337 [2024-11-29 09:50:49.934631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.337 [2024-11-29 09:50:49.934654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.337 [2024-11-29 09:50:49.934669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.337 [2024-11-29 09:50:49.936974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.337 [2024-11-29 09:50:49.946236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.337 [2024-11-29 09:50:49.946560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.337 [2024-11-29 09:50:49.946762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.337 [2024-11-29 09:50:49.946814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.337 [2024-11-29 09:50:49.946831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.337 [2024-11-29 09:50:49.946960] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.337 [2024-11-29 09:50:49.947130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.337 [2024-11-29 09:50:49.947152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.337 [2024-11-29 09:50:49.947168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.337 [2024-11-29 09:50:49.949526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.337 [2024-11-29 09:50:49.958962] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.337 [2024-11-29 09:50:49.959223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.337 [2024-11-29 09:50:49.959402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.337 [2024-11-29 09:50:49.959431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.337 [2024-11-29 09:50:49.959449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.337 [2024-11-29 09:50:49.959613] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.337 [2024-11-29 09:50:49.959783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.337 [2024-11-29 09:50:49.959806] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.337 [2024-11-29 09:50:49.959821] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.337 [2024-11-29 09:50:49.962116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.337 [2024-11-29 09:50:49.971417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.337 [2024-11-29 09:50:49.971765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:49.971906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:49.971935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-29 09:50:49.971952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.338 [2024-11-29 09:50:49.972080] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.338 [2024-11-29 09:50:49.972249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-29 09:50:49.972272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-29 09:50:49.972287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-29 09:50:49.974555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-29 09:50:49.984066] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-29 09:50:49.984351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:49.984480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:49.984509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-29 09:50:49.984526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.338 [2024-11-29 09:50:49.984709] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.338 [2024-11-29 09:50:49.984896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-29 09:50:49.984919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-29 09:50:49.984934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-29 09:50:49.987296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-29 09:50:49.996685] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-29 09:50:49.997032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:49.997203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:49.997231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-29 09:50:49.997248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.338 [2024-11-29 09:50:49.997442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.338 [2024-11-29 09:50:49.997577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-29 09:50:49.997600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-29 09:50:49.997615] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-29 09:50:50.000013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-29 09:50:50.009285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-29 09:50:50.009588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:50.009704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:50.009760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-29 09:50:50.009780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.338 [2024-11-29 09:50:50.009947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.338 [2024-11-29 09:50:50.010100] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-29 09:50:50.010124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-29 09:50:50.010140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-29 09:50:50.012338] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-29 09:50:50.022045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-29 09:50:50.022370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:50.022514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:50.022542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-29 09:50:50.022559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.338 [2024-11-29 09:50:50.022724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.338 [2024-11-29 09:50:50.022923] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-29 09:50:50.022948] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-29 09:50:50.022964] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-29 09:50:50.024970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-29 09:50:50.034725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-29 09:50:50.035067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:50.035236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:50.035265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-29 09:50:50.035284] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.338 [2024-11-29 09:50:50.035445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.338 [2024-11-29 09:50:50.035652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-29 09:50:50.035676] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-29 09:50:50.035692] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-29 09:50:50.037926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-29 09:50:50.047405] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-29 09:50:50.047725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:50.047867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:50.047896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-29 09:50:50.047914] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.338 [2024-11-29 09:50:50.048080] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.338 [2024-11-29 09:50:50.048268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-29 09:50:50.048291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-29 09:50:50.048306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-29 09:50:50.050675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-29 09:50:50.059922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-29 09:50:50.060191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:50.060325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:50.060354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-29 09:50:50.060372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.338 [2024-11-29 09:50:50.060569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.338 [2024-11-29 09:50:50.060672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-29 09:50:50.060694] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-29 09:50:50.060709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-29 09:50:50.063093] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-29 09:50:50.072432] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-29 09:50:50.072690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:50.072859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:50.072894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-29 09:50:50.072913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.338 [2024-11-29 09:50:50.073079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.338 [2024-11-29 09:50:50.073266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.338 [2024-11-29 09:50:50.073290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.338 [2024-11-29 09:50:50.073305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.338 [2024-11-29 09:50:50.075781] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.338 [2024-11-29 09:50:50.084919] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.338 [2024-11-29 09:50:50.085212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:50.085357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.338 [2024-11-29 09:50:50.085385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.338 [2024-11-29 09:50:50.085412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.338 [2024-11-29 09:50:50.085632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.339 [2024-11-29 09:50:50.085819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-29 09:50:50.085842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-29 09:50:50.085858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-29 09:50:50.088145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-29 09:50:50.097345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-29 09:50:50.097688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-29 09:50:50.097831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-29 09:50:50.097859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-29 09:50:50.097876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.339 [2024-11-29 09:50:50.098058] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.339 [2024-11-29 09:50:50.098192] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-29 09:50:50.098215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-29 09:50:50.098230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-29 09:50:50.100816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-29 09:50:50.109853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-29 09:50:50.110159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-29 09:50:50.110302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-29 09:50:50.110331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-29 09:50:50.110354] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.339 [2024-11-29 09:50:50.110517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.339 [2024-11-29 09:50:50.110688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-29 09:50:50.110711] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-29 09:50:50.110726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-29 09:50:50.113121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-29 09:50:50.122744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-29 09:50:50.123093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-29 09:50:50.123237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-29 09:50:50.123266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-29 09:50:50.123283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.339 [2024-11-29 09:50:50.123461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.339 [2024-11-29 09:50:50.123614] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-29 09:50:50.123637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-29 09:50:50.123652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-29 09:50:50.125903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-29 09:50:50.135325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-29 09:50:50.135695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-29 09:50:50.135821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-29 09:50:50.135864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-29 09:50:50.135882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.339 [2024-11-29 09:50:50.136028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.339 [2024-11-29 09:50:50.136197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-29 09:50:50.136221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-29 09:50:50.136236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-29 09:50:50.138443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-29 09:50:50.147837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-29 09:50:50.148143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-29 09:50:50.148298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-29 09:50:50.148329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-29 09:50:50.148353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.339 [2024-11-29 09:50:50.148535] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.339 [2024-11-29 09:50:50.148706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-29 09:50:50.148729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-29 09:50:50.148744] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-29 09:50:50.151124] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-29 09:50:50.160331] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-29 09:50:50.160655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-29 09:50:50.160806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-29 09:50:50.160834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-29 09:50:50.160851] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.339 [2024-11-29 09:50:50.160998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.339 [2024-11-29 09:50:50.161186] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-29 09:50:50.161210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-29 09:50:50.161225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-29 09:50:50.163523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.339 [2024-11-29 09:50:50.172926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.339 [2024-11-29 09:50:50.173257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-29 09:50:50.173408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.339 [2024-11-29 09:50:50.173435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.339 [2024-11-29 09:50:50.173450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.339 [2024-11-29 09:50:50.173607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.339 [2024-11-29 09:50:50.173777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.339 [2024-11-29 09:50:50.173800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.339 [2024-11-29 09:50:50.173815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.339 [2024-11-29 09:50:50.176141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.599 [2024-11-29 09:50:50.185522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.599 [2024-11-29 09:50:50.185851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.185976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.186004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.600 [2024-11-29 09:50:50.186021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.600 [2024-11-29 09:50:50.186204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.600 [2024-11-29 09:50:50.186362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.600 [2024-11-29 09:50:50.186385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.600 [2024-11-29 09:50:50.186412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.600 [2024-11-29 09:50:50.188862] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.600 [2024-11-29 09:50:50.198110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.600 [2024-11-29 09:50:50.198452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.198589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.198619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.600 [2024-11-29 09:50:50.198636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.600 [2024-11-29 09:50:50.198748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.600 [2024-11-29 09:50:50.198917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.600 [2024-11-29 09:50:50.198941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.600 [2024-11-29 09:50:50.198956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.600 [2024-11-29 09:50:50.201247] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.600 [2024-11-29 09:50:50.210660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.600 [2024-11-29 09:50:50.210937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.211078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.211106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.600 [2024-11-29 09:50:50.211123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.600 [2024-11-29 09:50:50.211288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.600 [2024-11-29 09:50:50.211525] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.600 [2024-11-29 09:50:50.211550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.600 [2024-11-29 09:50:50.211566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.600 [2024-11-29 09:50:50.213750] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.600 [2024-11-29 09:50:50.223339] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.600 [2024-11-29 09:50:50.223654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.223797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.223825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.600 [2024-11-29 09:50:50.223842] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.600 [2024-11-29 09:50:50.224006] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.600 [2024-11-29 09:50:50.224140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.600 [2024-11-29 09:50:50.224168] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.600 [2024-11-29 09:50:50.224185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.600 [2024-11-29 09:50:50.226445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.600 [2024-11-29 09:50:50.235947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.600 [2024-11-29 09:50:50.236224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.236357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.236386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.600 [2024-11-29 09:50:50.236412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.600 [2024-11-29 09:50:50.236560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.600 [2024-11-29 09:50:50.236711] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.600 [2024-11-29 09:50:50.236734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.600 [2024-11-29 09:50:50.236750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.600 [2024-11-29 09:50:50.238997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.600 [2024-11-29 09:50:50.248680] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.600 [2024-11-29 09:50:50.248991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.249106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.249149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.600 [2024-11-29 09:50:50.249165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.600 [2024-11-29 09:50:50.249281] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.600 [2024-11-29 09:50:50.249472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.600 [2024-11-29 09:50:50.249497] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.600 [2024-11-29 09:50:50.249512] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.600 [2024-11-29 09:50:50.251767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.600 [2024-11-29 09:50:50.261269] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.600 [2024-11-29 09:50:50.261540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.261662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.261690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.600 [2024-11-29 09:50:50.261707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.600 [2024-11-29 09:50:50.261854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.600 [2024-11-29 09:50:50.262041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.600 [2024-11-29 09:50:50.262065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.600 [2024-11-29 09:50:50.262085] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.600 [2024-11-29 09:50:50.264400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.600 [2024-11-29 09:50:50.273807] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.600 [2024-11-29 09:50:50.274110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.274243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.274273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.600 [2024-11-29 09:50:50.274291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.600 [2024-11-29 09:50:50.274415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.600 [2024-11-29 09:50:50.274587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.600 [2024-11-29 09:50:50.274610] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.600 [2024-11-29 09:50:50.274625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.600 [2024-11-29 09:50:50.277092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.600 [2024-11-29 09:50:50.286346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.600 [2024-11-29 09:50:50.286630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.286760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.286789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.600 [2024-11-29 09:50:50.286806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.600 [2024-11-29 09:50:50.286953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.600 [2024-11-29 09:50:50.287104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.600 [2024-11-29 09:50:50.287128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.600 [2024-11-29 09:50:50.287143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.600 [2024-11-29 09:50:50.289344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.600 [2024-11-29 09:50:50.299066] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.600 [2024-11-29 09:50:50.299323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.299492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.600 [2024-11-29 09:50:50.299522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.601 [2024-11-29 09:50:50.299539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.601 [2024-11-29 09:50:50.299687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.601 [2024-11-29 09:50:50.299874] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.601 [2024-11-29 09:50:50.299898] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.601 [2024-11-29 09:50:50.299913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.601 [2024-11-29 09:50:50.302344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.601 [2024-11-29 09:50:50.311745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.601 [2024-11-29 09:50:50.312026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.312141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.312171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.601 [2024-11-29 09:50:50.312189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.601 [2024-11-29 09:50:50.312372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.601 [2024-11-29 09:50:50.312518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.601 [2024-11-29 09:50:50.312541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.601 [2024-11-29 09:50:50.312556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.601 [2024-11-29 09:50:50.315077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.601 [2024-11-29 09:50:50.324403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.601 [2024-11-29 09:50:50.324730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.324892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.324921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.601 [2024-11-29 09:50:50.324938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.601 [2024-11-29 09:50:50.325103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.601 [2024-11-29 09:50:50.325236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.601 [2024-11-29 09:50:50.325259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.601 [2024-11-29 09:50:50.325273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.601 [2024-11-29 09:50:50.327589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.601 [2024-11-29 09:50:50.337017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.601 [2024-11-29 09:50:50.337373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.337555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.337581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.601 [2024-11-29 09:50:50.337596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.601 [2024-11-29 09:50:50.337828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.601 [2024-11-29 09:50:50.337980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.601 [2024-11-29 09:50:50.338003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.601 [2024-11-29 09:50:50.338018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.601 [2024-11-29 09:50:50.340306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.601 [2024-11-29 09:50:50.349739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.601 [2024-11-29 09:50:50.350060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.350222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.350250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.601 [2024-11-29 09:50:50.350268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.601 [2024-11-29 09:50:50.350446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.601 [2024-11-29 09:50:50.350599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.601 [2024-11-29 09:50:50.350622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.601 [2024-11-29 09:50:50.350637] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.601 [2024-11-29 09:50:50.352902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.601 [2024-11-29 09:50:50.362329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.601 [2024-11-29 09:50:50.362680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.362819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.362847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.601 [2024-11-29 09:50:50.362865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.601 [2024-11-29 09:50:50.363048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.601 [2024-11-29 09:50:50.363200] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.601 [2024-11-29 09:50:50.363222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.601 [2024-11-29 09:50:50.363237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.601 [2024-11-29 09:50:50.365565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.601 [2024-11-29 09:50:50.374780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.601 [2024-11-29 09:50:50.375079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.375241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.375270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.601 [2024-11-29 09:50:50.375287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.601 [2024-11-29 09:50:50.375499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.601 [2024-11-29 09:50:50.375723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.601 [2024-11-29 09:50:50.375746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.601 [2024-11-29 09:50:50.375761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.601 [2024-11-29 09:50:50.377940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.601 [2024-11-29 09:50:50.387343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.601 [2024-11-29 09:50:50.387679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.387815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.387843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.601 [2024-11-29 09:50:50.387860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.601 [2024-11-29 09:50:50.388061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.601 [2024-11-29 09:50:50.388195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.601 [2024-11-29 09:50:50.388218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.601 [2024-11-29 09:50:50.388232] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.601 [2024-11-29 09:50:50.390358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.601 [2024-11-29 09:50:50.399935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.601 [2024-11-29 09:50:50.400211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.400364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.400401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.601 [2024-11-29 09:50:50.400420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.601 [2024-11-29 09:50:50.400604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.601 [2024-11-29 09:50:50.400773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.601 [2024-11-29 09:50:50.400796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.601 [2024-11-29 09:50:50.400810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.601 [2024-11-29 09:50:50.403255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.601 [2024-11-29 09:50:50.412462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.601 [2024-11-29 09:50:50.412761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.412923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.601 [2024-11-29 09:50:50.412952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.601 [2024-11-29 09:50:50.412969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.601 [2024-11-29 09:50:50.413116] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.601 [2024-11-29 09:50:50.413303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.602 [2024-11-29 09:50:50.413326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.602 [2024-11-29 09:50:50.413341] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.602 [2024-11-29 09:50:50.415599] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.602 [2024-11-29 09:50:50.425026] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.602 [2024-11-29 09:50:50.425340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-29 09:50:50.425464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-29 09:50:50.425494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.602 [2024-11-29 09:50:50.425517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.602 [2024-11-29 09:50:50.425701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.602 [2024-11-29 09:50:50.425852] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.602 [2024-11-29 09:50:50.425874] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.602 [2024-11-29 09:50:50.425889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.602 [2024-11-29 09:50:50.428175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.602 [2024-11-29 09:50:50.437911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.602 [2024-11-29 09:50:50.438249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-29 09:50:50.438400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.602 [2024-11-29 09:50:50.438430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.602 [2024-11-29 09:50:50.438448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.602 [2024-11-29 09:50:50.438612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.602 [2024-11-29 09:50:50.438799] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.602 [2024-11-29 09:50:50.438822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.602 [2024-11-29 09:50:50.438837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.861 [2024-11-29 09:50:50.441088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.861 [2024-11-29 09:50:50.450569] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.861 [2024-11-29 09:50:50.450876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-29 09:50:50.451050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-29 09:50:50.451075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.861 [2024-11-29 09:50:50.451090] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.861 [2024-11-29 09:50:50.451285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.861 [2024-11-29 09:50:50.451465] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.861 [2024-11-29 09:50:50.451489] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.861 [2024-11-29 09:50:50.451504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.861 [2024-11-29 09:50:50.453931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.861 [2024-11-29 09:50:50.463310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.861 [2024-11-29 09:50:50.463650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-29 09:50:50.463752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-29 09:50:50.463780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.861 [2024-11-29 09:50:50.463798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.861 [2024-11-29 09:50:50.463969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.861 [2024-11-29 09:50:50.464121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.861 [2024-11-29 09:50:50.464144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.861 [2024-11-29 09:50:50.464159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.861 [2024-11-29 09:50:50.466469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.861 [2024-11-29 09:50:50.475963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.861 [2024-11-29 09:50:50.476300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-29 09:50:50.476434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-29 09:50:50.476461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.861 [2024-11-29 09:50:50.476476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.861 [2024-11-29 09:50:50.476648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.861 [2024-11-29 09:50:50.476836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.861 [2024-11-29 09:50:50.476858] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.861 [2024-11-29 09:50:50.476874] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.861 [2024-11-29 09:50:50.479155] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.861 [2024-11-29 09:50:50.488683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.861 [2024-11-29 09:50:50.488979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-29 09:50:50.489141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-29 09:50:50.489170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.861 [2024-11-29 09:50:50.489188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.861 [2024-11-29 09:50:50.489334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.861 [2024-11-29 09:50:50.489477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.861 [2024-11-29 09:50:50.489501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.861 [2024-11-29 09:50:50.489516] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.861 [2024-11-29 09:50:50.491752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.861 [2024-11-29 09:50:50.501451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.861 [2024-11-29 09:50:50.501772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-29 09:50:50.501913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-29 09:50:50.501941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.861 [2024-11-29 09:50:50.501958] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.861 [2024-11-29 09:50:50.502141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.861 [2024-11-29 09:50:50.502317] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.861 [2024-11-29 09:50:50.502340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.861 [2024-11-29 09:50:50.502356] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.861 [2024-11-29 09:50:50.504687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.861 [2024-11-29 09:50:50.514259] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.861 [2024-11-29 09:50:50.514618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-29 09:50:50.514748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.861 [2024-11-29 09:50:50.514773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.861 [2024-11-29 09:50:50.514788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.861 [2024-11-29 09:50:50.514984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.861 [2024-11-29 09:50:50.515208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.861 [2024-11-29 09:50:50.515231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.861 [2024-11-29 09:50:50.515246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.861 [2024-11-29 09:50:50.517648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.862 [2024-11-29 09:50:50.526872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.862 [2024-11-29 09:50:50.527214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.527357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.527385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.862 [2024-11-29 09:50:50.527412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.862 [2024-11-29 09:50:50.527561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.862 [2024-11-29 09:50:50.527730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.862 [2024-11-29 09:50:50.527753] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.862 [2024-11-29 09:50:50.527768] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.862 [2024-11-29 09:50:50.529927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.862 [2024-11-29 09:50:50.539495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.862 [2024-11-29 09:50:50.539852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.539997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.540026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.862 [2024-11-29 09:50:50.540043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.862 [2024-11-29 09:50:50.540244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.862 [2024-11-29 09:50:50.540423] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.862 [2024-11-29 09:50:50.540454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.862 [2024-11-29 09:50:50.540469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.862 [2024-11-29 09:50:50.542811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.862 [2024-11-29 09:50:50.552108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.862 [2024-11-29 09:50:50.552415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.552553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.552583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.862 [2024-11-29 09:50:50.552601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.862 [2024-11-29 09:50:50.552747] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.862 [2024-11-29 09:50:50.552881] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.862 [2024-11-29 09:50:50.552904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.862 [2024-11-29 09:50:50.552918] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.862 [2024-11-29 09:50:50.555351] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.862 [2024-11-29 09:50:50.564690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.862 [2024-11-29 09:50:50.565022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.565163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.565191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.862 [2024-11-29 09:50:50.565209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.862 [2024-11-29 09:50:50.565421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.862 [2024-11-29 09:50:50.565628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.862 [2024-11-29 09:50:50.565651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.862 [2024-11-29 09:50:50.565666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.862 [2024-11-29 09:50:50.567755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.862 [2024-11-29 09:50:50.577192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.862 [2024-11-29 09:50:50.577480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.577594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.577624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.862 [2024-11-29 09:50:50.577641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.862 [2024-11-29 09:50:50.577806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.862 [2024-11-29 09:50:50.577994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.862 [2024-11-29 09:50:50.578017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.862 [2024-11-29 09:50:50.578038] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.862 [2024-11-29 09:50:50.580460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.862 [2024-11-29 09:50:50.589801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.862 [2024-11-29 09:50:50.590139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.590305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.590333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.862 [2024-11-29 09:50:50.590351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.862 [2024-11-29 09:50:50.590490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.862 [2024-11-29 09:50:50.590678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.862 [2024-11-29 09:50:50.590701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.862 [2024-11-29 09:50:50.590716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.862 [2024-11-29 09:50:50.593236] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.862 [2024-11-29 09:50:50.602509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.862 [2024-11-29 09:50:50.602763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.602900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.602928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.862 [2024-11-29 09:50:50.602946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.862 [2024-11-29 09:50:50.603093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.862 [2024-11-29 09:50:50.603299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.862 [2024-11-29 09:50:50.603322] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.862 [2024-11-29 09:50:50.603336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.862 [2024-11-29 09:50:50.605371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.862 [2024-11-29 09:50:50.615156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.862 [2024-11-29 09:50:50.615452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.615627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.862 [2024-11-29 09:50:50.615653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.862 [2024-11-29 09:50:50.615669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.862 [2024-11-29 09:50:50.615801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.862 [2024-11-29 09:50:50.615977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.863 [2024-11-29 09:50:50.616000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.863 [2024-11-29 09:50:50.616015] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.863 [2024-11-29 09:50:50.618310] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.863 [2024-11-29 09:50:50.627564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.863 [2024-11-29 09:50:50.627862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-29 09:50:50.628027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-29 09:50:50.628056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.863 [2024-11-29 09:50:50.628073] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.863 [2024-11-29 09:50:50.628292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.863 [2024-11-29 09:50:50.628509] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.863 [2024-11-29 09:50:50.628533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.863 [2024-11-29 09:50:50.628548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.863 [2024-11-29 09:50:50.631013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.863 [2024-11-29 09:50:50.640193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.863 [2024-11-29 09:50:50.640521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-29 09:50:50.640669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-29 09:50:50.640695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.863 [2024-11-29 09:50:50.640711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.863 [2024-11-29 09:50:50.640826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.863 [2024-11-29 09:50:50.641051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.863 [2024-11-29 09:50:50.641074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.863 [2024-11-29 09:50:50.641089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.863 [2024-11-29 09:50:50.643403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.863 [2024-11-29 09:50:50.652679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.863 [2024-11-29 09:50:50.652985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-29 09:50:50.653124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-29 09:50:50.653152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.863 [2024-11-29 09:50:50.653170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.863 [2024-11-29 09:50:50.653317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.863 [2024-11-29 09:50:50.653533] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.863 [2024-11-29 09:50:50.653557] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.863 [2024-11-29 09:50:50.653572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.863 [2024-11-29 09:50:50.655751] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.863 [2024-11-29 09:50:50.665119] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.863 [2024-11-29 09:50:50.665408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-29 09:50:50.665545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-29 09:50:50.665574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.863 [2024-11-29 09:50:50.665592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.863 [2024-11-29 09:50:50.665774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.863 [2024-11-29 09:50:50.665926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.863 [2024-11-29 09:50:50.665949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.863 [2024-11-29 09:50:50.665963] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.863 [2024-11-29 09:50:50.668249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.863 [2024-11-29 09:50:50.677791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.863 [2024-11-29 09:50:50.678113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-29 09:50:50.678272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-29 09:50:50.678300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.863 [2024-11-29 09:50:50.678318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.863 [2024-11-29 09:50:50.678496] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.863 [2024-11-29 09:50:50.678649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.863 [2024-11-29 09:50:50.678671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.863 [2024-11-29 09:50:50.678686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.863 [2024-11-29 09:50:50.681154] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.863 [2024-11-29 09:50:50.690361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.863 [2024-11-29 09:50:50.690643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-29 09:50:50.690815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.863 [2024-11-29 09:50:50.690843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:27.863 [2024-11-29 09:50:50.690860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:27.863 [2024-11-29 09:50:50.691079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:27.863 [2024-11-29 09:50:50.691266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.863 [2024-11-29 09:50:50.691290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.863 [2024-11-29 09:50:50.691305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.863 [2024-11-29 09:50:50.693458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.123 [2024-11-29 09:50:50.702843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.123 [2024-11-29 09:50:50.703145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.123 [2024-11-29 09:50:50.703250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.123 [2024-11-29 09:50:50.703275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.123 [2024-11-29 09:50:50.703291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.123 [2024-11-29 09:50:50.703482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.123 [2024-11-29 09:50:50.703670] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.123 [2024-11-29 09:50:50.703693] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.123 [2024-11-29 09:50:50.703708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.123 [2024-11-29 09:50:50.706228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.123 [2024-11-29 09:50:50.715251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.123 [2024-11-29 09:50:50.715536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.123 [2024-11-29 09:50:50.715664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.123 [2024-11-29 09:50:50.715691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.123 [2024-11-29 09:50:50.715707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.123 [2024-11-29 09:50:50.715861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.123 [2024-11-29 09:50:50.716019] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.123 [2024-11-29 09:50:50.716040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.123 [2024-11-29 09:50:50.716054] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.123 [2024-11-29 09:50:50.718492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.123 [2024-11-29 09:50:50.727631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.123 [2024-11-29 09:50:50.727912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.123 [2024-11-29 09:50:50.728043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.123 [2024-11-29 09:50:50.728068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.123 [2024-11-29 09:50:50.728083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.123 [2024-11-29 09:50:50.728263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.123 [2024-11-29 09:50:50.728450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.123 [2024-11-29 09:50:50.728471] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.123 [2024-11-29 09:50:50.728485] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.123 [2024-11-29 09:50:50.730429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.123 [2024-11-29 09:50:50.740163] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.123 [2024-11-29 09:50:50.740454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.123 [2024-11-29 09:50:50.740585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.123 [2024-11-29 09:50:50.740615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.123 [2024-11-29 09:50:50.740632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.123 [2024-11-29 09:50:50.740789] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.123 [2024-11-29 09:50:50.740977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.123 [2024-11-29 09:50:50.741000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.123 [2024-11-29 09:50:50.741015] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.123 [2024-11-29 09:50:50.743230] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.123 [2024-11-29 09:50:50.752963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.123 [2024-11-29 09:50:50.753276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.123 [2024-11-29 09:50:50.753438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.123 [2024-11-29 09:50:50.753463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.123 [2024-11-29 09:50:50.753495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.123 [2024-11-29 09:50:50.753645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.123 [2024-11-29 09:50:50.753787] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.123 [2024-11-29 09:50:50.753826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.123 [2024-11-29 09:50:50.753841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.124 [2024-11-29 09:50:50.756290] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.124 [2024-11-29 09:50:50.765612] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.124 [2024-11-29 09:50:50.765973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.766119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.766145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.124 [2024-11-29 09:50:50.766160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.124 [2024-11-29 09:50:50.766326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.124 [2024-11-29 09:50:50.766566] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.124 [2024-11-29 09:50:50.766591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.124 [2024-11-29 09:50:50.766606] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.124 [2024-11-29 09:50:50.768852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.124 [2024-11-29 09:50:50.778277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.124 [2024-11-29 09:50:50.778611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.778740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.778768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.124 [2024-11-29 09:50:50.778791] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.124 [2024-11-29 09:50:50.778974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.124 [2024-11-29 09:50:50.779197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.124 [2024-11-29 09:50:50.779220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.124 [2024-11-29 09:50:50.779235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.124 [2024-11-29 09:50:50.781753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.124 [2024-11-29 09:50:50.791038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.124 [2024-11-29 09:50:50.791364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.791483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.791509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.124 [2024-11-29 09:50:50.791525] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.124 [2024-11-29 09:50:50.791674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.124 [2024-11-29 09:50:50.791860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.124 [2024-11-29 09:50:50.791884] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.124 [2024-11-29 09:50:50.791898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.124 [2024-11-29 09:50:50.794409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.124 [2024-11-29 09:50:50.803769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.124 [2024-11-29 09:50:50.804107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.804243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.804270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.124 [2024-11-29 09:50:50.804286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.124 [2024-11-29 09:50:50.804469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.124 [2024-11-29 09:50:50.804655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.124 [2024-11-29 09:50:50.804691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.124 [2024-11-29 09:50:50.804706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.124 [2024-11-29 09:50:50.806950] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.124 [2024-11-29 09:50:50.816511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.124 [2024-11-29 09:50:50.816825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.816967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.816996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.124 [2024-11-29 09:50:50.817013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.124 [2024-11-29 09:50:50.817208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.124 [2024-11-29 09:50:50.817342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.124 [2024-11-29 09:50:50.817365] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.124 [2024-11-29 09:50:50.817380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.124 [2024-11-29 09:50:50.819950] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.124 [2024-11-29 09:50:50.829087] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.124 [2024-11-29 09:50:50.829365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.829501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.829527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.124 [2024-11-29 09:50:50.829543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.124 [2024-11-29 09:50:50.829710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.124 [2024-11-29 09:50:50.829863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.124 [2024-11-29 09:50:50.829885] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.124 [2024-11-29 09:50:50.829900] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.124 [2024-11-29 09:50:50.832538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.124 [2024-11-29 09:50:50.841778] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.124 [2024-11-29 09:50:50.842061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.842240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.842266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.124 [2024-11-29 09:50:50.842281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.124 [2024-11-29 09:50:50.842468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.124 [2024-11-29 09:50:50.842667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.124 [2024-11-29 09:50:50.842691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.124 [2024-11-29 09:50:50.842706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.124 [2024-11-29 09:50:50.845027] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.124 [2024-11-29 09:50:50.854319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.124 [2024-11-29 09:50:50.854643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.854805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.854831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.124 [2024-11-29 09:50:50.854846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.124 [2024-11-29 09:50:50.854990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.124 [2024-11-29 09:50:50.855183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.124 [2024-11-29 09:50:50.855207] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.124 [2024-11-29 09:50:50.855221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.124 [2024-11-29 09:50:50.857776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.124 [2024-11-29 09:50:50.867232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.124 [2024-11-29 09:50:50.867516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.867625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.867650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.124 [2024-11-29 09:50:50.867665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.124 [2024-11-29 09:50:50.867809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.124 [2024-11-29 09:50:50.867943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.124 [2024-11-29 09:50:50.867965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.124 [2024-11-29 09:50:50.867980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.124 [2024-11-29 09:50:50.870295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.124 [2024-11-29 09:50:50.879617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.124 [2024-11-29 09:50:50.879899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.124 [2024-11-29 09:50:50.880027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.125 [2024-11-29 09:50:50.880055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.125 [2024-11-29 09:50:50.880072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.125 [2024-11-29 09:50:50.880256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.125 [2024-11-29 09:50:50.880453] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.125 [2024-11-29 09:50:50.880477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.125 [2024-11-29 09:50:50.880492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.125 [2024-11-29 09:50:50.882758] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.125 [2024-11-29 09:50:50.892131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.125 [2024-11-29 09:50:50.892428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.125 [2024-11-29 09:50:50.892578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.125 [2024-11-29 09:50:50.892603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.125 [2024-11-29 09:50:50.892618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.125 [2024-11-29 09:50:50.892783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.125 [2024-11-29 09:50:50.892999] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.125 [2024-11-29 09:50:50.893031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.125 [2024-11-29 09:50:50.893047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.125 [2024-11-29 09:50:50.895613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.125 [2024-11-29 09:50:50.904748] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.125 [2024-11-29 09:50:50.905076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.125 [2024-11-29 09:50:50.905187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.125 [2024-11-29 09:50:50.905216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.125 [2024-11-29 09:50:50.905234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.125 [2024-11-29 09:50:50.905447] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.125 [2024-11-29 09:50:50.905654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.125 [2024-11-29 09:50:50.905677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.125 [2024-11-29 09:50:50.905692] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.125 [2024-11-29 09:50:50.907959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.125 [2024-11-29 09:50:50.917441] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.125 [2024-11-29 09:50:50.917715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.125 [2024-11-29 09:50:50.917880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.125 [2024-11-29 09:50:50.917908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.125 [2024-11-29 09:50:50.917925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.125 [2024-11-29 09:50:50.918108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.125 [2024-11-29 09:50:50.918259] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.125 [2024-11-29 09:50:50.918283] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.125 [2024-11-29 09:50:50.918298] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.125 [2024-11-29 09:50:50.920647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.125 [2024-11-29 09:50:50.930065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.125 [2024-11-29 09:50:50.930440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.125 [2024-11-29 09:50:50.930571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.125 [2024-11-29 09:50:50.930600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.125 [2024-11-29 09:50:50.930617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.125 [2024-11-29 09:50:50.930783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.125 [2024-11-29 09:50:50.930952] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.125 [2024-11-29 09:50:50.930975] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.125 [2024-11-29 09:50:50.930995] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.125 [2024-11-29 09:50:50.933246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.125 [2024-11-29 09:50:50.942686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.125 [2024-11-29 09:50:50.942986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.125 [2024-11-29 09:50:50.943127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.125 [2024-11-29 09:50:50.943158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.125 [2024-11-29 09:50:50.943175] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.125 [2024-11-29 09:50:50.943323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.125 [2024-11-29 09:50:50.943502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.125 [2024-11-29 09:50:50.943527] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.125 [2024-11-29 09:50:50.943542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.125 [2024-11-29 09:50:50.945793] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.125 [2024-11-29 09:50:50.955369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.125 [2024-11-29 09:50:50.955709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.125 [2024-11-29 09:50:50.955872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.125 [2024-11-29 09:50:50.955900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.125 [2024-11-29 09:50:50.955917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.125 [2024-11-29 09:50:50.956100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.125 [2024-11-29 09:50:50.956251] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.125 [2024-11-29 09:50:50.956274] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.125 [2024-11-29 09:50:50.956288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.125 [2024-11-29 09:50:50.958493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.384 [2024-11-29 09:50:50.967659] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.384 [2024-11-29 09:50:50.967952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.384 [2024-11-29 09:50:50.968095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.384 [2024-11-29 09:50:50.968122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.384 [2024-11-29 09:50:50.968138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.384 [2024-11-29 09:50:50.968259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.384 [2024-11-29 09:50:50.968437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.384 [2024-11-29 09:50:50.968461] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.384 [2024-11-29 09:50:50.968478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.384 [2024-11-29 09:50:50.970619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.384 [2024-11-29 09:50:50.980277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.384 [2024-11-29 09:50:50.980604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.384 [2024-11-29 09:50:50.980716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.384 [2024-11-29 09:50:50.980743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.384 [2024-11-29 09:50:50.980759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.384 [2024-11-29 09:50:50.980963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.384 [2024-11-29 09:50:50.981133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.384 [2024-11-29 09:50:50.981157] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.384 [2024-11-29 09:50:50.981173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.384 [2024-11-29 09:50:50.983606] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.384 [2024-11-29 09:50:50.992917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.384 [2024-11-29 09:50:50.993257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.384 [2024-11-29 09:50:50.993369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.384 [2024-11-29 09:50:50.993407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.384 [2024-11-29 09:50:50.993427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.384 [2024-11-29 09:50:50.993592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.384 [2024-11-29 09:50:50.993726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.384 [2024-11-29 09:50:50.993749] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.384 [2024-11-29 09:50:50.993764] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.384 [2024-11-29 09:50:50.996231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.384 [2024-11-29 09:50:51.005641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.384 [2024-11-29 09:50:51.005933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.384 [2024-11-29 09:50:51.006068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.384 [2024-11-29 09:50:51.006096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.384 [2024-11-29 09:50:51.006113] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.384 [2024-11-29 09:50:51.006260] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.384 [2024-11-29 09:50:51.006459] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.384 [2024-11-29 09:50:51.006484] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.384 [2024-11-29 09:50:51.006499] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.384 [2024-11-29 09:50:51.008841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.384 [2024-11-29 09:50:51.018302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.384 [2024-11-29 09:50:51.018645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.384 [2024-11-29 09:50:51.018798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.384 [2024-11-29 09:50:51.018823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.384 [2024-11-29 09:50:51.018839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.384 [2024-11-29 09:50:51.019012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.384 [2024-11-29 09:50:51.019186] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.384 [2024-11-29 09:50:51.019210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.384 [2024-11-29 09:50:51.019225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.384 [2024-11-29 09:50:51.021522] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.384 [2024-11-29 09:50:51.030787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.384 [2024-11-29 09:50:51.031087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.384 [2024-11-29 09:50:51.031248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.384 [2024-11-29 09:50:51.031276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.385 [2024-11-29 09:50:51.031293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.385 [2024-11-29 09:50:51.031506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.385 [2024-11-29 09:50:51.031640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.385 [2024-11-29 09:50:51.031664] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.385 [2024-11-29 09:50:51.031679] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.385 [2024-11-29 09:50:51.033982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.385 [2024-11-29 09:50:51.043159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.385 [2024-11-29 09:50:51.043507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.043648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.043677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.385 [2024-11-29 09:50:51.043695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.385 [2024-11-29 09:50:51.043878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.385 [2024-11-29 09:50:51.044047] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.385 [2024-11-29 09:50:51.044071] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.385 [2024-11-29 09:50:51.044086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.385 [2024-11-29 09:50:51.046454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.385 [2024-11-29 09:50:51.055703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.385 [2024-11-29 09:50:51.056036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.056205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.056234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.385 [2024-11-29 09:50:51.056251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.385 [2024-11-29 09:50:51.056444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.385 [2024-11-29 09:50:51.056633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.385 [2024-11-29 09:50:51.056656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.385 [2024-11-29 09:50:51.056672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.385 [2024-11-29 09:50:51.059033] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.385 [2024-11-29 09:50:51.068416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.385 [2024-11-29 09:50:51.068709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.068824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.068852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.385 [2024-11-29 09:50:51.068870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.385 [2024-11-29 09:50:51.069017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.385 [2024-11-29 09:50:51.069204] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.385 [2024-11-29 09:50:51.069228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.385 [2024-11-29 09:50:51.069243] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.385 [2024-11-29 09:50:51.071577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.385 [2024-11-29 09:50:51.081138] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.385 [2024-11-29 09:50:51.081433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.081575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.081603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.385 [2024-11-29 09:50:51.081621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.385 [2024-11-29 09:50:51.081732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.385 [2024-11-29 09:50:51.081902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.385 [2024-11-29 09:50:51.081925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.385 [2024-11-29 09:50:51.081940] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.385 [2024-11-29 09:50:51.084268] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.385 [2024-11-29 09:50:51.093643] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.385 [2024-11-29 09:50:51.093956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.094120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.094149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.385 [2024-11-29 09:50:51.094172] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.385 [2024-11-29 09:50:51.094356] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.385 [2024-11-29 09:50:51.094535] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.385 [2024-11-29 09:50:51.094560] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.385 [2024-11-29 09:50:51.094575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.385 [2024-11-29 09:50:51.097025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.385 [2024-11-29 09:50:51.106164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.385 [2024-11-29 09:50:51.106486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.106668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.106694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.385 [2024-11-29 09:50:51.106710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.385 [2024-11-29 09:50:51.106936] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.385 [2024-11-29 09:50:51.107103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.385 [2024-11-29 09:50:51.107126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.385 [2024-11-29 09:50:51.107141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.385 [2024-11-29 09:50:51.109232] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.385 [2024-11-29 09:50:51.118857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.385 [2024-11-29 09:50:51.119156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.119282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.119307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.385 [2024-11-29 09:50:51.119322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.385 [2024-11-29 09:50:51.119549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.385 [2024-11-29 09:50:51.119720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.385 [2024-11-29 09:50:51.119743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.385 [2024-11-29 09:50:51.119758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.385 [2024-11-29 09:50:51.121974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.385 [2024-11-29 09:50:51.131593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.385 [2024-11-29 09:50:51.131897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.132037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.132064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.385 [2024-11-29 09:50:51.132081] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.385 [2024-11-29 09:50:51.132287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.385 [2024-11-29 09:50:51.132487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.385 [2024-11-29 09:50:51.132512] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.385 [2024-11-29 09:50:51.132527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.385 [2024-11-29 09:50:51.134873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.385 [2024-11-29 09:50:51.144296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.385 [2024-11-29 09:50:51.144586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.144738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.144767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.385 [2024-11-29 09:50:51.144783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.385 [2024-11-29 09:50:51.144948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.385 [2024-11-29 09:50:51.145118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.385 [2024-11-29 09:50:51.145141] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.385 [2024-11-29 09:50:51.145156] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.385 [2024-11-29 09:50:51.147420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.385 [2024-11-29 09:50:51.156863] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.385 [2024-11-29 09:50:51.157180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.157313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.385 [2024-11-29 09:50:51.157340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.385 [2024-11-29 09:50:51.157358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.385 [2024-11-29 09:50:51.157568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.385 [2024-11-29 09:50:51.157720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.385 [2024-11-29 09:50:51.157744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.385 [2024-11-29 09:50:51.157759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.386 [2024-11-29 09:50:51.160140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.386 [2024-11-29 09:50:51.169550] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.386 [2024-11-29 09:50:51.169824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.386 [2024-11-29 09:50:51.169975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.386 [2024-11-29 09:50:51.170001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.386 [2024-11-29 09:50:51.170017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.386 [2024-11-29 09:50:51.170159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.386 [2024-11-29 09:50:51.170353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.386 [2024-11-29 09:50:51.170377] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.386 [2024-11-29 09:50:51.170400] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.386 [2024-11-29 09:50:51.172671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.386 [2024-11-29 09:50:51.182096] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.386 [2024-11-29 09:50:51.182524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.386 [2024-11-29 09:50:51.182655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.386 [2024-11-29 09:50:51.182680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.386 [2024-11-29 09:50:51.182696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.386 [2024-11-29 09:50:51.182875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.386 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 144260 Killed "${NVMF_APP[@]}" "$@" 00:27:28.386 [2024-11-29 09:50:51.183087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.386 [2024-11-29 09:50:51.183111] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.386 [2024-11-29 09:50:51.183140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.386 09:50:51 -- host/bdevperf.sh@36 -- # tgt_init 00:27:28.386 09:50:51 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:28.386 09:50:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:28.386 09:50:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:28.386 09:50:51 -- common/autotest_common.sh@10 -- # set +x 00:27:28.386 [2024-11-29 09:50:51.185496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.386 09:50:51 -- nvmf/common.sh@469 -- # nvmfpid=145376 00:27:28.386 09:50:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:28.386 09:50:51 -- nvmf/common.sh@470 -- # waitforlisten 145376 00:27:28.386 09:50:51 -- common/autotest_common.sh@829 -- # '[' -z 145376 ']' 00:27:28.386 09:50:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:28.386 09:50:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:28.386 09:50:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:28.386 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:28.386 09:50:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:28.386 09:50:51 -- common/autotest_common.sh@10 -- # set +x 00:27:28.386 [2024-11-29 09:50:51.194701] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.386 [2024-11-29 09:50:51.195026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.386 [2024-11-29 09:50:51.195161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.386 [2024-11-29 09:50:51.195190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.386 [2024-11-29 09:50:51.195207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.386 [2024-11-29 09:50:51.195318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.386 [2024-11-29 09:50:51.195506] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.386 [2024-11-29 09:50:51.195533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.386 [2024-11-29 09:50:51.195548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.386 [2024-11-29 09:50:51.197791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.386 [2024-11-29 09:50:51.207306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.386 [2024-11-29 09:50:51.207626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.386 [2024-11-29 09:50:51.207799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.386 [2024-11-29 09:50:51.207824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.386 [2024-11-29 09:50:51.207840] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.386 [2024-11-29 09:50:51.207956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.386 [2024-11-29 09:50:51.208129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.386 [2024-11-29 09:50:51.208151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.386 [2024-11-29 09:50:51.208165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.386 [2024-11-29 09:50:51.210490] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.386 [2024-11-29 09:50:51.219553] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.386 [2024-11-29 09:50:51.219936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.386 [2024-11-29 09:50:51.220091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.386 [2024-11-29 09:50:51.220117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.386 [2024-11-29 09:50:51.220133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.386 [2024-11-29 09:50:51.220249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.386 [2024-11-29 09:50:51.220455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.386 [2024-11-29 09:50:51.220478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.386 [2024-11-29 09:50:51.220492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.386 [2024-11-29 09:50:51.222795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.646 [2024-11-29 09:50:51.230028] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:28.646 [2024-11-29 09:50:51.230099] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:28.646 [2024-11-29 09:50:51.231952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.646 [2024-11-29 09:50:51.232302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.646 [2024-11-29 09:50:51.232436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.646 [2024-11-29 09:50:51.232463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.646 [2024-11-29 09:50:51.232479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.646 [2024-11-29 09:50:51.232611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.646 [2024-11-29 09:50:51.232778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.646 [2024-11-29 09:50:51.232798] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.646 [2024-11-29 09:50:51.232810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.646 [2024-11-29 09:50:51.234985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.646 [2024-11-29 09:50:51.243992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.646 [2024-11-29 09:50:51.244327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.646 [2024-11-29 09:50:51.244426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.646 [2024-11-29 09:50:51.244453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.646 [2024-11-29 09:50:51.244468] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.646 [2024-11-29 09:50:51.244633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.646 [2024-11-29 09:50:51.244778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.646 [2024-11-29 09:50:51.244797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.646 [2024-11-29 09:50:51.244810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.647 [2024-11-29 09:50:51.246741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.647 [2024-11-29 09:50:51.256123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.647 [2024-11-29 09:50:51.256463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.256595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.256620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.647 [2024-11-29 09:50:51.256635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.647 [2024-11-29 09:50:51.256799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.647 [2024-11-29 09:50:51.257001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.647 [2024-11-29 09:50:51.257020] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.647 [2024-11-29 09:50:51.257032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.647 [2024-11-29 09:50:51.258911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.647 EAL: No free 2048 kB hugepages reported on node 1 00:27:28.647 [2024-11-29 09:50:51.268445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.647 [2024-11-29 09:50:51.268761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.268904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.268929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.647 [2024-11-29 09:50:51.268945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.647 [2024-11-29 09:50:51.269126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.647 [2024-11-29 09:50:51.269311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.647 [2024-11-29 09:50:51.269345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.647 [2024-11-29 09:50:51.269359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.647 [2024-11-29 09:50:51.271607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.647 [2024-11-29 09:50:51.281008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.647 [2024-11-29 09:50:51.281310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.281487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.281513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.647 [2024-11-29 09:50:51.281528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.647 [2024-11-29 09:50:51.281725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.647 [2024-11-29 09:50:51.281912] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.647 [2024-11-29 09:50:51.281935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.647 [2024-11-29 09:50:51.281950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.647 [2024-11-29 09:50:51.284262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.647 [2024-11-29 09:50:51.293624] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.647 [2024-11-29 09:50:51.294001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.294107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.294132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.647 [2024-11-29 09:50:51.294148] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.647 [2024-11-29 09:50:51.294334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.647 [2024-11-29 09:50:51.294536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.647 [2024-11-29 09:50:51.294557] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.647 [2024-11-29 09:50:51.294570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.647 [2024-11-29 09:50:51.297240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.647 [2024-11-29 09:50:51.300018] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:28.647 [2024-11-29 09:50:51.306214] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.647 [2024-11-29 09:50:51.306592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.306755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.306783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.647 [2024-11-29 09:50:51.306802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.647 [2024-11-29 09:50:51.306970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.647 [2024-11-29 09:50:51.307160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.647 [2024-11-29 09:50:51.307191] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.647 [2024-11-29 09:50:51.307208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.647 [2024-11-29 09:50:51.309519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.647 [2024-11-29 09:50:51.318657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.647 [2024-11-29 09:50:51.319018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.319164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.319190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.647 [2024-11-29 09:50:51.319209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.647 [2024-11-29 09:50:51.319379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.647 [2024-11-29 09:50:51.319540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.647 [2024-11-29 09:50:51.319562] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.647 [2024-11-29 09:50:51.319578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.647 [2024-11-29 09:50:51.321838] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.647 [2024-11-29 09:50:51.331375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.647 [2024-11-29 09:50:51.331761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.331906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.331934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.647 [2024-11-29 09:50:51.331952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.647 [2024-11-29 09:50:51.332099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.647 [2024-11-29 09:50:51.332285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.647 [2024-11-29 09:50:51.332308] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.647 [2024-11-29 09:50:51.332323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.647 [2024-11-29 09:50:51.334644] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.647 [2024-11-29 09:50:51.343987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.647 [2024-11-29 09:50:51.344334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.344487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.344514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.647 [2024-11-29 09:50:51.344531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.647 [2024-11-29 09:50:51.344717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.647 [2024-11-29 09:50:51.344888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.647 [2024-11-29 09:50:51.344911] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.647 [2024-11-29 09:50:51.344938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.647 [2024-11-29 09:50:51.347160] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.647 [2024-11-29 09:50:51.356583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.647 [2024-11-29 09:50:51.356900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.357046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.647 [2024-11-29 09:50:51.357074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.648 [2024-11-29 09:50:51.357092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.648 [2024-11-29 09:50:51.357239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.648 [2024-11-29 09:50:51.357418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.648 [2024-11-29 09:50:51.357454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.648 [2024-11-29 09:50:51.357467] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.648 [2024-11-29 09:50:51.359730] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.648 [2024-11-29 09:50:51.368981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.648 [2024-11-29 09:50:51.369483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.369702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.369732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.648 [2024-11-29 09:50:51.369754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.648 [2024-11-29 09:50:51.369912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.648 [2024-11-29 09:50:51.370069] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.648 [2024-11-29 09:50:51.370093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.648 [2024-11-29 09:50:51.370112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.648 [2024-11-29 09:50:51.372555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.648 [2024-11-29 09:50:51.381360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.648 [2024-11-29 09:50:51.381656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.381818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.381843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.648 [2024-11-29 09:50:51.381859] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.648 [2024-11-29 09:50:51.382016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.648 [2024-11-29 09:50:51.382204] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.648 [2024-11-29 09:50:51.382227] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.648 [2024-11-29 09:50:51.382243] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.648 [2024-11-29 09:50:51.384684] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.648 [2024-11-29 09:50:51.393808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.648 [2024-11-29 09:50:51.394095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.394198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.394228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.648 [2024-11-29 09:50:51.394246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.648 [2024-11-29 09:50:51.394425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.648 [2024-11-29 09:50:51.394640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.648 [2024-11-29 09:50:51.394661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.648 [2024-11-29 09:50:51.394674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.648 [2024-11-29 09:50:51.396987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.648 [2024-11-29 09:50:51.406592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.648 [2024-11-29 09:50:51.406911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.407081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.407110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.648 [2024-11-29 09:50:51.407127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.648 [2024-11-29 09:50:51.407310] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.648 [2024-11-29 09:50:51.407500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.648 [2024-11-29 09:50:51.407522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.648 [2024-11-29 09:50:51.407535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.648 [2024-11-29 09:50:51.409929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.648 [2024-11-29 09:50:51.415342] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:28.648 [2024-11-29 09:50:51.415483] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:28.648 [2024-11-29 09:50:51.415505] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:28.648 [2024-11-29 09:50:51.415521] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:28.648 [2024-11-29 09:50:51.415586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:28.648 [2024-11-29 09:50:51.415660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:28.648 [2024-11-29 09:50:51.415664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:28.648 [2024-11-29 09:50:51.418914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.648 [2024-11-29 09:50:51.419238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.419405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.419432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.648 [2024-11-29 09:50:51.419448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.648 [2024-11-29 09:50:51.419606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.648 [2024-11-29 09:50:51.419742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.648 [2024-11-29 09:50:51.419763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.648 [2024-11-29 09:50:51.419777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.648 [2024-11-29 09:50:51.421849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.648 [2024-11-29 09:50:51.431240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.648 [2024-11-29 09:50:51.431733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.431907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.431933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.648 [2024-11-29 09:50:51.431954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.648 [2024-11-29 09:50:51.432129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.648 [2024-11-29 09:50:51.432266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.648 [2024-11-29 09:50:51.432288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.648 [2024-11-29 09:50:51.432307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.648 [2024-11-29 09:50:51.434370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.648 [2024-11-29 09:50:51.443590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.648 [2024-11-29 09:50:51.444035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.444184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.444211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.648 [2024-11-29 09:50:51.444231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.648 [2024-11-29 09:50:51.444357] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.648 [2024-11-29 09:50:51.444558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.648 [2024-11-29 09:50:51.444581] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.648 [2024-11-29 09:50:51.444599] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.648 [2024-11-29 09:50:51.446726] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.648 [2024-11-29 09:50:51.456149] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.648 [2024-11-29 09:50:51.456612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.456761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.456787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.648 [2024-11-29 09:50:51.456808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.648 [2024-11-29 09:50:51.456951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.648 [2024-11-29 09:50:51.457125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.648 [2024-11-29 09:50:51.457147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.648 [2024-11-29 09:50:51.457165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.648 [2024-11-29 09:50:51.459176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.648 [2024-11-29 09:50:51.468497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.648 [2024-11-29 09:50:51.468886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.648 [2024-11-29 09:50:51.469059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.649 [2024-11-29 09:50:51.469084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.649 [2024-11-29 09:50:51.469103] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.649 [2024-11-29 09:50:51.469226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.649 [2024-11-29 09:50:51.469363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.649 [2024-11-29 09:50:51.469384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.649 [2024-11-29 09:50:51.469424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.649 [2024-11-29 09:50:51.471656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.649 [2024-11-29 09:50:51.481108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.649 [2024-11-29 09:50:51.481523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.649 [2024-11-29 09:50:51.481634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.649 [2024-11-29 09:50:51.481661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.649 [2024-11-29 09:50:51.481681] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.649 [2024-11-29 09:50:51.481856] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.649 [2024-11-29 09:50:51.482015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.649 [2024-11-29 09:50:51.482038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.649 [2024-11-29 09:50:51.482056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.649 [2024-11-29 09:50:51.484032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.911 [2024-11-29 09:50:51.493528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.911 [2024-11-29 09:50:51.493891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.911 [2024-11-29 09:50:51.494061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.911 [2024-11-29 09:50:51.494088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.911 [2024-11-29 09:50:51.494109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.911 [2024-11-29 09:50:51.494282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.911 [2024-11-29 09:50:51.494481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.911 [2024-11-29 09:50:51.494522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.911 [2024-11-29 09:50:51.494540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.911 [2024-11-29 09:50:51.496816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.911 [2024-11-29 09:50:51.506094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.911 [2024-11-29 09:50:51.506418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.911 [2024-11-29 09:50:51.506555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.911 [2024-11-29 09:50:51.506581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.911 [2024-11-29 09:50:51.506597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.911 [2024-11-29 09:50:51.506762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.911 [2024-11-29 09:50:51.506914] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.911 [2024-11-29 09:50:51.506934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.911 [2024-11-29 09:50:51.506948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.911 [2024-11-29 09:50:51.509065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.911 [2024-11-29 09:50:51.518580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.911 [2024-11-29 09:50:51.518858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.911 [2024-11-29 09:50:51.518990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.911 [2024-11-29 09:50:51.519017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.911 [2024-11-29 09:50:51.519033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.911 [2024-11-29 09:50:51.519183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.911 [2024-11-29 09:50:51.519317] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.911 [2024-11-29 09:50:51.519338] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.911 [2024-11-29 09:50:51.519351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.911 [2024-11-29 09:50:51.521506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.911 [2024-11-29 09:50:51.530902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.911 [2024-11-29 09:50:51.531152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.911 [2024-11-29 09:50:51.531286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.911 [2024-11-29 09:50:51.531311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.911 [2024-11-29 09:50:51.531326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.911 [2024-11-29 09:50:51.531500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.911 [2024-11-29 09:50:51.531638] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.911 [2024-11-29 09:50:51.531658] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.911 [2024-11-29 09:50:51.531677] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.911 [2024-11-29 09:50:51.533892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.911 [2024-11-29 09:50:51.543329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.911 [2024-11-29 09:50:51.543657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.911 [2024-11-29 09:50:51.543800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.911 [2024-11-29 09:50:51.543825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.911 [2024-11-29 09:50:51.543840] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.911 [2024-11-29 09:50:51.543973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.911 [2024-11-29 09:50:51.544123] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.911 [2024-11-29 09:50:51.544144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.911 [2024-11-29 09:50:51.544157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.911 [2024-11-29 09:50:51.546087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.911 [2024-11-29 09:50:51.555646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.911 [2024-11-29 09:50:51.555959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.911 [2024-11-29 09:50:51.556090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.556115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.912 [2024-11-29 09:50:51.556130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.912 [2024-11-29 09:50:51.556278] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.912 [2024-11-29 09:50:51.556501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.912 [2024-11-29 09:50:51.556523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.912 [2024-11-29 09:50:51.556537] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.912 [2024-11-29 09:50:51.558560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.912 [2024-11-29 09:50:51.567997] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.912 [2024-11-29 09:50:51.568292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.568412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.568438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.912 [2024-11-29 09:50:51.568454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.912 [2024-11-29 09:50:51.568619] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.912 [2024-11-29 09:50:51.568801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.912 [2024-11-29 09:50:51.568821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.912 [2024-11-29 09:50:51.568834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.912 [2024-11-29 09:50:51.570831] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.912 [2024-11-29 09:50:51.580183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.912 [2024-11-29 09:50:51.580506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.580616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.580641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.912 [2024-11-29 09:50:51.580657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.912 [2024-11-29 09:50:51.580788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.912 [2024-11-29 09:50:51.580968] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.912 [2024-11-29 09:50:51.580990] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.912 [2024-11-29 09:50:51.581003] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.912 [2024-11-29 09:50:51.583113] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.912 [2024-11-29 09:50:51.592583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.912 [2024-11-29 09:50:51.592846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.592977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.593003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.912 [2024-11-29 09:50:51.593018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.912 [2024-11-29 09:50:51.593167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.912 [2024-11-29 09:50:51.593334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.912 [2024-11-29 09:50:51.593354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.912 [2024-11-29 09:50:51.593367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.912 [2024-11-29 09:50:51.595390] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.912 [2024-11-29 09:50:51.604777] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.912 [2024-11-29 09:50:51.605066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.605191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.605217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.912 [2024-11-29 09:50:51.605232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.912 [2024-11-29 09:50:51.605348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.912 [2024-11-29 09:50:51.605525] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.912 [2024-11-29 09:50:51.605547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.912 [2024-11-29 09:50:51.605560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.912 [2024-11-29 09:50:51.607470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.912 [2024-11-29 09:50:51.617154] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.912 [2024-11-29 09:50:51.617408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.617537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.617562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.912 [2024-11-29 09:50:51.617578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.912 [2024-11-29 09:50:51.617743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.912 [2024-11-29 09:50:51.617908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.912 [2024-11-29 09:50:51.617928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.912 [2024-11-29 09:50:51.617941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.912 [2024-11-29 09:50:51.619904] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.912 [2024-11-29 09:50:51.629463] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.912 [2024-11-29 09:50:51.629726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.629864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.629889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.912 [2024-11-29 09:50:51.629904] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.912 [2024-11-29 09:50:51.630036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.912 [2024-11-29 09:50:51.630218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.912 [2024-11-29 09:50:51.630239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.912 [2024-11-29 09:50:51.630252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.912 [2024-11-29 09:50:51.632190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.912 [2024-11-29 09:50:51.641732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.912 [2024-11-29 09:50:51.642021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.642125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.642150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.912 [2024-11-29 09:50:51.642166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.912 [2024-11-29 09:50:51.642314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.912 [2024-11-29 09:50:51.642474] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.912 [2024-11-29 09:50:51.642496] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.912 [2024-11-29 09:50:51.642509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.912 [2024-11-29 09:50:51.644527] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.912 [2024-11-29 09:50:51.654021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.912 [2024-11-29 09:50:51.654294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.654434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.654460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.912 [2024-11-29 09:50:51.654475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.912 [2024-11-29 09:50:51.654624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.912 [2024-11-29 09:50:51.654852] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.912 [2024-11-29 09:50:51.654872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.912 [2024-11-29 09:50:51.654885] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.912 [2024-11-29 09:50:51.657025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.912 [2024-11-29 09:50:51.666451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.912 [2024-11-29 09:50:51.666731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.666827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.912 [2024-11-29 09:50:51.666853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.912 [2024-11-29 09:50:51.666868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.912 [2024-11-29 09:50:51.667017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.912 [2024-11-29 09:50:51.667152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.913 [2024-11-29 09:50:51.667173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.913 [2024-11-29 09:50:51.667186] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.913 [2024-11-29 09:50:51.669227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.913 [2024-11-29 09:50:51.678651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.913 [2024-11-29 09:50:51.678908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.913 [2024-11-29 09:50:51.679008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.913 [2024-11-29 09:50:51.679033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.913 [2024-11-29 09:50:51.679049] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.913 [2024-11-29 09:50:51.679245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.913 [2024-11-29 09:50:51.679434] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.913 [2024-11-29 09:50:51.679455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.913 [2024-11-29 09:50:51.679468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.913 [2024-11-29 09:50:51.681555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.913 [2024-11-29 09:50:51.691022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.913 [2024-11-29 09:50:51.691328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.913 [2024-11-29 09:50:51.691453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.913 [2024-11-29 09:50:51.691484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.913 [2024-11-29 09:50:51.691501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.913 [2024-11-29 09:50:51.691714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.913 [2024-11-29 09:50:51.691861] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.913 [2024-11-29 09:50:51.691881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.913 [2024-11-29 09:50:51.691894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.913 [2024-11-29 09:50:51.694124] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.913 [2024-11-29 09:50:51.703202] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.913 [2024-11-29 09:50:51.703463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.913 [2024-11-29 09:50:51.703595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.913 [2024-11-29 09:50:51.703620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.913 [2024-11-29 09:50:51.703636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.913 [2024-11-29 09:50:51.703800] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.913 [2024-11-29 09:50:51.703981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.913 [2024-11-29 09:50:51.704002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.913 [2024-11-29 09:50:51.704015] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.913 [2024-11-29 09:50:51.706195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.913 [2024-11-29 09:50:51.715567] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.913 [2024-11-29 09:50:51.715847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.913 [2024-11-29 09:50:51.715976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.913 [2024-11-29 09:50:51.716002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.913 [2024-11-29 09:50:51.716017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.913 [2024-11-29 09:50:51.716214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.913 [2024-11-29 09:50:51.716401] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.913 [2024-11-29 09:50:51.716422] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.913 [2024-11-29 09:50:51.716434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.913 [2024-11-29 09:50:51.718441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.913 [2024-11-29 09:50:51.727750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.913 [2024-11-29 09:50:51.728020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.913 [2024-11-29 09:50:51.728149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.913 [2024-11-29 09:50:51.728175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.913 [2024-11-29 09:50:51.728196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.913 [2024-11-29 09:50:51.728344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.913 [2024-11-29 09:50:51.728545] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.913 [2024-11-29 09:50:51.728577] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.913 [2024-11-29 09:50:51.728592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.913 [2024-11-29 09:50:51.730769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.913 [2024-11-29 09:50:51.739843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.913 [2024-11-29 09:50:51.740192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.913 [2024-11-29 09:50:51.740346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.913 [2024-11-29 09:50:51.740373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:28.913 [2024-11-29 09:50:51.740389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:28.913 [2024-11-29 09:50:51.740579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:28.913 [2024-11-29 09:50:51.740778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.913 [2024-11-29 09:50:51.740799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.913 [2024-11-29 09:50:51.740813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.913 [2024-11-29 09:50:51.743059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.173 [2024-11-29 09:50:51.752250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.173 [2024-11-29 09:50:51.752627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-11-29 09:50:51.752732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-11-29 09:50:51.752758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.173 [2024-11-29 09:50:51.752774] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.173 [2024-11-29 09:50:51.752907] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.173 [2024-11-29 09:50:51.753073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.173 [2024-11-29 09:50:51.753095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.173 [2024-11-29 09:50:51.753109] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.173 [2024-11-29 09:50:51.755205] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.173 [2024-11-29 09:50:51.764578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.173 [2024-11-29 09:50:51.764822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-11-29 09:50:51.764927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-11-29 09:50:51.764953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.173 [2024-11-29 09:50:51.764969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.173 [2024-11-29 09:50:51.765122] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.173 [2024-11-29 09:50:51.765288] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.173 [2024-11-29 09:50:51.765309] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.173 [2024-11-29 09:50:51.765322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.173 [2024-11-29 09:50:51.767346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.173 [2024-11-29 09:50:51.776780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.173 [2024-11-29 09:50:51.777072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-11-29 09:50:51.777195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-11-29 09:50:51.777221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.173 [2024-11-29 09:50:51.777236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.173 [2024-11-29 09:50:51.777384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.173 [2024-11-29 09:50:51.777531] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.173 [2024-11-29 09:50:51.777553] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.173 [2024-11-29 09:50:51.777566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.173 [2024-11-29 09:50:51.779600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.173 [2024-11-29 09:50:51.788807] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.173 [2024-11-29 09:50:51.789112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-11-29 09:50:51.789242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-11-29 09:50:51.789268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.173 [2024-11-29 09:50:51.789283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.173 [2024-11-29 09:50:51.789407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.173 [2024-11-29 09:50:51.789560] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.173 [2024-11-29 09:50:51.789581] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.173 [2024-11-29 09:50:51.789594] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.173 [2024-11-29 09:50:51.791725] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.173 [2024-11-29 09:50:51.801056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.173 [2024-11-29 09:50:51.801340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-11-29 09:50:51.801468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.173 [2024-11-29 09:50:51.801494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.173 [2024-11-29 09:50:51.801510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.173 [2024-11-29 09:50:51.801674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.173 [2024-11-29 09:50:51.801818] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.173 [2024-11-29 09:50:51.801839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.173 [2024-11-29 09:50:51.801853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.173 [2024-11-29 09:50:51.803887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.173 [2024-11-29 09:50:51.813424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.173 [2024-11-29 09:50:51.813693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.813844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.813870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.174 [2024-11-29 09:50:51.813885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.174 [2024-11-29 09:50:51.814066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.174 [2024-11-29 09:50:51.814215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.174 [2024-11-29 09:50:51.814236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.174 [2024-11-29 09:50:51.814248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.174 [2024-11-29 09:50:51.816366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.174 [2024-11-29 09:50:51.825629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.174 [2024-11-29 09:50:51.825930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.826061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.826086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.174 [2024-11-29 09:50:51.826102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.174 [2024-11-29 09:50:51.826250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.174 [2024-11-29 09:50:51.826457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.174 [2024-11-29 09:50:51.826479] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.174 [2024-11-29 09:50:51.826492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.174 [2024-11-29 09:50:51.828713] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.174 [2024-11-29 09:50:51.837943] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.174 [2024-11-29 09:50:51.838213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.838316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.838342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.174 [2024-11-29 09:50:51.838357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.174 [2024-11-29 09:50:51.838532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.174 [2024-11-29 09:50:51.838716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.174 [2024-11-29 09:50:51.838742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.174 [2024-11-29 09:50:51.838756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.174 [2024-11-29 09:50:51.840806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.174 [2024-11-29 09:50:51.850365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.174 [2024-11-29 09:50:51.850685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.850783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.850808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.174 [2024-11-29 09:50:51.850823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.174 [2024-11-29 09:50:51.850988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.174 [2024-11-29 09:50:51.851155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.174 [2024-11-29 09:50:51.851175] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.174 [2024-11-29 09:50:51.851188] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.174 [2024-11-29 09:50:51.853215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.174 [2024-11-29 09:50:51.862730] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.174 [2024-11-29 09:50:51.863012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.863114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.863141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.174 [2024-11-29 09:50:51.863156] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.174 [2024-11-29 09:50:51.863289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.174 [2024-11-29 09:50:51.863514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.174 [2024-11-29 09:50:51.863537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.174 [2024-11-29 09:50:51.863551] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.174 [2024-11-29 09:50:51.865691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.174 [2024-11-29 09:50:51.875101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.174 [2024-11-29 09:50:51.875360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.875499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.875526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.174 [2024-11-29 09:50:51.875542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.174 [2024-11-29 09:50:51.875673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.174 [2024-11-29 09:50:51.875840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.174 [2024-11-29 09:50:51.875861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.174 [2024-11-29 09:50:51.875879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.174 [2024-11-29 09:50:51.877988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.174 [2024-11-29 09:50:51.887288] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.174 [2024-11-29 09:50:51.887540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.887648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.887674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.174 [2024-11-29 09:50:51.887689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.174 [2024-11-29 09:50:51.887838] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.174 [2024-11-29 09:50:51.888004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.174 [2024-11-29 09:50:51.888025] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.174 [2024-11-29 09:50:51.888038] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.174 [2024-11-29 09:50:51.890200] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.174 [2024-11-29 09:50:51.899677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.174 [2024-11-29 09:50:51.899936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.900087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.900112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.174 [2024-11-29 09:50:51.900127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.174 [2024-11-29 09:50:51.900259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.174 [2024-11-29 09:50:51.900437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.174 [2024-11-29 09:50:51.900458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.174 [2024-11-29 09:50:51.900472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.174 [2024-11-29 09:50:51.902673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.174 [2024-11-29 09:50:51.912040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.174 [2024-11-29 09:50:51.912318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.912448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.912475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.174 [2024-11-29 09:50:51.912490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.174 [2024-11-29 09:50:51.912639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.174 [2024-11-29 09:50:51.912792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.174 [2024-11-29 09:50:51.912812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.174 [2024-11-29 09:50:51.912826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.174 [2024-11-29 09:50:51.915067] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.174 [2024-11-29 09:50:51.924314] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.174 [2024-11-29 09:50:51.924560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.924691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.174 [2024-11-29 09:50:51.924717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.174 [2024-11-29 09:50:51.924733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.175 [2024-11-29 09:50:51.924897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.175 [2024-11-29 09:50:51.925075] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.175 [2024-11-29 09:50:51.925096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.175 [2024-11-29 09:50:51.925109] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.175 [2024-11-29 09:50:51.927198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.175 [2024-11-29 09:50:51.936534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.175 [2024-11-29 09:50:51.936810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-11-29 09:50:51.936930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-11-29 09:50:51.936956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.175 [2024-11-29 09:50:51.936972] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.175 [2024-11-29 09:50:51.937137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.175 [2024-11-29 09:50:51.937349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.175 [2024-11-29 09:50:51.937385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.175 [2024-11-29 09:50:51.937409] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.175 [2024-11-29 09:50:51.939500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.175 [2024-11-29 09:50:51.948979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.175 [2024-11-29 09:50:51.949261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-11-29 09:50:51.949364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-11-29 09:50:51.949400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.175 [2024-11-29 09:50:51.949418] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.175 [2024-11-29 09:50:51.949616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.175 [2024-11-29 09:50:51.949814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.175 [2024-11-29 09:50:51.949835] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.175 [2024-11-29 09:50:51.949848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.175 [2024-11-29 09:50:51.951798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.175 [2024-11-29 09:50:51.961024] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.175 [2024-11-29 09:50:51.961319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-11-29 09:50:51.961421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-11-29 09:50:51.961447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.175 [2024-11-29 09:50:51.961464] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.175 [2024-11-29 09:50:51.961612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.175 [2024-11-29 09:50:51.961794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.175 [2024-11-29 09:50:51.961815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.175 [2024-11-29 09:50:51.961828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.175 [2024-11-29 09:50:51.963861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.175 [2024-11-29 09:50:51.973405] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.175 [2024-11-29 09:50:51.973667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-11-29 09:50:51.973765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-11-29 09:50:51.973790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.175 [2024-11-29 09:50:51.973806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.175 [2024-11-29 09:50:51.973954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.175 [2024-11-29 09:50:51.974074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.175 [2024-11-29 09:50:51.974095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.175 [2024-11-29 09:50:51.974109] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.175 [2024-11-29 09:50:51.976047] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.175 [2024-11-29 09:50:51.985834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.175 [2024-11-29 09:50:51.986058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-11-29 09:50:51.986160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-11-29 09:50:51.986187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.175 [2024-11-29 09:50:51.986203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.175 [2024-11-29 09:50:51.986336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.175 [2024-11-29 09:50:51.986497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.175 [2024-11-29 09:50:51.986519] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.175 [2024-11-29 09:50:51.986533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.175 [2024-11-29 09:50:51.988668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.175 [2024-11-29 09:50:51.998204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.175 [2024-11-29 09:50:51.998425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-11-29 09:50:51.998538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-11-29 09:50:51.998564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.175 [2024-11-29 09:50:51.998579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.175 [2024-11-29 09:50:51.998728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.175 [2024-11-29 09:50:51.998894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.175 [2024-11-29 09:50:51.998914] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.175 [2024-11-29 09:50:51.998928] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.175 [2024-11-29 09:50:52.000921] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.175 [2024-11-29 09:50:52.010597] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.175 [2024-11-29 09:50:52.010905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-11-29 09:50:52.011031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.175 [2024-11-29 09:50:52.011057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.175 [2024-11-29 09:50:52.011073] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.175 [2024-11-29 09:50:52.011253] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.175 [2024-11-29 09:50:52.011432] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.175 [2024-11-29 09:50:52.011455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.175 [2024-11-29 09:50:52.011469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.435 [2024-11-29 09:50:52.013776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.435 [2024-11-29 09:50:52.022893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.435 [2024-11-29 09:50:52.023206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.435 [2024-11-29 09:50:52.023333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.435 [2024-11-29 09:50:52.023359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.435 [2024-11-29 09:50:52.023374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.435 [2024-11-29 09:50:52.023539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.435 [2024-11-29 09:50:52.023708] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.435 [2024-11-29 09:50:52.023729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.435 [2024-11-29 09:50:52.023742] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.435 [2024-11-29 09:50:52.026078] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.435 [2024-11-29 09:50:52.035209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.435 [2024-11-29 09:50:52.035505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.435 [2024-11-29 09:50:52.035630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.435 [2024-11-29 09:50:52.035655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.435 [2024-11-29 09:50:52.035680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.435 [2024-11-29 09:50:52.035797] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.435 [2024-11-29 09:50:52.035947] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.435 [2024-11-29 09:50:52.035967] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.435 [2024-11-29 09:50:52.035980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.435 [2024-11-29 09:50:52.038068] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.435 [2024-11-29 09:50:52.047713] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.435 [2024-11-29 09:50:52.048035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.435 [2024-11-29 09:50:52.048134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.435 [2024-11-29 09:50:52.048159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.435 [2024-11-29 09:50:52.048174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.435 [2024-11-29 09:50:52.048306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.435 [2024-11-29 09:50:52.048484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.435 [2024-11-29 09:50:52.048506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.435 [2024-11-29 09:50:52.048519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.435 [2024-11-29 09:50:52.050454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.435 [2024-11-29 09:50:52.059808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.435 [2024-11-29 09:50:52.060118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.435 [2024-11-29 09:50:52.060244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.435 [2024-11-29 09:50:52.060270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.435 [2024-11-29 09:50:52.060285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.435 [2024-11-29 09:50:52.060459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.435 [2024-11-29 09:50:52.060579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.435 [2024-11-29 09:50:52.060600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.435 [2024-11-29 09:50:52.060613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.435 [2024-11-29 09:50:52.062659] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.435 [2024-11-29 09:50:52.072091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.435 [2024-11-29 09:50:52.072404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.435 [2024-11-29 09:50:52.072533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.435 [2024-11-29 09:50:52.072560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.435 [2024-11-29 09:50:52.072576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.435 [2024-11-29 09:50:52.072777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.435 [2024-11-29 09:50:52.072942] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.435 [2024-11-29 09:50:52.072962] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.435 [2024-11-29 09:50:52.072976] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.435 [2024-11-29 09:50:52.075060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.435 [2024-11-29 09:50:52.084173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.435 [2024-11-29 09:50:52.084487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.435 [2024-11-29 09:50:52.084592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.435 [2024-11-29 09:50:52.084617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.435 [2024-11-29 09:50:52.084633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.435 [2024-11-29 09:50:52.084813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.435 [2024-11-29 09:50:52.084993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.435 [2024-11-29 09:50:52.085014] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.435 [2024-11-29 09:50:52.085027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.435 [2024-11-29 09:50:52.087147] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.435 [2024-11-29 09:50:52.096530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.435 [2024-11-29 09:50:52.096841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.435 [2024-11-29 09:50:52.096989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.097016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.436 [2024-11-29 09:50:52.097032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.436 [2024-11-29 09:50:52.097180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.436 [2024-11-29 09:50:52.097362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.436 [2024-11-29 09:50:52.097406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.436 [2024-11-29 09:50:52.097422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.436 [2024-11-29 09:50:52.099501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.436 [2024-11-29 09:50:52.108755] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.436 [2024-11-29 09:50:52.109006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.109154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.109179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.436 [2024-11-29 09:50:52.109195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.436 [2024-11-29 09:50:52.109295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.436 [2024-11-29 09:50:52.109479] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.436 [2024-11-29 09:50:52.109501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.436 [2024-11-29 09:50:52.109515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.436 [2024-11-29 09:50:52.111578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.436 [2024-11-29 09:50:52.121042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.436 [2024-11-29 09:50:52.121356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.121462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.121488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.436 [2024-11-29 09:50:52.121504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.436 [2024-11-29 09:50:52.121636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.436 [2024-11-29 09:50:52.121787] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.436 [2024-11-29 09:50:52.121807] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.436 [2024-11-29 09:50:52.121820] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.436 [2024-11-29 09:50:52.123894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.436 [2024-11-29 09:50:52.133270] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.436 [2024-11-29 09:50:52.133580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.133680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.133708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.436 [2024-11-29 09:50:52.133724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.436 [2024-11-29 09:50:52.133856] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.436 [2024-11-29 09:50:52.134068] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.436 [2024-11-29 09:50:52.134089] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.436 [2024-11-29 09:50:52.134102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.436 [2024-11-29 09:50:52.136119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.436 [2024-11-29 09:50:52.145602] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.436 [2024-11-29 09:50:52.145901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.146055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.146080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.436 [2024-11-29 09:50:52.146096] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.436 [2024-11-29 09:50:52.146261] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.436 [2024-11-29 09:50:52.146437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.436 [2024-11-29 09:50:52.146465] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.436 [2024-11-29 09:50:52.146480] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.436 [2024-11-29 09:50:52.148635] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.436 [2024-11-29 09:50:52.157931] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.436 [2024-11-29 09:50:52.158274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.158370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.158403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.436 [2024-11-29 09:50:52.158421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.436 [2024-11-29 09:50:52.158601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.436 [2024-11-29 09:50:52.158753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.436 [2024-11-29 09:50:52.158774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.436 [2024-11-29 09:50:52.158787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.436 [2024-11-29 09:50:52.160626] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.436 [2024-11-29 09:50:52.170310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.436 [2024-11-29 09:50:52.170614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.170739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.170766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.436 [2024-11-29 09:50:52.170782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.436 [2024-11-29 09:50:52.170931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.436 [2024-11-29 09:50:52.171128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.436 [2024-11-29 09:50:52.171149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.436 [2024-11-29 09:50:52.171162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.436 [2024-11-29 09:50:52.173181] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.436 [2024-11-29 09:50:52.182671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.436 [2024-11-29 09:50:52.182940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.183060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.183086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.436 [2024-11-29 09:50:52.183102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.436 [2024-11-29 09:50:52.183235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.436 [2024-11-29 09:50:52.183443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.436 [2024-11-29 09:50:52.183465] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.436 [2024-11-29 09:50:52.183484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.436 [2024-11-29 09:50:52.185725] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.436 [2024-11-29 09:50:52.195038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.436 [2024-11-29 09:50:52.195319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.195443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.195470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.436 [2024-11-29 09:50:52.195485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.436 [2024-11-29 09:50:52.195666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.436 [2024-11-29 09:50:52.195879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.436 [2024-11-29 09:50:52.195900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.436 [2024-11-29 09:50:52.195913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.436 [2024-11-29 09:50:52.198024] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.436 [2024-11-29 09:50:52.207179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.436 [2024-11-29 09:50:52.207458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.436 [2024-11-29 09:50:52.207559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.437 [2024-11-29 09:50:52.207583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.437 [2024-11-29 09:50:52.207599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.437 [2024-11-29 09:50:52.207747] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.437 [2024-11-29 09:50:52.207910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.437 [2024-11-29 09:50:52.207930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.437 [2024-11-29 09:50:52.207943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.437 [2024-11-29 09:50:52.210104] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.437 [2024-11-29 09:50:52.219578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.437 [2024-11-29 09:50:52.219782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.437 [2024-11-29 09:50:52.219916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.437 [2024-11-29 09:50:52.219941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.437 [2024-11-29 09:50:52.219957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.437 [2024-11-29 09:50:52.220106] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.437 [2024-11-29 09:50:52.220286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.437 [2024-11-29 09:50:52.220306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.437 [2024-11-29 09:50:52.220319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.437 [2024-11-29 09:50:52.222235] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.437 [2024-11-29 09:50:52.231808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.437 [2024-11-29 09:50:52.232073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.437 [2024-11-29 09:50:52.232203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.437 [2024-11-29 09:50:52.232228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.437 [2024-11-29 09:50:52.232243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.437 [2024-11-29 09:50:52.232400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.437 [2024-11-29 09:50:52.232538] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.437 [2024-11-29 09:50:52.232560] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.437 [2024-11-29 09:50:52.232574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.437 [2024-11-29 09:50:52.234779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.437 09:50:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:29.437 09:50:52 -- common/autotest_common.sh@862 -- # return 0 00:27:29.437 09:50:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:29.437 09:50:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:29.437 09:50:52 -- common/autotest_common.sh@10 -- # set +x 00:27:29.437 [2024-11-29 09:50:52.244108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.437 [2024-11-29 09:50:52.244411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.437 [2024-11-29 09:50:52.244540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.437 [2024-11-29 09:50:52.244566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.437 [2024-11-29 09:50:52.244582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.437 [2024-11-29 09:50:52.244746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.437 [2024-11-29 09:50:52.244864] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.437 [2024-11-29 09:50:52.244886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.437 [2024-11-29 09:50:52.244899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.437 [2024-11-29 09:50:52.246981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.437 [2024-11-29 09:50:52.256551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.437 [2024-11-29 09:50:52.256841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.437 [2024-11-29 09:50:52.256939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.437 [2024-11-29 09:50:52.256965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.437 [2024-11-29 09:50:52.256981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.437 [2024-11-29 09:50:52.257097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.437 [2024-11-29 09:50:52.257247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.437 [2024-11-29 09:50:52.257269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.437 [2024-11-29 09:50:52.257299] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.437 [2024-11-29 09:50:52.259485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.437 09:50:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:29.437 09:50:52 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:29.437 09:50:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.437 09:50:52 -- common/autotest_common.sh@10 -- # set +x 00:27:29.437 [2024-11-29 09:50:52.265226] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:29.437 [2024-11-29 09:50:52.268950] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.437 [2024-11-29 09:50:52.269260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.437 [2024-11-29 09:50:52.269421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.437 [2024-11-29 09:50:52.269447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.437 [2024-11-29 09:50:52.269463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.437 [2024-11-29 09:50:52.269611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.437 [2024-11-29 09:50:52.269747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.437 [2024-11-29 09:50:52.269768] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.437 [2024-11-29 09:50:52.269781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.437 09:50:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.437 09:50:52 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:29.437 09:50:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.437 09:50:52 -- common/autotest_common.sh@10 -- # set +x 00:27:29.437 [2024-11-29 09:50:52.271749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.696 [2024-11-29 09:50:52.281093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.696 [2024-11-29 09:50:52.281429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.696 [2024-11-29 09:50:52.281534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.696 [2024-11-29 09:50:52.281560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.696 [2024-11-29 09:50:52.281575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.696 [2024-11-29 09:50:52.281772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.696 [2024-11-29 09:50:52.281984] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.696 [2024-11-29 09:50:52.282014] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.696 [2024-11-29 09:50:52.282027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.696 [2024-11-29 09:50:52.283981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.696 [2024-11-29 09:50:52.293780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.696 [2024-11-29 09:50:52.294100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.696 [2024-11-29 09:50:52.294249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.696 [2024-11-29 09:50:52.294274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.696 [2024-11-29 09:50:52.294298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.696 [2024-11-29 09:50:52.294455] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.696 [2024-11-29 09:50:52.294593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.696 [2024-11-29 09:50:52.294614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.696 [2024-11-29 09:50:52.294628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.696 [2024-11-29 09:50:52.296797] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.696 [2024-11-29 09:50:52.306073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.696 [2024-11-29 09:50:52.306540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.696 [2024-11-29 09:50:52.306711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.696 [2024-11-29 09:50:52.306740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.696 [2024-11-29 09:50:52.306760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.696 [2024-11-29 09:50:52.306879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.696 [2024-11-29 09:50:52.307066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.696 [2024-11-29 09:50:52.307088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.696 [2024-11-29 09:50:52.307105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.696 [2024-11-29 09:50:52.309239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.696 Malloc0 00:27:29.696 09:50:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.696 09:50:52 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:29.696 09:50:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.696 09:50:52 -- common/autotest_common.sh@10 -- # set +x 00:27:29.696 09:50:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.696 [2024-11-29 09:50:52.318499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.696 09:50:52 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:29.696 09:50:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.696 09:50:52 -- common/autotest_common.sh@10 -- # set +x 00:27:29.696 [2024-11-29 09:50:52.318811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.696 [2024-11-29 09:50:52.318927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.696 [2024-11-29 09:50:52.318953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x729160 with addr=10.0.0.2, port=4420 00:27:29.696 [2024-11-29 09:50:52.318969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x729160 is same with the state(5) to be set 00:27:29.696 [2024-11-29 09:50:52.319084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x729160 (9): Bad file descriptor 00:27:29.696 [2024-11-29 09:50:52.319237] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.696 [2024-11-29 09:50:52.319258] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.696 [2024-11-29 09:50:52.319271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.696 [2024-11-29 09:50:52.321284] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.696 09:50:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.696 09:50:52 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:29.696 09:50:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.696 09:50:52 -- common/autotest_common.sh@10 -- # set +x 00:27:29.696 [2024-11-29 09:50:52.330412] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:29.696 [2024-11-29 09:50:52.330812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.696 09:50:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.697 09:50:52 -- host/bdevperf.sh@38 -- # wait 144572 00:27:29.697 [2024-11-29 09:50:52.365502] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:39.671 00:27:39.671 Latency(us) 00:27:39.671 [2024-11-29T08:51:02.514Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:39.671 [2024-11-29T08:51:02.514Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:39.671 Verification LBA range: start 0x0 length 0x4000 00:27:39.671 Nvme1n1 : 15.05 9311.59 36.37 15924.11 0.00 5044.78 600.75 42913.94 00:27:39.671 [2024-11-29T08:51:02.514Z] =================================================================================================================== 00:27:39.671 [2024-11-29T08:51:02.514Z] Total : 9311.59 36.37 15924.11 0.00 5044.78 600.75 42913.94 00:27:39.671 09:51:01 -- host/bdevperf.sh@39 -- # sync 00:27:39.671 09:51:01 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:39.671 09:51:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:39.671 09:51:01 -- common/autotest_common.sh@10 -- # set +x 00:27:39.671 09:51:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:39.671 09:51:01 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:39.671 09:51:01 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:39.671 09:51:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:39.671 09:51:01 -- nvmf/common.sh@116 -- # sync 00:27:39.671 09:51:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:39.672 09:51:01 -- nvmf/common.sh@119 -- # set +e 00:27:39.672 09:51:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:39.672 09:51:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:39.672 rmmod nvme_tcp 00:27:39.672 rmmod nvme_fabrics 00:27:39.672 rmmod nvme_keyring 00:27:39.672 09:51:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:39.672 09:51:01 -- nvmf/common.sh@123 -- # set -e 00:27:39.672 09:51:01 -- nvmf/common.sh@124 -- # return 0 00:27:39.672 09:51:01 -- nvmf/common.sh@477 -- # '[' -n 145376 ']' 00:27:39.672 09:51:01 -- nvmf/common.sh@478 -- # killprocess 145376 00:27:39.672 09:51:01 -- common/autotest_common.sh@936 -- # '[' -z 145376 ']' 00:27:39.672 09:51:01 -- common/autotest_common.sh@940 -- # kill -0 145376 00:27:39.672 09:51:01 -- common/autotest_common.sh@941 -- # uname 00:27:39.672 09:51:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:39.672 09:51:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 145376 00:27:39.672 09:51:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:39.672 09:51:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:39.672 09:51:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 145376' 00:27:39.672 killing process with pid 145376 00:27:39.672 09:51:01 -- common/autotest_common.sh@955 -- # kill 145376 00:27:39.672 09:51:01 -- common/autotest_common.sh@960 -- # wait 145376 00:27:39.672 09:51:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:39.672 09:51:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:39.672 09:51:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:39.672 09:51:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:39.672 09:51:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:39.672 09:51:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:39.672 09:51:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:39.672 09:51:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:40.614 09:51:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:40.873 00:27:40.873 real 0m23.305s 00:27:40.874 user 1m3.541s 00:27:40.874 sys 0m3.982s 00:27:40.874 09:51:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:40.874 09:51:03 -- common/autotest_common.sh@10 -- # set +x 00:27:40.874 ************************************ 00:27:40.874 END TEST nvmf_bdevperf 00:27:40.874 ************************************ 00:27:40.874 09:51:03 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:40.874 09:51:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:40.874 09:51:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:40.874 09:51:03 -- common/autotest_common.sh@10 -- # set +x 00:27:40.874 ************************************ 00:27:40.874 START TEST nvmf_target_disconnect 00:27:40.874 ************************************ 00:27:40.874 09:51:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:40.874 * Looking for test storage... 00:27:40.874 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:40.874 09:51:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:40.874 09:51:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:40.874 09:51:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:40.874 09:51:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:40.874 09:51:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:40.874 09:51:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:40.874 09:51:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:40.874 09:51:03 -- scripts/common.sh@335 -- # IFS=.-: 00:27:40.874 09:51:03 -- scripts/common.sh@335 -- # read -ra ver1 00:27:40.874 09:51:03 -- scripts/common.sh@336 -- # IFS=.-: 00:27:40.874 09:51:03 -- scripts/common.sh@336 -- # read -ra ver2 00:27:40.874 09:51:03 -- scripts/common.sh@337 -- # local 'op=<' 00:27:40.874 09:51:03 -- scripts/common.sh@339 -- # ver1_l=2 00:27:40.874 09:51:03 -- scripts/common.sh@340 -- # ver2_l=1 00:27:40.874 09:51:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:40.874 09:51:03 -- scripts/common.sh@343 -- # case "$op" in 00:27:40.874 09:51:03 -- scripts/common.sh@344 -- # : 1 00:27:40.874 09:51:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:40.874 09:51:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:40.874 09:51:03 -- scripts/common.sh@364 -- # decimal 1 00:27:40.874 09:51:03 -- scripts/common.sh@352 -- # local d=1 00:27:40.874 09:51:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:40.874 09:51:03 -- scripts/common.sh@354 -- # echo 1 00:27:40.874 09:51:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:40.874 09:51:03 -- scripts/common.sh@365 -- # decimal 2 00:27:40.874 09:51:03 -- scripts/common.sh@352 -- # local d=2 00:27:40.874 09:51:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:40.874 09:51:03 -- scripts/common.sh@354 -- # echo 2 00:27:40.874 09:51:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:40.874 09:51:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:40.874 09:51:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:40.874 09:51:03 -- scripts/common.sh@367 -- # return 0 00:27:40.874 09:51:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:40.874 09:51:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:40.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:40.874 --rc genhtml_branch_coverage=1 00:27:40.874 --rc genhtml_function_coverage=1 00:27:40.874 --rc genhtml_legend=1 00:27:40.874 --rc geninfo_all_blocks=1 00:27:40.874 --rc geninfo_unexecuted_blocks=1 00:27:40.874 00:27:40.874 ' 00:27:40.874 09:51:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:40.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:40.874 --rc genhtml_branch_coverage=1 00:27:40.874 --rc genhtml_function_coverage=1 00:27:40.874 --rc genhtml_legend=1 00:27:40.874 --rc geninfo_all_blocks=1 00:27:40.874 --rc geninfo_unexecuted_blocks=1 00:27:40.874 00:27:40.874 ' 00:27:40.874 09:51:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:40.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:40.874 --rc genhtml_branch_coverage=1 00:27:40.874 --rc genhtml_function_coverage=1 00:27:40.874 --rc genhtml_legend=1 00:27:40.874 --rc geninfo_all_blocks=1 00:27:40.874 --rc geninfo_unexecuted_blocks=1 00:27:40.874 00:27:40.874 ' 00:27:40.874 09:51:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:40.874 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:40.874 --rc genhtml_branch_coverage=1 00:27:40.874 --rc genhtml_function_coverage=1 00:27:40.874 --rc genhtml_legend=1 00:27:40.874 --rc geninfo_all_blocks=1 00:27:40.874 --rc geninfo_unexecuted_blocks=1 00:27:40.874 00:27:40.874 ' 00:27:40.874 09:51:03 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:40.874 09:51:03 -- nvmf/common.sh@7 -- # uname -s 00:27:40.874 09:51:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:40.874 09:51:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:40.874 09:51:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:40.874 09:51:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:40.874 09:51:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:40.874 09:51:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:40.874 09:51:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:40.874 09:51:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:40.874 09:51:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:40.874 09:51:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:40.874 09:51:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:40.874 09:51:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:40.874 09:51:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:40.874 09:51:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:40.874 09:51:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:40.874 09:51:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:40.874 09:51:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:40.874 09:51:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:40.874 09:51:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:40.874 09:51:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.874 09:51:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.874 09:51:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.874 09:51:03 -- paths/export.sh@5 -- # export PATH 00:27:40.874 09:51:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.874 09:51:03 -- nvmf/common.sh@46 -- # : 0 00:27:40.874 09:51:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:40.874 09:51:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:40.874 09:51:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:40.874 09:51:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:40.874 09:51:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:40.874 09:51:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:40.874 09:51:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:40.874 09:51:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:40.874 09:51:03 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:40.874 09:51:03 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:40.874 09:51:03 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:40.874 09:51:03 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:40.874 09:51:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:40.874 09:51:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:40.874 09:51:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:40.874 09:51:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:40.874 09:51:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:40.874 09:51:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:40.874 09:51:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:40.874 09:51:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:40.874 09:51:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:40.874 09:51:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:40.874 09:51:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:40.874 09:51:03 -- common/autotest_common.sh@10 -- # set +x 00:27:42.777 09:51:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:42.777 09:51:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:42.777 09:51:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:42.777 09:51:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:42.777 09:51:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:42.777 09:51:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:42.777 09:51:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:42.777 09:51:05 -- nvmf/common.sh@294 -- # net_devs=() 00:27:42.777 09:51:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:42.777 09:51:05 -- nvmf/common.sh@295 -- # e810=() 00:27:42.777 09:51:05 -- nvmf/common.sh@295 -- # local -ga e810 00:27:42.777 09:51:05 -- nvmf/common.sh@296 -- # x722=() 00:27:42.777 09:51:05 -- nvmf/common.sh@296 -- # local -ga x722 00:27:42.777 09:51:05 -- nvmf/common.sh@297 -- # mlx=() 00:27:42.778 09:51:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:42.778 09:51:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:42.778 09:51:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:42.778 09:51:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:42.778 09:51:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:42.778 09:51:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:42.778 09:51:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:42.778 09:51:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:42.778 09:51:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:42.778 09:51:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:42.778 09:51:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:42.778 09:51:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:42.778 09:51:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:42.778 09:51:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:42.778 09:51:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:42.778 09:51:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:42.778 09:51:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:42.778 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:42.778 09:51:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:42.778 09:51:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:42.778 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:42.778 09:51:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:42.778 09:51:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:42.778 09:51:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:42.778 09:51:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:42.778 09:51:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:42.778 09:51:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:42.778 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:42.778 09:51:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:42.778 09:51:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:42.778 09:51:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:42.778 09:51:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:42.778 09:51:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:42.778 09:51:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:42.778 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:42.778 09:51:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:42.778 09:51:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:42.778 09:51:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:42.778 09:51:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:42.778 09:51:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:42.778 09:51:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:42.778 09:51:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:42.778 09:51:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:42.778 09:51:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:42.778 09:51:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:42.778 09:51:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:42.778 09:51:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:42.778 09:51:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:42.778 09:51:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:42.778 09:51:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:42.778 09:51:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:42.778 09:51:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:42.778 09:51:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:43.036 09:51:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:43.036 09:51:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:43.036 09:51:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:43.036 09:51:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:43.036 09:51:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:43.036 09:51:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:43.036 09:51:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:43.036 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:43.036 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:27:43.036 00:27:43.036 --- 10.0.0.2 ping statistics --- 00:27:43.036 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:43.036 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:27:43.036 09:51:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:43.036 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:43.036 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:27:43.036 00:27:43.036 --- 10.0.0.1 ping statistics --- 00:27:43.036 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:43.037 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:27:43.037 09:51:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:43.037 09:51:05 -- nvmf/common.sh@410 -- # return 0 00:27:43.037 09:51:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:43.037 09:51:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:43.037 09:51:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:43.037 09:51:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:43.037 09:51:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:43.037 09:51:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:43.037 09:51:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:43.037 09:51:05 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:43.037 09:51:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:43.037 09:51:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:43.037 09:51:05 -- common/autotest_common.sh@10 -- # set +x 00:27:43.037 ************************************ 00:27:43.037 START TEST nvmf_target_disconnect_tc1 00:27:43.037 ************************************ 00:27:43.037 09:51:05 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:43.037 09:51:05 -- host/target_disconnect.sh@32 -- # set +e 00:27:43.037 09:51:05 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:43.037 EAL: No free 2048 kB hugepages reported on node 1 00:27:43.037 [2024-11-29 09:51:05.822742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.037 [2024-11-29 09:51:05.822934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.037 [2024-11-29 09:51:05.822964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1158b40 with addr=10.0.0.2, port=4420 00:27:43.037 [2024-11-29 09:51:05.823001] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:43.037 [2024-11-29 09:51:05.823041] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:43.037 [2024-11-29 09:51:05.823055] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:43.037 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:43.037 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:43.037 Initializing NVMe Controllers 00:27:43.037 09:51:05 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:43.037 09:51:05 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:43.037 09:51:05 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:43.037 09:51:05 -- common/autotest_common.sh@1142 -- # return 0 00:27:43.037 09:51:05 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:43.037 09:51:05 -- host/target_disconnect.sh@41 -- # set -e 00:27:43.037 00:27:43.037 real 0m0.084s 00:27:43.037 user 0m0.032s 00:27:43.037 sys 0m0.052s 00:27:43.037 09:51:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:43.037 09:51:05 -- common/autotest_common.sh@10 -- # set +x 00:27:43.037 ************************************ 00:27:43.037 END TEST nvmf_target_disconnect_tc1 00:27:43.037 ************************************ 00:27:43.037 09:51:05 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:43.037 09:51:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:43.037 09:51:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:43.037 09:51:05 -- common/autotest_common.sh@10 -- # set +x 00:27:43.037 ************************************ 00:27:43.037 START TEST nvmf_target_disconnect_tc2 00:27:43.037 ************************************ 00:27:43.037 09:51:05 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:43.037 09:51:05 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:43.037 09:51:05 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:43.037 09:51:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:43.037 09:51:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:43.037 09:51:05 -- common/autotest_common.sh@10 -- # set +x 00:27:43.037 09:51:05 -- nvmf/common.sh@469 -- # nvmfpid=148646 00:27:43.037 09:51:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:43.037 09:51:05 -- nvmf/common.sh@470 -- # waitforlisten 148646 00:27:43.037 09:51:05 -- common/autotest_common.sh@829 -- # '[' -z 148646 ']' 00:27:43.037 09:51:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:43.037 09:51:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:43.037 09:51:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:43.037 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:43.037 09:51:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:43.037 09:51:05 -- common/autotest_common.sh@10 -- # set +x 00:27:43.296 [2024-11-29 09:51:05.909033] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:43.296 [2024-11-29 09:51:05.909114] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:43.296 EAL: No free 2048 kB hugepages reported on node 1 00:27:43.296 [2024-11-29 09:51:05.975475] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:43.296 [2024-11-29 09:51:06.081764] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:43.296 [2024-11-29 09:51:06.081923] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:43.296 [2024-11-29 09:51:06.081941] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:43.296 [2024-11-29 09:51:06.081953] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:43.296 [2024-11-29 09:51:06.082231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:43.296 [2024-11-29 09:51:06.082345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:43.296 [2024-11-29 09:51:06.082441] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:43.296 [2024-11-29 09:51:06.082444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:44.233 09:51:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:44.233 09:51:06 -- common/autotest_common.sh@862 -- # return 0 00:27:44.233 09:51:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:44.233 09:51:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:44.233 09:51:06 -- common/autotest_common.sh@10 -- # set +x 00:27:44.233 09:51:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:44.233 09:51:06 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:44.233 09:51:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.233 09:51:06 -- common/autotest_common.sh@10 -- # set +x 00:27:44.233 Malloc0 00:27:44.233 09:51:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.233 09:51:06 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:44.233 09:51:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.233 09:51:06 -- common/autotest_common.sh@10 -- # set +x 00:27:44.233 [2024-11-29 09:51:06.961229] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:44.233 09:51:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.233 09:51:06 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:44.233 09:51:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.233 09:51:06 -- common/autotest_common.sh@10 -- # set +x 00:27:44.233 09:51:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.233 09:51:06 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:44.233 09:51:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.233 09:51:06 -- common/autotest_common.sh@10 -- # set +x 00:27:44.233 09:51:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.233 09:51:06 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:44.233 09:51:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.233 09:51:06 -- common/autotest_common.sh@10 -- # set +x 00:27:44.233 [2024-11-29 09:51:06.989517] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:44.233 09:51:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.233 09:51:06 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:44.233 09:51:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.233 09:51:06 -- common/autotest_common.sh@10 -- # set +x 00:27:44.233 09:51:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.233 09:51:07 -- host/target_disconnect.sh@50 -- # reconnectpid=148819 00:27:44.233 09:51:07 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:44.233 09:51:07 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:44.233 EAL: No free 2048 kB hugepages reported on node 1 00:27:46.791 09:51:09 -- host/target_disconnect.sh@53 -- # kill -9 148646 00:27:46.791 09:51:09 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Write completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Write completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Write completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Write completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Write completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Read completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.791 Write completed with error (sct=0, sc=8) 00:27:46.791 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 [2024-11-29 09:51:09.014292] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 [2024-11-29 09:51:09.014635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Write completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 Read completed with error (sct=0, sc=8) 00:27:46.792 starting I/O failed 00:27:46.792 [2024-11-29 09:51:09.014973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:46.792 [2024-11-29 09:51:09.015141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.015282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.015309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.792 qpair failed and we were unable to recover it. 00:27:46.792 [2024-11-29 09:51:09.015461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.015563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.015589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.792 qpair failed and we were unable to recover it. 00:27:46.792 [2024-11-29 09:51:09.015705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.015799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.015824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.792 qpair failed and we were unable to recover it. 00:27:46.792 [2024-11-29 09:51:09.015922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.016049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.016075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.792 qpair failed and we were unable to recover it. 00:27:46.792 [2024-11-29 09:51:09.016208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.016300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.016326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.792 qpair failed and we were unable to recover it. 00:27:46.792 [2024-11-29 09:51:09.016441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.016540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.016567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.792 qpair failed and we were unable to recover it. 00:27:46.792 [2024-11-29 09:51:09.016666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.016802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.016828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.792 qpair failed and we were unable to recover it. 00:27:46.792 [2024-11-29 09:51:09.016961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.017117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.017142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.792 qpair failed and we were unable to recover it. 00:27:46.792 [2024-11-29 09:51:09.017298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.017410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.017436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.792 qpair failed and we were unable to recover it. 00:27:46.792 [2024-11-29 09:51:09.017546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.017650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.792 [2024-11-29 09:51:09.017676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.017768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.017915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.017941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.018045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.018162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.018187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.018304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.018420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.018447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.018547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.018651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.018677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.018827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.018977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.019003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.019121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.019284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.019318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.019466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.019579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.019605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.019725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.019827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.019853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.019986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.020107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.020133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.020291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.020384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.020418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.020545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.020683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.020709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.020838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.020960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.020986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.021139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.021268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.021294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.021431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.021554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.021581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.021694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.021850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.021875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.021971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.022066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.022097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.022221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.022344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.022371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.022469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.022591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.022617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.022753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.022911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.022937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.023056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.023166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.023195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.023323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.023462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.023489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.023610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.023725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.023751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.023850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.023948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.023975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.024128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.024256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.024282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.024487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.024586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.024612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.024716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.024812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.024859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.025001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.025140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.025165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.793 [2024-11-29 09:51:09.025291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.025418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.793 [2024-11-29 09:51:09.025444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.793 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.025591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.025725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.025751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.025853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.025943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.025968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.026117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.026271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.026297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.026416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.026541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.026567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.026662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.026767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.026792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.026921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.027023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.027051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.027150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.027277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.027306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.027461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.027557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.027582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.027721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.027807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.027832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.027920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.028034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.028059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.028176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.028277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.028302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.028412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.028504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.028529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.028661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.028825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.028854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.028949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.029081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.029124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.029229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.029337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.029366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.029499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.029629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.029654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.029751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.029847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.029873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.029963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.030089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.030114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.030265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.030356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.030381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.030483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.030603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.030631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.030774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.030911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.030938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.031082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.031262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.031287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.031381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.031489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.031515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.031611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.031703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.031729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.031853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.031935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.031959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.032065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.032204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.032238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.032358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.032457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.032483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.032588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.032721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.032745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.794 qpair failed and we were unable to recover it. 00:27:46.794 [2024-11-29 09:51:09.032844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.032968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.794 [2024-11-29 09:51:09.032993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.033104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.033196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.033220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.033334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.033466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.033493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.033591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.033738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.033765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.033897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.034002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.034030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.034171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.034271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.034297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.034431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.034548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.034574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.034672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.034786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.034811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.034903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.035027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.035052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.035142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.035254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.035281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.035415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.035543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.035569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.035702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.035837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.035862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.035996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.036147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.036174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.036280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.036378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.036415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.036539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.036630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.036656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.036769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.036858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.036884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.037030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.037132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.037160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.037379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.037491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.037518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.037613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.037707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.037732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.037855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.037959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.037987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.038118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.038226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.038260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.038370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.038529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.038554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.038653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.038809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.038835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.038967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.039088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.039113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.039237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.039318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.039343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.039464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.039556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.039581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.039680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.039796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.039821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.039938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.040075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.040103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.040271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.040365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.040390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.795 qpair failed and we were unable to recover it. 00:27:46.795 [2024-11-29 09:51:09.040493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.795 [2024-11-29 09:51:09.040613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.040638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.040741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.040867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.040912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.041064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.041214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.041239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.041423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.041550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.041574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.041664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.041830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.041857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.041987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.042090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.042117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.042252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.042417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.042458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.042547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.042649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.042689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.042779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.042936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.042960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.043091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.043236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.043264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.043370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.043521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.043548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.043654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.043751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.043776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.043915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.044058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.044083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.044203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.044292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.044318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.044479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.044571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.044596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.044723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.044818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.044845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.044967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.045100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.045130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.045231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.045366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.045390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.045495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.045642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.045666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.045796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.045907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.045947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.046036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.046162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.046187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.046336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.046479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.046505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.046603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.046740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.046782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.046906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.047002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.047027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.796 qpair failed and we were unable to recover it. 00:27:46.796 [2024-11-29 09:51:09.047113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.796 [2024-11-29 09:51:09.047236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.047260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.047353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.047494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.047520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.047615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.047747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.047772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.047885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.048009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.048033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.048129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.048264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.048291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.048413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.048533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.048560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.048662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.048775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.048801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.048946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.049036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.049063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.049182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.049363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.049389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.049487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.049583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.049608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.049750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.049852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.049878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.050043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.050183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.050210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.050358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.050482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.050508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.050596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.050808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.050834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.050981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.051092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.051119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.051270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.051358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.051382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.051563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.051670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.051712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.051849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.052025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.052050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.052175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.052299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.052328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.052488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.052608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.052635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.052801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.052926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.052951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.053072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.053162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.053186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.053279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.053429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.053455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.053546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.053651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.053693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.053811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.053933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.053958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.054127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.054258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.054286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.054411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.054522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.054550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.054672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.054790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.054815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.054918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.055015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.055039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.797 qpair failed and we were unable to recover it. 00:27:46.797 [2024-11-29 09:51:09.055141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.797 [2024-11-29 09:51:09.055257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.055282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.055419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.055513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.055539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.055631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.055756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.055781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.055879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.056025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.056051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.056177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.056304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.056330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.056417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.056535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.056560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.056649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.056776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.056800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.056905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.057026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.057051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.057164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.057261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.057286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.057413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.057511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.057536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.057638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.057762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.057787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.057952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.058090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.058114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.058240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.058328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.058352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.058486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.058605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.058630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.058751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.058898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.058926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.059020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.059139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.059166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.059286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.059444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.059470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.059568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.059652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.059676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.059823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.059948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.059973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.060095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.060222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.060247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.060399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.060531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.060557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.060678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.060799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.060825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.060947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.061072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.061098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.061274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.061419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.061449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.061555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.061672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.061700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.061849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.061945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.061969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.062155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.062253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.062278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.062390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.062492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.062516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.062641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.062765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.798 [2024-11-29 09:51:09.062790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.798 qpair failed and we were unable to recover it. 00:27:46.798 [2024-11-29 09:51:09.062963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.063061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.063088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.063218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.063344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.063369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.063491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.063588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.063613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.063751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.063888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.063915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.064062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.064163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.064191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.064332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.064430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.064455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.064596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.064706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.064731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.064896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.065026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.065066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.065220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.065382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.065415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.065544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.065666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.065692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.065788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.065906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.065931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.066055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.066175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.066205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.066352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.066471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.066499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.066633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.066770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.066797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.066931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.067045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.067070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.067199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.067302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.067329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.067456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.067602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.067627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.067775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.067900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.067925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.068070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.068215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.068243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.068340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.068450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.068480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.068627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.068768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.068794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.068947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.069038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.069071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.069188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.069302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.069327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.069447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.069544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.069570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.069696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.069811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.069836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.069959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.070082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.070107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.070229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.070325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.070351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.070455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.070537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.070563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.799 [2024-11-29 09:51:09.070664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.070750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.799 [2024-11-29 09:51:09.070790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.799 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.070960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.071055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.071080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.071207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.071326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.071352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.071485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.071579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.071604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.071713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.071802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.071827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.071917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.072006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.072030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.072112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.072231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.072255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.072375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.072504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.072530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.072631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.072799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.072828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.072934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.073095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.073122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.073227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.073369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.073415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.073555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.073675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.073703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.073832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.073940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.073969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.074083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.074209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.074234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.074365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.074494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.074523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.074629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.074740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.074768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.074902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.075019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.075043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.075204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.075364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.075391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.075513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.075639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.075667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.075793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.075944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.075969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.076109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.076244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.076273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.076420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.076524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.076549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.076637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.076770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.076795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.076923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.077006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.077032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.077179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.077324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.077353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.077494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.077620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.077645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.077764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.077886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.077911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.078052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.078221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.078248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.800 qpair failed and we were unable to recover it. 00:27:46.800 [2024-11-29 09:51:09.078363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.078457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.800 [2024-11-29 09:51:09.078483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.078607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.078760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.078785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.078885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.079001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.079026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.079189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.079313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.079339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.079461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.079586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.079611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.079723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.079851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.079892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.080006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.080123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.080148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.080245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.080365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.080389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.080514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.080615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.080640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.080776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.080901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.080926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.081019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.081112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.081138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.081239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.081382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.081434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.081534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.081660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.081685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.081812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.081910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.081935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.082049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.082137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.082162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.082249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.082402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.082428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.082547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.082717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.082749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.082912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.083040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.083080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.083169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.083289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.083314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.083470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.083601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.083629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.083807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.083916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.083942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.084059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.084181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.084205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.084345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.084486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.084514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.084646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.084754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.084782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.084927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.085055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.085080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.085178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.085334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.085359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.801 qpair failed and we were unable to recover it. 00:27:46.801 [2024-11-29 09:51:09.085512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.801 [2024-11-29 09:51:09.085622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.085651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.085769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.085888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.085913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.086013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.086104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.086129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.086226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.086352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.086401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.086543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.086689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.086714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.086858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.086995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.087019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.087147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.087302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.087329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.087460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.087557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.087581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.087736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.087892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.087917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.088011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.088110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.088135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.088257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.088373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.088405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.088577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.088707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.088733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.088824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.088919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.088943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.089039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.089136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.089162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.089287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.089477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.089503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.089626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.089740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.089767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.089884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.090012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.090037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.090136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.090276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.090304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.090487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.090586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.090610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.090744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.090839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.090863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.090956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.091067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.091095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.091229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.091334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.091362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.091490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.091638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.091664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.091814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.091937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.091962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.092082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.092201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.092225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.092355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.092486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.092511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.092614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.092758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.092783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.092916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.093051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.093078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.093224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.093319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.802 [2024-11-29 09:51:09.093344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.802 qpair failed and we were unable to recover it. 00:27:46.802 [2024-11-29 09:51:09.093470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.093593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.093618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.093716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.093808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.093849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.093967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.094070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.094095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.094192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.094310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.094335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.094491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.094653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.094681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.094843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.094964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.094991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.095113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.095198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.095223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.095352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.095448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.095491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.095613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.095716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.095743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.095916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.096050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.096092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.096215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.096303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.096328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.096462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.096554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.096579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.096676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.096778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.096808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.096930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.097130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.097155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.097245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.097330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.097355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.097542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.097662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.097687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.097808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.097956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.097982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.098103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.098227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.098268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.098428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.098552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.098577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.098704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.098826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.098850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.098942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.099067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.099091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.099185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.099274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.099300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.099388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.099571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.099597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.099727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.099853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.099878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.099970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.100090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.100116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.100243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.100361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.100385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.100525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.100644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.100669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.100809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.100906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.100934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.803 [2024-11-29 09:51:09.101073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.101166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.803 [2024-11-29 09:51:09.101194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.803 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.101365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.101517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.101543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.101664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.101787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.101812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.101936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.102059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.102085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.102205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.102350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.102374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.102495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.102612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.102636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.102781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.102891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.102932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.103031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.103145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.103170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.103264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.103423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.103466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.103569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.103666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.103699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.103820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.103933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.103958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.104056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.104183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.104210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.104309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.104456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.104481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.104578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.104711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.104736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.104853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.104936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.104961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.105116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.105289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.105318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.105472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.105598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.105622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.105731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.105833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.105858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.105946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.106042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.106068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.106226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.106327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.106352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.106461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.106609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.106634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.106792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.106878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.106905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.107016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.107123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.107147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.107238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.107336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.107361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.107482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.107600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.107624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.107788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.107913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.107955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.108095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.108217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.108243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.108364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.108500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.108526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.108626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.108758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.108783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.804 [2024-11-29 09:51:09.108933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.109021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.804 [2024-11-29 09:51:09.109046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.804 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.109173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.109266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.109291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.109374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.109514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.109539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.109665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.109821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.109850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.109959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.110111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.110136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.110260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.110405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.110434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.110552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.110648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.110679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.110771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.110886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.110911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.111004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.111125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.111149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.111278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.111434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.111463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.111640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.111772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.111797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.111920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.112013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.112037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.112157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.112240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.112266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.112366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.112501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.112526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.112629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.112728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.112754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.112886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.113021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.113049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.113158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.113267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.113297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.113475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.113599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.113624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.113793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.113894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.113922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.114020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.114167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.114191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.114307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.114464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.114490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.114671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.114817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.114842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.114991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.115133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.115163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.115329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.115483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.115508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.115664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.115769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.115797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.115957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.116089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.116117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.805 qpair failed and we were unable to recover it. 00:27:46.805 [2024-11-29 09:51:09.116243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.805 [2024-11-29 09:51:09.116336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.116361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.116492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.116584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.116609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.116726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.116840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.116865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.116992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.117104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.117129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.117268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.117426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.117455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.117591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.117710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.117738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.117900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.118014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.118040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.118165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.118305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.118331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.118514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.118617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.118642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.118743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.118890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.118914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.119023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.119123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.119151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.119248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.119356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.119383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.119533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.119654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.119678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.119789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.119925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.119965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.120088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.120224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.120248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.120402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.120514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.120538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.120652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.120792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.120817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.120921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.121018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.121042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.121138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.121256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.121281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.121434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.121580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.121604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.121756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.121851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.121875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.121997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.122121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.122147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.122283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.122389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.122438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.122561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.122660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.122688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.122788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.122911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.122935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.123032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.123171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.123198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.123315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.123420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.123449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.123573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.123663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.123687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.123799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.123933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.806 [2024-11-29 09:51:09.123960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.806 qpair failed and we were unable to recover it. 00:27:46.806 [2024-11-29 09:51:09.124073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.124221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.124246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.124346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.124492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.124517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.124665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.124825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.124858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.124991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.125132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.125156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.125272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.125420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.125445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.125544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.125685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.125709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.125818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.125957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.125985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.126127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.126263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.126289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.126424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.126569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.126597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.126733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.126864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.126892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.127044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.127168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.127193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.127284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.127385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.127414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.127539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.127633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.127662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.127781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.127901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.127926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.128022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.128141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.128169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.128315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.128441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.128466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.128565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.128687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.128714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.128850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.128991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.129019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.129156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.129267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.129291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.129423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.129528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.129553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.129689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.129822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.129849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.130004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.130125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.130150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.130301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.130410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.130438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.130591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.130727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.130755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.130864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.131006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.131030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.131155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.131280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.131305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.131414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.131511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.131555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.131664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.131809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.131834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.807 qpair failed and we were unable to recover it. 00:27:46.807 [2024-11-29 09:51:09.131966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.807 [2024-11-29 09:51:09.132091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.132116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.132202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.132302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.132327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.132488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.132607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.132631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.132764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.132883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.132908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.133041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.133170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.133198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.133370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.133511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.133539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.133686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.133831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.133856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.133945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.134041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.134066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.134191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.134366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.134398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.134580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.134678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.134703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.134847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.135007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.135032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.135160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.135256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.135300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.135428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.135581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.135606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.135722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.135840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.135867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.135972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.136113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.136154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.136272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.136372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.136412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.136532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.136631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.136675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.136822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.136957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.136984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.137154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.137254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.137278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.137423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.137583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.137611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.137745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.137877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.137905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.138035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.138154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.138179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.138314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.138421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.138451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.138555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.138668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.138693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.138797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.138886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.138911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.139032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.139154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.139180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.139359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.139479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.139509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.139657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.139802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.139826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.139972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.140108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.808 [2024-11-29 09:51:09.140133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.808 qpair failed and we were unable to recover it. 00:27:46.808 [2024-11-29 09:51:09.140236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.140324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.140349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.140461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.140560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.140584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.140734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.140881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.140906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.141010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.141129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.141153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.141258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.141357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.141381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.141510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.141660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.141684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.141840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.141983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.142016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.142159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.142308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.142349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.142517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.142650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.142678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.142827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.142910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.142935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.143064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.143217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.143242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.143427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.143546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.143570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.143688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.143856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.143911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.144052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.144207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.144234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.144352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.144478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.144503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.144613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.144750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.144775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.144899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.145021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.145047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.145175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.145308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.145336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.145493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.145589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.145614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.145719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.145840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.145864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.145982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.146126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.146150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.146300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.146459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.146499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.146624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.146746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.146771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.146939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.147037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.147065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.147181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.147308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.147336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.147476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.147636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.147664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.147803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.147925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.147949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.148095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.148204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.148231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.809 [2024-11-29 09:51:09.148399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.148534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.809 [2024-11-29 09:51:09.148562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.809 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.148682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.148778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.148803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.148952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.149044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.149069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.149210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.149327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.149355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.149488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.149613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.149638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.149811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.149975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.150000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.150137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.150263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.150289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.150379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.150496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.150525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.150713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.150948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.151004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.151138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.151307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.151335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.151510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.151633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.151657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.151757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.151890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.151918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.152085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.152200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.152227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.152370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.152495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.152523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.152642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.152755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.152780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.152926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.153068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.153096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.153234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.153366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.153403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.153544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.153654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.153679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.153777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.153902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.153927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.154047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.154173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.154198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.154315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.154450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.154480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.154618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.154744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.154788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.154937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.155057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.155082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.155204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.155319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.155344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.155475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.155593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.155621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.810 [2024-11-29 09:51:09.155726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.155879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.810 [2024-11-29 09:51:09.155907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.810 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.156047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.156169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.156194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.156331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.156479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.156507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.156626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.156760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.156788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.156966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.157111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.157141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.157312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.157460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.157487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.157640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.157738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.157763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.157901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.158056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.158084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.158240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.158363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.158390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.158506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.158626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.158651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.158749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.158867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.158891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.159026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.159158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.159186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.159291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.159450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.159476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.159575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.159689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.159713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.159860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.160015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.160043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.160181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.160311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.160339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.160484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.160583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.160611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.160782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.160905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.160930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.161083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.161210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.161235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.161398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.161538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.161567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.161675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.161778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.161807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.161981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.162076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.162103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.162228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.162326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.162350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.162449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.162576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.162602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.162763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.162879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.162904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.163017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.163140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.163165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.163281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.163461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.163487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.163644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.163788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.163816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.163947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.164073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.164101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.811 qpair failed and we were unable to recover it. 00:27:46.811 [2024-11-29 09:51:09.164212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.811 [2024-11-29 09:51:09.164337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.164361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.164461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.164609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.164633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.164819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.164913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.164938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.165056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.165179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.165205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.165319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.165450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.165478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.165618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.165786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.165814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.165953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.166072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.166097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.166189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.166315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.166339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.166479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.166605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.166629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.166755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.166919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.166946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.167078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.167252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.167278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.167358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.167526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.167553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.167675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.167796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.167820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.167963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.168078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.168105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.168266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.168406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.168435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.168575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.168714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.168741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.168910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.169077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.169105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.169238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.169337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.169364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.169537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.169675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.169700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.169842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.169943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.169970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.170113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.170237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.170263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.170452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.170550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.170576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.170670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.170763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.170789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.170910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.171038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.171068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.171202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.171352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.171378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.171505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.171597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.171622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.171743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.171865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.171894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.172062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.172218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.172243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.172409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.172544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.812 [2024-11-29 09:51:09.172569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.812 qpair failed and we were unable to recover it. 00:27:46.812 [2024-11-29 09:51:09.172672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.172765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.172789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.172938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.173096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.173124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.173297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.173418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.173442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.173539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.173655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.173681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.173786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.173900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.173926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.174074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.174250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.174278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.174432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.174529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.174555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.174656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.174806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.174835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.174957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.175058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.175099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.175228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.175371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.175417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.175590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.175748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.175773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.175874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.175969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.175994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.176134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.176308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.176333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.176465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.176636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.176664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.176777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.176895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.176920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.177016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.177110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.177134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.177275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.177435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.177459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.177586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.177714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.177739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.177839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.177958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.177983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.178065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.178180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.178204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.178303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.178421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.178450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.178605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.178760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.178784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.178908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.179032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.179057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.179186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.179310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.179334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.179466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.179558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.179582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.179723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.179883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.179911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.180062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.180191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.180217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.180313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.180426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.180452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.813 [2024-11-29 09:51:09.180602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.180720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.813 [2024-11-29 09:51:09.180748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.813 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.180891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.181014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.181040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.181178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.181286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.181313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.181449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.181551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.181576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.181681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.181802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.181826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.181946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.182103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.182127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.182273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.182370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.182403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.182556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.182660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.182684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.182806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.182944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.182972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.183108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.183238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.183265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.183377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.183522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.183550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.183694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.183791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.183816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.183952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.184073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.184097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.184280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.184416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.184443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.184537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.184709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.184735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.184861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.184986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.185011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.185129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.185262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.185290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.185427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.185527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.185554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.185700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.185822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.185846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.185974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.186095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.186119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.186265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.186399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.186427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.186561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.186663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.186691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.186796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.186964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.186988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.187080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.187200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.187224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.187340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.187493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.187519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.187613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.187730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.187754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.814 qpair failed and we were unable to recover it. 00:27:46.814 [2024-11-29 09:51:09.187856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.814 [2024-11-29 09:51:09.187971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.187998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.188151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.188250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.188275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.188370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.188502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.188528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.188652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.188812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.188840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.188972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.189111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.189141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.189241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.189369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.189413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.189540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.189643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.189672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.189782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.189940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.189967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.190109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.190240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.190267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.190419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.190522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.190547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.190662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.190807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.190833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.190948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.191084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.191111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.191245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.191350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.191390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.191497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.191588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.191612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.191730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.191838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.191866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.192004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.192143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.192171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.192305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.192424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.192454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.192576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.192678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.192703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.192793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.192937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.192978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.193151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.193275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.193300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.193426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.193532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.193557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.193680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.193773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.193798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.193908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.194008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.194036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.194140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.194257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.194284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.194458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.194546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.194571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.194676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.194830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.194855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.195011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.195157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.195199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.195351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.195454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.195482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.815 [2024-11-29 09:51:09.195632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.195761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.815 [2024-11-29 09:51:09.195787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.815 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.195918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.196012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.196037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.196138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.196253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.196294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.196404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.196531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.196558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.196665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.196793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.196822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.196947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.197073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.197098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.197240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.197405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.197434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.197620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1077600 is same with the state(5) to be set 00:27:46.816 [2024-11-29 09:51:09.197877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.198050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.198079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.198193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.198306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.198334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.198472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.198598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.198624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.198799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.198947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.198974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.199117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.199241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.199267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.199367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.199503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.199531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.199683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.199793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.199819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.199942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.200043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.200072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.200192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.200324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.200352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.200480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.200612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.200640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.200787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.200908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.200933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.201083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.201180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.201207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.201306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.201479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.201508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.201609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.201736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.201761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.201898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.202050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.202077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.202222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.202348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.202374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.202480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.202575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.202600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.202765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.202886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.202913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.203046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.203136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.203164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.203334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.203438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.203480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.203632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.203804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.203834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.203996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.204134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.204160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.816 qpair failed and we were unable to recover it. 00:27:46.816 [2024-11-29 09:51:09.204277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.816 [2024-11-29 09:51:09.204372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.204402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.204531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.204676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.204703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.204845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.204992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.205019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.205119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.205217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.205241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.205368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.205520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.205547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.205681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.205839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.205867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.206014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.206129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.206154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.206264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.206428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.206455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.206554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.206651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.206677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.206831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.206926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.206952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.207052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.207181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.207206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.207320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.207456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.207484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.207633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.207782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.207807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.207946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.208092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.208119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.208224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.208328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.208354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.208475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.208572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.208597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.208695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.208802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.208833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.208972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.209113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.209139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.209301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.209443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.209470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.209565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.209656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.209680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.209799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.209925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.209951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.210092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.210185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.210210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.210323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.210439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.210467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.210561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.210661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.210688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.210824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.210948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.210972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.211084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.211194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.211221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.211321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.211441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.211469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.211590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.211681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.211705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.211826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.211943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.817 [2024-11-29 09:51:09.211979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.817 qpair failed and we were unable to recover it. 00:27:46.817 [2024-11-29 09:51:09.212083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.212207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.212233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.212351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.212450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.212476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.212572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.212691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.212718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.212863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.212994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.213018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.213136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.213260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.213284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.213420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.213519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.213545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.213649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.213739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.213765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.213914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.214010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.214035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.214134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.214228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.214253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.214380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.214498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.214525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.214619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.214743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.214768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.214885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.215000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.215024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.215107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.215201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.215225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.215390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.215486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.215511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.215606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.215734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.215759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.215853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.215970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.215995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.216097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.216217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.216242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.216339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.216475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.216501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.216598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.216691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.216715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.216811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.216919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.216944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.217042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.217187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.217213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.217328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.217475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.217507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.217619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.217744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.217778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.217927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.218054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.218082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.218206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.218342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.218370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.218497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.218599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.218626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.218789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.218911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.218938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.219062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.219171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.219198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.818 qpair failed and we were unable to recover it. 00:27:46.818 [2024-11-29 09:51:09.219352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.219458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.818 [2024-11-29 09:51:09.219485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.219575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.219678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.219704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Write completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Write completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Write completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Write completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Write completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Write completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Write completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Write completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Write completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Write completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Write completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Write completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Write completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Write completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 Read completed with error (sct=0, sc=8) 00:27:46.819 starting I/O failed 00:27:46.819 [2024-11-29 09:51:09.220037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:46.819 [2024-11-29 09:51:09.220146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.220310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.220336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.220451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.220552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.220576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.220682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.220804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.220828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.220924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.221044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.221071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.221196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.221286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.221310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.221414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.221515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.221540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.221632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.221732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.221757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.221888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.221972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.221997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.222089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.222257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.222300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.222386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.222485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.222510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.222597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.222721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.222746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.222863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.223007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.223034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.223162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.223285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.223326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.223427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.223513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.223537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.223633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.223746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.819 [2024-11-29 09:51:09.223775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.819 qpair failed and we were unable to recover it. 00:27:46.819 [2024-11-29 09:51:09.223936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.224070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.224095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.224222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.224353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.224378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.224522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.224617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.224642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.224745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.224840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.224864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.224990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.225116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.225141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.225236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.225329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.225354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.225477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.225571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.225597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.225722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.225840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.225864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.225957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.226054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.226079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.226225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.226315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.226340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.226439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.226535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.226565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.226667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.226790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.226814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.226959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.227082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.227109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.227282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.227435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.227460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.227546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.227644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.227669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.227783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.227886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.227910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.228639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.228757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.228784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.228932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.229070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.229099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.229237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.229371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.229418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.229523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.229618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.229643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.229740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.229837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.229866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.229998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.230117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.230141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.230244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.230338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.230363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.230486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.230586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.230611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.230777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.230923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.230948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.231096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.231210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.231235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.231348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.231446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.231471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.231564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.231684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.231712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.820 qpair failed and we were unable to recover it. 00:27:46.820 [2024-11-29 09:51:09.231841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.231959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.820 [2024-11-29 09:51:09.231984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.232140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.232258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.232283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.232425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.232524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.232549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.232637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.232738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.232762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.232910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.233043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.233068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.233196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.233291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.233315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.233415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.233540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.233564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.233667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.233762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.233786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.233910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.234007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.234032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.234157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.234256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.234281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.234377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.234480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.234505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.234626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.234726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.234751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.234871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.234963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.234988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.235119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.235214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.235238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.235327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.235436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.235460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.235561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.235681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.235711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.235809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.235936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.235962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.236069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.236183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.236208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.236372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.236487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.236513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.236608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.236743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.236768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.236897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.237017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.237043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.237165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.237252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.237277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.237399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.237515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.237541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.237630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.237750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.237779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.237869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.237990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.238016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.238112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.238232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.238258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.238376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.238516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.238542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.238689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.238799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.238826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.238916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.239010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.239036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.821 qpair failed and we were unable to recover it. 00:27:46.821 [2024-11-29 09:51:09.239159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.821 [2024-11-29 09:51:09.239306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.239336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.239552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.239682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.239708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.239862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.239974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.240002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.240174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.240302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.240345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.240464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.240558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.240585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.240731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.240883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.240912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.241072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.241205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.241247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.241406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.241609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.241635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.241811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.241965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.241991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.242109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.242207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.242235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.242324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.242436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.242464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.242591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.242685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.242721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.242851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.242958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.242984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.243115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.243216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.243242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.243344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.243496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.243522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.243615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.243706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.243731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.243890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.244015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.244042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.244189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.244283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.244309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.244434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.244526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.244551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.244658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.244785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.244810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.244965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.245101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.245126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.245256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.245353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.245378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.245477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.245564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.245591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.245687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.245816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.245841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.245993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.246117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.246152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.246277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.246369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.246403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.246617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.246735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.246761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.246916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.247008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.247033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.247141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.247263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.822 [2024-11-29 09:51:09.247289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.822 qpair failed and we were unable to recover it. 00:27:46.822 [2024-11-29 09:51:09.247415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.247519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.247544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.247668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.247864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.247889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.247989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.248114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.248140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.248235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.248345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.248372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.248485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.248585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.248611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.248739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.248859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.248889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.249006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.249101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.249126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.249294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.249400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.249427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.249531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.249665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.249691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.249841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.249949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.249975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.250094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.250212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.250237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.250391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.250503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.250528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.250619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.250753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.250779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.250901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.251004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.251030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.251159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.251254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.251279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.251379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.251490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.251519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.251621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.251754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.251780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.251875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.251977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.252004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.252105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.252274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.252299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.252426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.252553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.252579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.252671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.252814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.252839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.252969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.253120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.253145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.253250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.253374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.253416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.253541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.253668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.253694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.253815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.253905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.253930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.254012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.254129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.254159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.254266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.254353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.254378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.254505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.254607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.823 [2024-11-29 09:51:09.254633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.823 qpair failed and we were unable to recover it. 00:27:46.823 [2024-11-29 09:51:09.254751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.254880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.254906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.255005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.255157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.255182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.255280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.255431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.255457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.255546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.255634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.255660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.255811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.255941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.255968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.256094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.256244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.256269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.256375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.256492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.256517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.256612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.256702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.256727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.256865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.256983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.257008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.257125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.257282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.257307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.257423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.257543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.257568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.257660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.257798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.257824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.257949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.258040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.258065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.258181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.258326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.258363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.258504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.258599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.258624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.258733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.258830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.258855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.258940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.259059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.259083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.259227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.259342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.259367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.259485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.259607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.259634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.259741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.259864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.259891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.259985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.260075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.260101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.260242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.260375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.260422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.260550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.260638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.260665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.260778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.260901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.260926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.261021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.261227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.261254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.824 [2024-11-29 09:51:09.261354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.261519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.824 [2024-11-29 09:51:09.261546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.824 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.261639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.262553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.262584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.262715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.262835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.262861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.262994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.263114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.263140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.263265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.263363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.263390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.263503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.263588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.263613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.263705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.263831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.263856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.263943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.264033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.264059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.264207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.264294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.264319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.264426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.264527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.264552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.264660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.264790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.264814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.264958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.265093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.265121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.265239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.265372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.265425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.265538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.265636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.265661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.265760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.265882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.265907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.266028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.266146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.266171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.266268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.266387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.266425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.266521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.266646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.266671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.266768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.266920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.266945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.267071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.267198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.267228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.267337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.267490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.267516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.267624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.267832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.267857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.267994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.268132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.268157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.268311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.268438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.268465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.268569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.268686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.268715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.268813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.268929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.268971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.269084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.269199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.269226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.269374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.269488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.269515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.269607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.269703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.269728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.825 qpair failed and we were unable to recover it. 00:27:46.825 [2024-11-29 09:51:09.269825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.825 [2024-11-29 09:51:09.269948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.269974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.270095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.270188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.270213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.270341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.270450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.270475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.270602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.270696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.270721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.270821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.270932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.270968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.271094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.271251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.271277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.271372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.271472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.271498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.271584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.271719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.271746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.271831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.272042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.272068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.272182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.272324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.272367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.272481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.272584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.272610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.272721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.272825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.272852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.272974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.273064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.273090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.273239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.273382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.273449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.273550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.273646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.273672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.273875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.274070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.274095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.274301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.274465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.274491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.274595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.274695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.274722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.274818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.274909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.274934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.275090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.275185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.275212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.275333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.275458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.275485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.275608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.275731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.275760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.275924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.276021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.276047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.276150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.276236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.276278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.276435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.276538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.276564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.276679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.276829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.276855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.276952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.277101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.277129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.277252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.277353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.277442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.277570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.277669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.826 [2024-11-29 09:51:09.277695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.826 qpair failed and we were unable to recover it. 00:27:46.826 [2024-11-29 09:51:09.277868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.278021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.278051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.278157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.278246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.278272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.278410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.278515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.278541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.278643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.278741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.278767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.278848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.278968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.278995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.279088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.279186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.279212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.279339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.279450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.279477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.279578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.279726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.279757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.279903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.280007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.280037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.280147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.280266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.280292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.280463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.280586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.280611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.280730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.280848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.280874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.281027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.281150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.281178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.281339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.281541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.281567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.281663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.281819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.281845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.281944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.282109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.282136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.282326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.282424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.282451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.282548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.286411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.286465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.286631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.286798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.286828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.286965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.287119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.287147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.287254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.287354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.287383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.287517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.287615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.287642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.287797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.287952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.287980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.288118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.288272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.288299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.288449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.288557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.288583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.288750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.288898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.288928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.289093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.289217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.289244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.289420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.289532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.289558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.827 qpair failed and we were unable to recover it. 00:27:46.827 [2024-11-29 09:51:09.289698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.827 [2024-11-29 09:51:09.289826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.289852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.289963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.290118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.290146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.290269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.290402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.290428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.290537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.290633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.290658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.290763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.290889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.290916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.291046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.291148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.291176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.291377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.291510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.291536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.291647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.292407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.292434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.292541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.292641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.292669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.293431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.293542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.293576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.293719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.293879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.293915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.294057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.294217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.294249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.294430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.294541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.294574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.294712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.294849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.294884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.295036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.295167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.295200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.295316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.295478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.295512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.295681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.295812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.295847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.296022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.296188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.296245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.296388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.296497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.296530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.296651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.296803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.296837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.296992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.297106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.297141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.297365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.297501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.297535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.297666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.297814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.297851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.297985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.298106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.298141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.298277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.298402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.298436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.828 [2024-11-29 09:51:09.298574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.298690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.828 [2024-11-29 09:51:09.298724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.828 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.298836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.298950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.298984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.299114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.299235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.299276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.299445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.299588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.299637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.299779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.299958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.299991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.300107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.300270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.300301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.300451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.300633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.300677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.300815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.300957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.300983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.301086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.301188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.301215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.301314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.301453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.301487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.301593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.301712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.301743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.301841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.301965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.301991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.302093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.302218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.302249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.302347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.302483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.302510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.302611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.302767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.302794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.302924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.303050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.303075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.303194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.303317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.303342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.303457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.303584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.303610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.303712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.303819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.303845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.303936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.304033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.304061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.304189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.304331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.304361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.304505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.304616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.304643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.304760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.304896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.304927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.305056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.305204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.305231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.305344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.305471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.305499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.305610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.305735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.305771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.305866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.305975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.306001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.306092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.306217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.306250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.306424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.306522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.306554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.829 qpair failed and we were unable to recover it. 00:27:46.829 [2024-11-29 09:51:09.306643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.829 [2024-11-29 09:51:09.306753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.306779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.306908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.307006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.307032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.307156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.307273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.307299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.307405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.307532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.307562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.307667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.307801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.307827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.307951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.308068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.308094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.308219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.308366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.308403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.308510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.308625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.308652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.308777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.308903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.308929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.309055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.309159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.309185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.309287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.309436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.309464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.309568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.309664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.309692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.309824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.309943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.309969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.310071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.310191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.310217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.310321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.310448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.310475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.310602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.310727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.310753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.310853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.310977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.311003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.311103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.311192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.311218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.311372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.311511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.311539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.311633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.311731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.311757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.311855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.311947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.311973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.312069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.312193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.312218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.312351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.312462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.312493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.312595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.312688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.312714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.312876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.312963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.312989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.313118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.313215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.313241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.313370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.313473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.313501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.313619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.313724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.313751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.830 [2024-11-29 09:51:09.313885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.313982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.830 [2024-11-29 09:51:09.314009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.830 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.314102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.314224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.314255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.314356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.314474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.314501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.314631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.314763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.314789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.314885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.314982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.315008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.315131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.315266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.315293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.315388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.315523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.315550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.315754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.315874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.315899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.315994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.316088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.316114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.316237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.316391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.316426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.316525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.316620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.316646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.316792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.316887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.316913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.317068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.317202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.317241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.317368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.317493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.317522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.317647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.317775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.317801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.317927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.318050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.318076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.318198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.318322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.318349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.318467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.318556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.318582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.318708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.318849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.318874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.319009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.319104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.319131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.319273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.319423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.319455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.319558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.319657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.319685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.319784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.319878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.319906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.319998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.320149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.320175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.320326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.320433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.320460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.320583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.320702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.320730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.320859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.320957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.320984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.321103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.321235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.321262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.321402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.321524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.321551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.321650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.321804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.321831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.831 [2024-11-29 09:51:09.321930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.322055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.831 [2024-11-29 09:51:09.322082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.831 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.322172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.322267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.322294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.322466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.322605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.322631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.322768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.322894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.322920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.323052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.323170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.323196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.323331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.323488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.323515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.323613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.323713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.323741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.323895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.324017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.324043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.324167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.324293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.324319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.324448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.324574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.324603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.324775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.324898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.324924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.325061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.325182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.325208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.325344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.325456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.325485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.325616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.325765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.325808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.325933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.326064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.326090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.326180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.326283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.326310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.326451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.326557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.326583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.326707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.326796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.326823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.326946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.327042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.327068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.327191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.327320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.327346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.327467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.327558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.327588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.327691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.327813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.327840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.327993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.328114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.328139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.328245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.328364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.328390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.328504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.328597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.328623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.328755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.328871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.328896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.328997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.329092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.329118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.329219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.329315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.329343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.329452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.329587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.329613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.329713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.329817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.329843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.329940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.330039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.330065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.832 qpair failed and we were unable to recover it. 00:27:46.832 [2024-11-29 09:51:09.330162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.330259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.832 [2024-11-29 09:51:09.330286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.330412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.330535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.330561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.330655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.330747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.330776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.330909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.331026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.331053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.331181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.331269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.331295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.331432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.331559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.331586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.331689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.331779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.331809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.331950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.332088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.332115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.332218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.332315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.332340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.332477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.332576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.332602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.332699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.332828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.332855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.332977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.333084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.333110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.333235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.333357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.333384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.333497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.333592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.333618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.333725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.333839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.333868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.333990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.334116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.334144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.334273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.334399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.334425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.334524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.334625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.334652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.334768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.334889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.334919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.335015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.335114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.335141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.335251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.335342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.335367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.335464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.335549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.335573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.335665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.335789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.335814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.335915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.336050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.336082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.336203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.336297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.336323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.336467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.336569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.336601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.336722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.336884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.336912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.337069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.337220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.337245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.833 qpair failed and we were unable to recover it. 00:27:46.833 [2024-11-29 09:51:09.337340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.833 [2024-11-29 09:51:09.337442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.337469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.337569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.337672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.337707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.337826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.337957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.337982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.338072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.338175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.338201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.338327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.338467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.338493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.338640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.338751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.338778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.338882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.339004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.339028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.339123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.339219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.339263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.339382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.339506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.339531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.339633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.339756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.339781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.339895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.340000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.340027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.340171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.340307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.340332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.340449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.340550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.340575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.340715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.340854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.340883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.341016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.341167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.341193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.341345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.341494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.341520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.341647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.341741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.341768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.341868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.341975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.342004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.342109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.342239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.342279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.342402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.342530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.342555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.342693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.342788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.342815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.342933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.343022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.343049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.343175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.343303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.343328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.343422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.343541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.343567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.343687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.343774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.343799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.343894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.343999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.344025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.344157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.344277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.344303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.344427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.344517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.344543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.344660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.344776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.344818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.344958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.345101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.345129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.345257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.345352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.345398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.345492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.345595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.345620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.834 [2024-11-29 09:51:09.345730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.345836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.834 [2024-11-29 09:51:09.345861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.834 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.345957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.346072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.346098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.346214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.346316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.346344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.346496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.346590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.346615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.346746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.346874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.346899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.347014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.347149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.347190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.347291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.347426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.347451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.347597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.347703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.347731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.347898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.348015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.348040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.348180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.348293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.348319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.348421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.348552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.348577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.348673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.348784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.348812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.348949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.349082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.349111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.349238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.349363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.349388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.349527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.349615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.349640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.349753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.349880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.349906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.349990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.350105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.350134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.350297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.350414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.350440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.350533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.350628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.350653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.350742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.350832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.350858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.350948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.351064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.351090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.351218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.351303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.351329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.351455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.351541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.351567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.351694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.351786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.351827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.351949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.352068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.352096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.352217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.352310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.352336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.352442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.352571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.352603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.352708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.352802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.352828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.352931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.353054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.353079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.353174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.353263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.353287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.353426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.353520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.353544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.353664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.353802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.353829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.353965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.354113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.354139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.354234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.354329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.354356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.835 qpair failed and we were unable to recover it. 00:27:46.835 [2024-11-29 09:51:09.354462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.835 [2024-11-29 09:51:09.354586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.354612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.354712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.354836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.354863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.354987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.355110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.355136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.355266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.355364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.355389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.355549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.355678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.355705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.355831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.355950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.355975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.356074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.356202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.356227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.356339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.356430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.356455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.356549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.356642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.356668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.356789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.356911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.356938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.357040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.357166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.357192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.357296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.357408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.357434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.357532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.357656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.357682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.357826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.357955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.357998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.358124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.358246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.358271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.358391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.358523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.358550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.358667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.358780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.358804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.358924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.359040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.359064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.359165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.359267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.359294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.359418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.359515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.359540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.359639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.359759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.359785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.359882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.360004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.360030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.360166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.360281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.360306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.360406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.360495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.360521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.360622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.360740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.360765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.360912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.361028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.361055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.361203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.361295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.361320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.361443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.361538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.361562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.361676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.361756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.361780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.361910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.362030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.362055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.362170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.362313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.362338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.362462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.362565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.362590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.362687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.362809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.362835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.836 [2024-11-29 09:51:09.362923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.363054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.836 [2024-11-29 09:51:09.363080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.836 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.363210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.363307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.363334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.363492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.363587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.363611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.363741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.363830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.363855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.363969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.364065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.364098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.364238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.364365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.364390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.364527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.364624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.364649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.364764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.364856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.364881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.364979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.365103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.365129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.365227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.365346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.365371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.365527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.365624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.365655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.365753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.365906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.365931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.366035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.366126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.366151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.366274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.366404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.366431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.366530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.366617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.366642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.366768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.366890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.366915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.367007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.367129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.367154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.367331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.367500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.367526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.367647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.367744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.367769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.367877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.367991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.368015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.368166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.368284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.368310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.368448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.368563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.368589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.368688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.368804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.368830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.368937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.369092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.369118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.369233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.369361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.369389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.369543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.369689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.369713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.369815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.369935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.369960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.370050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.370135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.370180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.370341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.370511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.370538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.837 [2024-11-29 09:51:09.370684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.370806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.837 [2024-11-29 09:51:09.370833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.837 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.370946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.371046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.371071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.371169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.371338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.371367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.371493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.371598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.371624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.371724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.371843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.371869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.372001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.372137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.372167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.372344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.372454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.372480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.372579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.372671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.372700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.372816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.372956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.372984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.373123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.373244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.373270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.373417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.373512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.373537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.373631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.373767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.373796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.373956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.374080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.374105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.374210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.374344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.374370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.374484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.374582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.374608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.374727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.374829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.374856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.374976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.375097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.375123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.375257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.375350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.375375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.375510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.375628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.375653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.375754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.375916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.375942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.376060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.376178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.376204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.376331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.376458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.376485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.838 [2024-11-29 09:51:09.376573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.376710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.838 [2024-11-29 09:51:09.376736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.838 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.376869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.377018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.377044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.377191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.377286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.377313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.377434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.377582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.377607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.377783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.377940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.377966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.378064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.378185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.378210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.378306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.378408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.378436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.378565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.378659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.378685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.378785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.378884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.378909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.379054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.379174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.379199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.379323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.379430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.379461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.379562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.379647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.379672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.379795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.379884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.379910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.380039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.380166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.380191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.380366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.380499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.380525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.380643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.380766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.380795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.380954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.381051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.381077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.381201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.381319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.381343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.381434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.381527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.381552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.381648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.381743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.381768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.381893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.382012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.382037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.382147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.382266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.382291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.382384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.382492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.382518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.382644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.382739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.382766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.382935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.383049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.383075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.383206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.383303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.383329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.383480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.383571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.383596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.383764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.383900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.383940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.384068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.384169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.384194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.839 qpair failed and we were unable to recover it. 00:27:46.839 [2024-11-29 09:51:09.384316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.384441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.839 [2024-11-29 09:51:09.384466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.384610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.384763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.384788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.384924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.385013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.385039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.385139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.385264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.385289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.385400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.385531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.385557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.385650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.385768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.385793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.385917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.386040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.386065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.386190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.386285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.386311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.386415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.386538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.386566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.386715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.386845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.386871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.386992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.387115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.387142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.388361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.388482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.388510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.388614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.388714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.388739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.388851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.388953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.388981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.389125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.389246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.389275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.389438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.389537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.389562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.389689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.389832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.389859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.390047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.390131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.390156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.390259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.390383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.390416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.390519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.390613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.390639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.390811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.390909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.390938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.391059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.391158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.391183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.391304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.391409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.391436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.391537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.391632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.391659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.391820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.391940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.391965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.392094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.392212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.392237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.392373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.392538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.392567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.392711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.392858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.392883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.393034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.393136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.393163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.840 qpair failed and we were unable to recover it. 00:27:46.840 [2024-11-29 09:51:09.393314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.840 [2024-11-29 09:51:09.393435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.393477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.393576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.393677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.393709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.393813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.393968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.393994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.394095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.394230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.394263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.394417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.394516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.394543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.394671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.394768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.394794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.394918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.395017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.395043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.395133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.395231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.395256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.395390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.395493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.395520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.395651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.395769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.395796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.395923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.396045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.396070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.396192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.396311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.396339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.396459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.396584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.396627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.396759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.396879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.396903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.397028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.397129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.397155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.397274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.397365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.397420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.397550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.397672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.397697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.397819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.397953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.397978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.398122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.398290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.398318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.398437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.398593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.398619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.398730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.398818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.398844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.398975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.399098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.399123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.399222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.399316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.399342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.399478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.399627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.399673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.841 qpair failed and we were unable to recover it. 00:27:46.841 [2024-11-29 09:51:09.399830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.399923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.841 [2024-11-29 09:51:09.399948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.400096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.400191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.400216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.400330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.400449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.400479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.400661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.400791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.400817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.400939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.401032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.401057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.401212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.401340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.401369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.401484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.401584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.401610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.401758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.401879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.401905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.402003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.402128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.402155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.402279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.402430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.402458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.402574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.402672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.402698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.402796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.402885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.402910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.403037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.403149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.403176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.403317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.403423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.403466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.403563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.403664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.403705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.403848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.403976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.404002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.404150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.404241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.404267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.404388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.404546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.404572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.404677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.404788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.404814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.404908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.405039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.405064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.405182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.405304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.405330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.405465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.405587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.405613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.405750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.405842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.405867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.405989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.406109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.406134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.406257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.406355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.406380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.406490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.406587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.406613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.406731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.406827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.406853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.406978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.407075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.407100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.407195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.407311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.407336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.842 qpair failed and we were unable to recover it. 00:27:46.842 [2024-11-29 09:51:09.407477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.842 [2024-11-29 09:51:09.407594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.407620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.407745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.407848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.407880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.408007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.408141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.408166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.408263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.408353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.408378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.408507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.408608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.408635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.408764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.408914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.408940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.409097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.409192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.409218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.409309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.409436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.409462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.409551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.409646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.409673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.409821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.409911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.409936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.410035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.410163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.410188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.410311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.410441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.410473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.410603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.410696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.410722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.410869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.410991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.411018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.411116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.411233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.411259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.411350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.411479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.411507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.411606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.411748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.411774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.411891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.411978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.412004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.412105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.412224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.412249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.412345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.412440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.412466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.412565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.412688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.412716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.412816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.412903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.412929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.413064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.413192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.413217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.413363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.413493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.413520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.413625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.413776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.413802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.413894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.413992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.414018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.414141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.414240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.414265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.414380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.414482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.414506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.414606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.414734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.843 [2024-11-29 09:51:09.414759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.843 qpair failed and we were unable to recover it. 00:27:46.843 [2024-11-29 09:51:09.414907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.415009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.415036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.415168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.415266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.415292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.415398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.415521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.415547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.415676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.415799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.415825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.415954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.416048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.416074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.416200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.416329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.416355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.416483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.416579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.416604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.416732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.416846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.416871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.416965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.417089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.417114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.417277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.417427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.417454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.417584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.417683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.417714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.417814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.417905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.417930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.418027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.418115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.418140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.418255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.418353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.418378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.418480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.418601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.418626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.418758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.418852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.418877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.419024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.419150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.419177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.419332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.419455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.419482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.419604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.419758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.419783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.419909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.420029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.420055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.420153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.420271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.420296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.420408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.420507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.420533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.420653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.420774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.420799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.420924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.421074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.421100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.421227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.421342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.421368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.421508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.421605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.421631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.421771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.421872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.421897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.421989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.422139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.422164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.844 [2024-11-29 09:51:09.422316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.422422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.844 [2024-11-29 09:51:09.422448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.844 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.422548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.422695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.422722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.422825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.422942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.422968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.423086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.423170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.423196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.423319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.423427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.423454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.423542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.423683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.423713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.423814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.423940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.423965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.424089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.424251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.424276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.424400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.424502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.424528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.424627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.424758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.424783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.424884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.425004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.425029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.425153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.425284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.425310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.425461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.425582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.425607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.425716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.425816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.425841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.425966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.426057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.426083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.426188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.426296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.426321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.426443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.426550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.426575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.426667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.426787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.426812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.426963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.427107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.427133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.427239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.427338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.427364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.427492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.427589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.427617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.427769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.427894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.427919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.428025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.428152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.428177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.428337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.428475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.428503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.428626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.428755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.428780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.428872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.429016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.429042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.429145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.429294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.429321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.429445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.429564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.429589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.429717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.429808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.429833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.845 qpair failed and we were unable to recover it. 00:27:46.845 [2024-11-29 09:51:09.429936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.430056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.845 [2024-11-29 09:51:09.430081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.430189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.430296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.430323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.430423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.430546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.430572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.430706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.430855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.430897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.431074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.431227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.431253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.431352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.431505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.431532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.431628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.431725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.431751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.431881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.431997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.432022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.432114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.432245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.432270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.432397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.432522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.432548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.432637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.432755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.432781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.432878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.433028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.433055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.433178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.433296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.433322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.433426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.433530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.433555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.433678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.433803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.433828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.433950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.434070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.434095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.434263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.434390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.434427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.434523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.434668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.434694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.434790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.434875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.434900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.435021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.435138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.435163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.435263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.435359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.435400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.435495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.435622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.435646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.435806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.435903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.435928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.436053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.436180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.436206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.436323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.436409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.436435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.846 [2024-11-29 09:51:09.436528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.436650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.846 [2024-11-29 09:51:09.436676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.846 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.436802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.436948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.436974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.437124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.437255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.437286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.437426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.437545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.437571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.437694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.437811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.437836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.437967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.438064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.438090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.438175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.438290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.438316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.438463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.438581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.438607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.438754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.438868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.438894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.439041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.439153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.439178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.439315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.439435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.439463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.439590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.439708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.439734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.439870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.440013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.440043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.440165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.440247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.440272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.440373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.440504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.440531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.440649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.440730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.440756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.440906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.441051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.441079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.441196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.443527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.443568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.443704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.443894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.443921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.444033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.444141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.444169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.444348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.444453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.444480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.444604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.444693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.444719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.444845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.444969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.444996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.445135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.445261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.445287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.445379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.445500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.445528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.445655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.445754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.445780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.445880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.446028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.446054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.446215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.446339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.446365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.446478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.446621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.446647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.847 qpair failed and we were unable to recover it. 00:27:46.847 [2024-11-29 09:51:09.446766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.446886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.847 [2024-11-29 09:51:09.446912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.447035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.447157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.447184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.447289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.447411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.447437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.447535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.447687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.447713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.447831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.448011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.448037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.448167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.448288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.448314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.448406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.448529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.448556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.448654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.448779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.448805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.448902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.449049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.449074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.449207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.449302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.449328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.449456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.449561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.449588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.449715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.449836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.449861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.449956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.450041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.450066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.450189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.450277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.450303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.450415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.450541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.450566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.450682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.450770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.450795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.450881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.450998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.451024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.451150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.451241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.451266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.451372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.451511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.451537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.451655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.451801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.451827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.451942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.452045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.452070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.452160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.452283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.452309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.452411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.452515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.452542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.452659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.452782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.452808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.452930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.453084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.453114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.453264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.453362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.453412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.453502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.453598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.453623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.453773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.453869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.453894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.454033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.454120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.454145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.848 qpair failed and we were unable to recover it. 00:27:46.848 [2024-11-29 09:51:09.454266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.848 [2024-11-29 09:51:09.454369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.454401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.454503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.454624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.454648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.454750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.454874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.454899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.454999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.455094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.455119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.455203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.455329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.455355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.455458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.455547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.455577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.455680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.455826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.455852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.455974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.456122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.456148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.456266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.456373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.456408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.456559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.456663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.456689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.456862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.457010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.457035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.457183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.457278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.457305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.457428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.457549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.457575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.457709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.457836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.457862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.457999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.458143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.458168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.458263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.458348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.458374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.458490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.458571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.458597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.458693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.458859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.458888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.459022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.459130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.459154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.459280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.459441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.459467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.459560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.459661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.459686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.459814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.459903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.459928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.460048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.460180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.460204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.460304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.460423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.460449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.460540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.460639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.460665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.460765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.460856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.460880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.461004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.461134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.461161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.461257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.461343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.461368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.461507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.461635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.849 [2024-11-29 09:51:09.461660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.849 qpair failed and we were unable to recover it. 00:27:46.849 [2024-11-29 09:51:09.461794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.461964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.461991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.462126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.462227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.462253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.462371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.462510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.462537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.462736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.462828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.462854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.462950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.463046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.463072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.463168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.463253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.463278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.463379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.463511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.463538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.463707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.463829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.463855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.463986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.464108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.464134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.464281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.464380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.464419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.464543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.464640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.464665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.464833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.464934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.464976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.465120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.465260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.465287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.465434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.465548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.465573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.465727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.465925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.465974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.466085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.466187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.466215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.466322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.466457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.466483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.466581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.466691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.466716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.466866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.466999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.467025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.467147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.467290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.467317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.467463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.467554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.467578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.467667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.467820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.467845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.467966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.468055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.468079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.468199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.468345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.468370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.468468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.468596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.468620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.468740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.468918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.468942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.469066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.469190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.850 [2024-11-29 09:51:09.469215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.850 qpair failed and we were unable to recover it. 00:27:46.850 [2024-11-29 09:51:09.469308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.469414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.469446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.469592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.469706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.469733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.469880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.470028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.470055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.470171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.470297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.470325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.470448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.470545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.470571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.470663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.470805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.470830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.470998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.471125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.471151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.471243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.471373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.471410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.471515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.471636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.471661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.471773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.471906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.471934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.472060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.472192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.472217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.472320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.472422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.472448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.472550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.472643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.472668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.472797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.472942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.472967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.473063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.473159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.473183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.473309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.473468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.473496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.473629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.473715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.473748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.473868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.473962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.473989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.474158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.474290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.474316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.474447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.474598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.474622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.474766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.474888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.474913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.475015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.475171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.475197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.475305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.475444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.475474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.475588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.475708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.475732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.475849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.475941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.475965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.476061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.476194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.476219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.476345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.476498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.476524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.851 qpair failed and we were unable to recover it. 00:27:46.851 [2024-11-29 09:51:09.476618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.851 [2024-11-29 09:51:09.476736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.476760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.476861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.477011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.477036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.477178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.477311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.477338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.477463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.477560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.477585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.477748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.477848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.477873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.478002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.478099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.478126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.478244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.478337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.478363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.478520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.478624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.478649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.478776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.478895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.478920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.479023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.479141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.479167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.479257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.479372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.479418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.479544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.479669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.479704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.479826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.479924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.479949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.480054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.480138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.480163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.480291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.480453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.480497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.480682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.480835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.480860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.480963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.481108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.481133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.481253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.481347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.481373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.481523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.481690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.481722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.481833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.481953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.481979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.482110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.482199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.482223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.482338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.482474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.482501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.482591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.482790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.482814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.482911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.483032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.483058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.483191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.483286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.483315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.483432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.483524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.483567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.483678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.483802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.483835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.483952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.484086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.484112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.484287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.484449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.852 [2024-11-29 09:51:09.484476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.852 qpair failed and we were unable to recover it. 00:27:46.852 [2024-11-29 09:51:09.484621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.484767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.484799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.484924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.485048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.485073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.485228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.485346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.485371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.485564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.485695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.485738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.485894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.486031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.486057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.486190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.486276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.486300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.486439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.486564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.486589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.486770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.486940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.486965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.487064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.487159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.487184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.487301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.487402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.487428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.487542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.487635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.487663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.487774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.487953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.487978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.488095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.488224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.488250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.488373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.488504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.488530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.488655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.488767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.488804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.488985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.489084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.489120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.489277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.489363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.489412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.489566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.489712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.489737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.489858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.489944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.489968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.490089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.490184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.490211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.490346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.490443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.490471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.490592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.490757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.490793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.490878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.491023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.491063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.491196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.491360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.491388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.491520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.491614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.491639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.491768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.491863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.491889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.492016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.492158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.492187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.492314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.492438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.492464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.492586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.492718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.853 [2024-11-29 09:51:09.492744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.853 qpair failed and we were unable to recover it. 00:27:46.853 [2024-11-29 09:51:09.492884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.492996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.493022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.493114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.493233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.493260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.493357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.493488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.493515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.493664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.493763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.493790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.493923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.494048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.494073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.494180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.494283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.494311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.494440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.494545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.494588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.494683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.494845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.494870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.494964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.495113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.495141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.495277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.495444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.495472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.495599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.495724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.495749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.495887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.495985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.496010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.496182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.496283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.496312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.496486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.496619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.496644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.496781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.496908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.496937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.497040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.497162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.497186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.497329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.497437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.497463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.497553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.497668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.497706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.497807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.497900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.497925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.498074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.498164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.498189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.498305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.498470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.498496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.498636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.498755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.498779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.498928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.499027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.499052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.499147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.499271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.499295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.499429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.499572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.499600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.499748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.499897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.499922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.500029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.500128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.500154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.500248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.500406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.500433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.854 [2024-11-29 09:51:09.500574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.500692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.854 [2024-11-29 09:51:09.500722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.854 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.500814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.500938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.500963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.501061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.501173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.501207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.501323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.501484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.501512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.501658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.501838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.501863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.501987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.502143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.502168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.502301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.502411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.502438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.502532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.502701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.502729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.502878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.503022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.503048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.503156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.503274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.503299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.503431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.503579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.503608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.503754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.503874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.503899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.504046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.504167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.504193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.504323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.504434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.504460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.504552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.504647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.504672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.504839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.504985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.505010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.505125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.505243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.505269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.505425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.505562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.505587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.505714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.505874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.505900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.505989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.506100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.506137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.506243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.506330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.506355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.506488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.506583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.506609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.506708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.506834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.506859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.506952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.507067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.507092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.507194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.507346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.507371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.855 [2024-11-29 09:51:09.507507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.507638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.855 [2024-11-29 09:51:09.507664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.855 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.507792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.507890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.507932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.508055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.508169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.508194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.508296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.508418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.508444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.508544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.508630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.508655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.508786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.508877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.508903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.509049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.509172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.509199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.509365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.509523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.509549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.509648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.509769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.509794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.509889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.510062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.510089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.510224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.510368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.510410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.510533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.510661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.510686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.510820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.510913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.510939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.511066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.511163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.511188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.511277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.511391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.511424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.511517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.511606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.511637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.511768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.511860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.511886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.512008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.512124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.512148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.512286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.512407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.512442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.512561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.512662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.512688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.512820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.512907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.512932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.513076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.513183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.513212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.513339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.513544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.513569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.513711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.513824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.513849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.513995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.514136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.514161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.514283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.514377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.514412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.514529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.514627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.514653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.514772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.514856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.514884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.514975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.515071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.515096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.856 qpair failed and we were unable to recover it. 00:27:46.856 [2024-11-29 09:51:09.515224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.515346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.856 [2024-11-29 09:51:09.515372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.515533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.515693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.515722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.515901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.516000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.516024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.516149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.516258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.516283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.516404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.516505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.516529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.516653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.516739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.516763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.516884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.517005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.517030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.517179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.517359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.517384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.517501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.517595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.517621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.517753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.517873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.517898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.518010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.518141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.518168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.518330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.518484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.518510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.518632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.518757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.518783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.518905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.519001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.519045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.519150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.519279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.519307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.519429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.519511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.519536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.519678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.519810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.519838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.520020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.520141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.520165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.520264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.520354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.520379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.520535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.520668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.520695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.520811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.520943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.520970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.521084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.521211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.521236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.521357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.521513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.521540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.521667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.521816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.521846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.521994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.522141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.522167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.522314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.522446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.522474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.522620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.522730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.522756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.522899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.522997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.523022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.523190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.523296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.523324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.857 qpair failed and we were unable to recover it. 00:27:46.857 [2024-11-29 09:51:09.523484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.857 [2024-11-29 09:51:09.523600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.523625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.523755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.523878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.523904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.524030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.524151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.524178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.524280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.524414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.524440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.524563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.524662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.524687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.524824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.524981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.525011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.525157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.525255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.525281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.525437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.525559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.525584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.525706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.525830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.525858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.525990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.526093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.526121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.526261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.526356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.526382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.526526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.526643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.526669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.526780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.526936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.526962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.527125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.527273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.527297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.527445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.527598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.527624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.527764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.527861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.527886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.528007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.528099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.528124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.528249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.528373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.528407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.528518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.528618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.528648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.528747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.528867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.528892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.528991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.529083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.529108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.529253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.529378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.529433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.529557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.529681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.529706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.529879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.530038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.530066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.530194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.530292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.530319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.530466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.530578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.530603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.530701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.530822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.530846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.531002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.531111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.531139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.531284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.531423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.531451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.858 qpair failed and we were unable to recover it. 00:27:46.858 [2024-11-29 09:51:09.531546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.858 [2024-11-29 09:51:09.531646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.531671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.531782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.531881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.531907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.531998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.532091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.532117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.532254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.532381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.532417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.532552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.532684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.532713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.532838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.532930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.532956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.533076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.533226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.533251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.533348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.533473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.533504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.533660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.533789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.533814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.533905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.534003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.534028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.534183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.534315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.534342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.534469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.534591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.534616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.534711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.534805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.534830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.534922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.535002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.535027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.535151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.535267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.535293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.535434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.535556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.535582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.535675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.535769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.535795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.535912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.536010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.536035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.536139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.536258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.536284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.536449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.536582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.536610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.536733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.536884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.536911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.537003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.537126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.537152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.537287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.537378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.537411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.537512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.537633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.537658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.537753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.537865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.537894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.538026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.538128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.538156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.538291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.538409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.538436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.538526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.538623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.538651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.538799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.538921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.859 [2024-11-29 09:51:09.538962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.859 qpair failed and we were unable to recover it. 00:27:46.859 [2024-11-29 09:51:09.539127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.539252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.539277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.539408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.539560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.539588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.539701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.539874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.539899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.540024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.540115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.540140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.540266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.540406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.540434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.540542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.540679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.540706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.540873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.540976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.541001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.541156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.541296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.541322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.541416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.541522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.541549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.541668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.541785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.541812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.541954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.542090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.542117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.542253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.542415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.542460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.542601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.542719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.542745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.542867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.542989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.543013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.543117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.543265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.543289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.543409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.543508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.543533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.543655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.543824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.543866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.543988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.544109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.544133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.544256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.544347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.544372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.544502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.544639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.544666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.544765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.544866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.544895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.545020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.545115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.545141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.545274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.545366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.545390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.545493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.545593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.545619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.545721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.545839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.545864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.860 qpair failed and we were unable to recover it. 00:27:46.860 [2024-11-29 09:51:09.546024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.860 [2024-11-29 09:51:09.546122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.546148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.546251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.546364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.546388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.546530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.546654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.546678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.546803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.546900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.546924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.547027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.547116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.547141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.547281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.547439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.547465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.547566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.547657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.547684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.547833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.548004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.548029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.548178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.548295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.548321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.548437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.548600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.548627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.548781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.548948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.548976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.549116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.549212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.549238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.549401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.549507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.549535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.549651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.549770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.549794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.549919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.550033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.550058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.550186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.550342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.550371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.550536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.550656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.550682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.550822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.550921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.550947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.551118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.551219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.551246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.551384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.551503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.551532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.551686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.551781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.551806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.551953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.552078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.552103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.552199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.552291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.552317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.552441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.552538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.552564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.552688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.552781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.552805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.552926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.553023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.553049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.553186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.553344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.553371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.553510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.553651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.553692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.553859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.553986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.861 [2024-11-29 09:51:09.554013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.861 qpair failed and we were unable to recover it. 00:27:46.861 [2024-11-29 09:51:09.554131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.554231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.554256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.554386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.554487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.554514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.554654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.554766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.554795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.554916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.555069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.555095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.555212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.555384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.555416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.555538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.555635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.555660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.555787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.555909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.555934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.556081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.556227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.556252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.556381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.556484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.556513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.556636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.556733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.556759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.556878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.556999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.557024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.557128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.557245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.557269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.557412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.557556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.557581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.557753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.557860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.557888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.557993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.558113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.558138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.558237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.558350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.558375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.558512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.558633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.558658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.558816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.558919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.558948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.559117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.559265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.559311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.559484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.559602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.559627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.559747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.559838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.559862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.559958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.560057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.560082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.560207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.560359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.560383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.560567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.560684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.560712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.560882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.561001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.561044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.561197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.561349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.561374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.561486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.561583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.561608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.561709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.561800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.561824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.561928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.562059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.862 [2024-11-29 09:51:09.562087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.862 qpair failed and we were unable to recover it. 00:27:46.862 [2024-11-29 09:51:09.562228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.562366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.562402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.562548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.562673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.562698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.562824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.562916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.562940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.563066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.563180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.563205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.563354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.563477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.563505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.563600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.563725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.563750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.563836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.563958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.563983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.564079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.564226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.564250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.564377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.564502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.564528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.564629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.564726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.564751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.564882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.565004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.565029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.565181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.565288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.565315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.565454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.565591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.565619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.565761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.565887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.565912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.566007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.566093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.566118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.566210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.566329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.566353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.566466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.566579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.566604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.566738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.566870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.566897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.567067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.567190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.567215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.567342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.567492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.567534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.567653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.567777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.567802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.567928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.568026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.568052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.568183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.568304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.568330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.568453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.568552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.568579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.568703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.568842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.568870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.569039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.569166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.569190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.569295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.569411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.569436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.569547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.569640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.569666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.863 [2024-11-29 09:51:09.569816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.569936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.863 [2024-11-29 09:51:09.569962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.863 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.570083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.570238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.570266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.570404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.570545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.570573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.570746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.570862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.570887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.571012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.571103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.571128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.571265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.571389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.571421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.571518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.571643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.571668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.571796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.571950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.571974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.572130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.572247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.572275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.572458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.572577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.572603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.572723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.572817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.572842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.572967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.573082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.573126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.573286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.573464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.573494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.573594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.573718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.573743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.573861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.573972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.574002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.574147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.574293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.574318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.574462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.574597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.574625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.574787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.574883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.574911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.575058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.575150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.575175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.575322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.575450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.575476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.575578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.575713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.575741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.575856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.575955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.575980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.576111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.576196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.576237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.576374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.576517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.576545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.576690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.576782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.576806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.576939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.577042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.864 [2024-11-29 09:51:09.577068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.864 qpair failed and we were unable to recover it. 00:27:46.864 [2024-11-29 09:51:09.577167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.577265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.577308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.577449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.577569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.577594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.577759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.577892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.577920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.578078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.578211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.578239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.578382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.578536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.578563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.578660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.578750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.578775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.578865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.578987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.579030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.579202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.579304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.579334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.579482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.579605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.579632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.579752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.579885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.579915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.580032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.580151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.580176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.580301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.580419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.580445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.580543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.580676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.580705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.580863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.580988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.581014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.581162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.581296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.581324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.581464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.581596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.581624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.581740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.581855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.581881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.582004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.582126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.582152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.582276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.582372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.582423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.582545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.582666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.582692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.582834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.582983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.583012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.583121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.583255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.583283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.583421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.583543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.583568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.583684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.583814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.583839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.583934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.584084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.584111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.584247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.584435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.584461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.584589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.584699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.584727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.584858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.584994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.585023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.865 qpair failed and we were unable to recover it. 00:27:46.865 [2024-11-29 09:51:09.585143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.865 [2024-11-29 09:51:09.585296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.585321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.585414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.585541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.585567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.585667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.585839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.585867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.586042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.586143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.586169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.586264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.586362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.586389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.586492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.586637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.586666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.586780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.586907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.586933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.587055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.587145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.587170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.587291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.587389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.587421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.587551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.587676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.587706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.587851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.587954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.587983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.588150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.588290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.588317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.588466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.588582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.588607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.588746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.588865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.588891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.589021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.589121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.589146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.589294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.589390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.589443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.589548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.589641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.589668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.589791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.589879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.589905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.590000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.590120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.590145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.590297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.590423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.590450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.590574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.590737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.590763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.590860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.590949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.590974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.591096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.591183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.591209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.591322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.591429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.591458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.591576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.591703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.591728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.591827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.591908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.591933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.592068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.592175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.592203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.592335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.592461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.592487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.592603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.592733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.866 [2024-11-29 09:51:09.592761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.866 qpair failed and we were unable to recover it. 00:27:46.866 [2024-11-29 09:51:09.592934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.593020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.593045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.593172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.593294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.593320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.593424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.593550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.593576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.593725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.593825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.593850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.593975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.594066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.594090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.594233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.594364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.594391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.594515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.594658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.594700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.594815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.594936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.594962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.595155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.595259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.595285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.595430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.595553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.595580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.595728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.595851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.595877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.596007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.596138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.596168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.596350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.596515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.596541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.596688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.596807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.596832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.596969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.597110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.597135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.597267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.597367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.597399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.597524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.597615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.597641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.597765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.597909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.597934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.598077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.598211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.598238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.598391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.598498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.598524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.598621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.598716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.598741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.598863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.598983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.599008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.599100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.599223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.599253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.599420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.599567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.599593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.599766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.599925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.599953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.600097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.600187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.600213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.600331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.600464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.600494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.600625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.600729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.600756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.600907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.601005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.867 [2024-11-29 09:51:09.601032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.867 qpair failed and we were unable to recover it. 00:27:46.867 [2024-11-29 09:51:09.601136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.601263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.601288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 09:51:09.601388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.601488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.601513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 09:51:09.601602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.601719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.601748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 09:51:09.601886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.602030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.602056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 09:51:09.602173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.602266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.602290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 09:51:09.602417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.602508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.602533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 09:51:09.602664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.602765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.602790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 09:51:09.602915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.603022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.603047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:46.868 [2024-11-29 09:51:09.603167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.603310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.868 [2024-11-29 09:51:09.603338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:46.868 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.603462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.603561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.603586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.603713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.603802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.603827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.603955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.604055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.604081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.604221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.604323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.604356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.604530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.604647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.604673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.604822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.604907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.604932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.605029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.605119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.605144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.605230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.605352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.605378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.605553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.605658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.605682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.605805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.605906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.605930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.606023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.606188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.606215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.606362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.606513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.606540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.606664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.606787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.606813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.606939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.607027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.607053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.607170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.607303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.607331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.607444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.607590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.607615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.607706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.607787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.607813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.607902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.607996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.608022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.608212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.608380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.608417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.608528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.608651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.608692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.608819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.608941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.608967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.609068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.609166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.609190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.609366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.609464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.609492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.156 qpair failed and we were unable to recover it. 00:27:47.156 [2024-11-29 09:51:09.609634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.156 [2024-11-29 09:51:09.609724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.609749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.609872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.609991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.610019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.610178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.610309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.610339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.610493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.610591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.610617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.610735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.610876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.610904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.611039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.611183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.611208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.611308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.611427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.611453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.611637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.611735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.611763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.611864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.612002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.612029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.612176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.612265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.612291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.612388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.612490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.612515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.612662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.612815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.612840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.612989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.613137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.613163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.613247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.613374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.613407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.613538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.613630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.613656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.613819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.613918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.613943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.614032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.614176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.614204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.614321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.614443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.614468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.614594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.614721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.614747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.614850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.614977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.615002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.615086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.615170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.615195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.615292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.615408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.615438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.615573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.615707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.615736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.615871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.616021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.616047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.616200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.616294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.616318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.616439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.616576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.616601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.616698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.616815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.157 [2024-11-29 09:51:09.616839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.157 qpair failed and we were unable to recover it. 00:27:47.157 [2024-11-29 09:51:09.616960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.617081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.617106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.617245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.617371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.617407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.617524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.617658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.617686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.617810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.617937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.617962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.618077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.618226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.618258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.618369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.618480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.618506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.618628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.618752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.618776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.618891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.619012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.619037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.619171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.619308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.619336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.619451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.619540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.619565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.619655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.619835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.619863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.619997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.620156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.620183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.620281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.620408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.620438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.620578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.620701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.620727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.620828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.620969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.620997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.621112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.621202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.621227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.621391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.621501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.621530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.621641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.621749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.621780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.621914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.622066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.622092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.622279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.622375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.622408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.622540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.622638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.622663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.622815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.622909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.622934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.623049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.623142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.623167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.623296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.623441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.623471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.623616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.623763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.623789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.623891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.624020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.624047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.624186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.624297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.158 [2024-11-29 09:51:09.624326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.158 qpair failed and we were unable to recover it. 00:27:47.158 [2024-11-29 09:51:09.624469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.624592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.624618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.624741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.624862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.624888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.624989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.625077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.625104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.625203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.625331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.625357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.625509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.625622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.625651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.625790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.625922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.625951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.626065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.626187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.626213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.626322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.626454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.626484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.626663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.626814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.626840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.626943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.627061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.627088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.627254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.627426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.627456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.627596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.627739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.627767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.627915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.628066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.628091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.628267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.628373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.628412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.628525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.628687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.628736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.628865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.628986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.629012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.629103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.629226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.629251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.629389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.629556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.629584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.629727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.629831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.629857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.629982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.630076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.630117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.630230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.630386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.630420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.630561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.630663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.630689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.630808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.630922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.630948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.631048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.631132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.631156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.631259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.631351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.631377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.631526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.631668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.159 [2024-11-29 09:51:09.631696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.159 qpair failed and we were unable to recover it. 00:27:47.159 [2024-11-29 09:51:09.631825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.631935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.631964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.632112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.632226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.632252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.632403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.632569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.632602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.632707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.632808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.632838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.632961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.633110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.633136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.633233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.633355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.633382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.633490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.633583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.633608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.633725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.633868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.633893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.634034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.634136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.634166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.634323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.634417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.634444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.634535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.634622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.634647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.634774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.634868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.634911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.635042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.635151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.635176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.635347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.635483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.635509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.635637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.635782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.635807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.635906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.636031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.636056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.636143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.636239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.636264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.636368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.636528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.636555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.636674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.636814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.636843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.636953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.637099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.637125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.637231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.637364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.637400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.637545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.637666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.637691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.637811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.637904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.637930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.638120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.638239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.638264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.638409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.638509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.638537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.160 qpair failed and we were unable to recover it. 00:27:47.160 [2024-11-29 09:51:09.638654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.638756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.160 [2024-11-29 09:51:09.638781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.638881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.639003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.639047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.639189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.639350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.639379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.639505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.639589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.639615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.639718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.639811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.639836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.639982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.640094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.640120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.640259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.640403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.640446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.640544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.640636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.640662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.640818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.640949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.640977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.641117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.641238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.641263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.641434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.641568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.641595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.641705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.641837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.641865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.641983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.642098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.642123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.642244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.642340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.642364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.642499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.642645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.642674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.642822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.642911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.642936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.643079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.643216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.643245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.643348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.643495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.643525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.643648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.643781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.643807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.643932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.644052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.644079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.644171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.644264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.644289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.644409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.644527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.644553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.644669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.644825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.644854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.161 [2024-11-29 09:51:09.644999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.645101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.161 [2024-11-29 09:51:09.645131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.161 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.645272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.645423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.645449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.645631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.645759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.645786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.645883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.646015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.646043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.646181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.646297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.646322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.646439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.646591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.646621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.646750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.646859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.646884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.646982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.647074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.647099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.647191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.647313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.647354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.647493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.647620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.647645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.647765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.647892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.647918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.648090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.648223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.648251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.648414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.648519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.648547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.648693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.648782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.648807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.648950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.649048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.649082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.649174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.649273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.649297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.649450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.649574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.649599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.649748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.649910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.649938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.650045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.650219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.650244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.650371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.650472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.650498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.650632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.650809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.650834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.650984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.651120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.651147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.651264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.651385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.651436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.651537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.651727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.651752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.651841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.651940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.651966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.652125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.652228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.652252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.652408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.652529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.652558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.652695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.652822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.652853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.652995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.653120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.653145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.162 qpair failed and we were unable to recover it. 00:27:47.162 [2024-11-29 09:51:09.653281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.162 [2024-11-29 09:51:09.653402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.653428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.653548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.653641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.653666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.653787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.653878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.653905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.654014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.654127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.654154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.654303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.654428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.654454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.654555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.654651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.654676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.654825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.654993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.655022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.655162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.655295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.655323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.655470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.655567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.655592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.655715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.655808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.655833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.655966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.656088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.656113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.656273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.656390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.656425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.656608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.656744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.656772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.656937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.657067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.657109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.657208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.657298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.657322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.657470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.657566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.657591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.657722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.657860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.657889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.658012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.658167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.658193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.658380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.658508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.658533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.658745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.658859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.658887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.659012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.659133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.659158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.659300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.659430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.659455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.659582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.659682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.659706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.659805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.659898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.659923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.660017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.660130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.660155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.660312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.660449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.660477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.660593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.660688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.660712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.660829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.661000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.661030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.661153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.661255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.661279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.163 qpair failed and we were unable to recover it. 00:27:47.163 [2024-11-29 09:51:09.661406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.163 [2024-11-29 09:51:09.661525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.661550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.661698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.661802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.661828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.661964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.662064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.662092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.662242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.662335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.662361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.662464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.662589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.662615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.662717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.662815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.662841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.662937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.663059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.663083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.663180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.663295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.663320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.663458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.663562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.663592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.663719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.663843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.663869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.663974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.664087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.664114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.664255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.664345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.664373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.664524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.664621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.664647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.664767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.664863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.664889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.665041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.665203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.665228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.665352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.665484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.665511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.665655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.665797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.665825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.665987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.666150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.666177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.666327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.666436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.666462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.666595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.666715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.666741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.666864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.667030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.667057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.667174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.667296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.667321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.667439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.667553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.667578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.667758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.667889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.667916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.668028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.668125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.668151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.668280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.668420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.668450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.668614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.668715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.668744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.668890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.669035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.669061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.669185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.669317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.669345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.164 qpair failed and we were unable to recover it. 00:27:47.164 [2024-11-29 09:51:09.669485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.164 [2024-11-29 09:51:09.669640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.669668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.669815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.669918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.669943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.670073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.670177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.670202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.670335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.670468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.670496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.670653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.670800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.670825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.670949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.671041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.671067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.671191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.671307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.671335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.671475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.671570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.671595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.671750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.671924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.671949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.672068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.672210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.672234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.672447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.672597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.672621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.672715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.672914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.672943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.673074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.673197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.673225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.673375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.673489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.673515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.673642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.673747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.673772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.673867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.673992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.674018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.674112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.674234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.674260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.674362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.674509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.674539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.674687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.674825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.674852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.674985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.675130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.675155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.675338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.675480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.675509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.675616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.675751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.675782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.675896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.675999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.676025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.676170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.676313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.676338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.676461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.676583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.165 [2024-11-29 09:51:09.676610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.165 qpair failed and we were unable to recover it. 00:27:47.165 [2024-11-29 09:51:09.676709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.676857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.676882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.677048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.677157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.677185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.677314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.677464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.677490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.677606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.677726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.677751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.677850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.677994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.678020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.678111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.678231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.678262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.678409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.678525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.678550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.678700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.678816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.678842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.678991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.679127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.679155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.679301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.679448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.679491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.679590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.679724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.679751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.679890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.680023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.680066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.680192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.680307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.680333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.680458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.680550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.680576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.680717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.680873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.680902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.681026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.681187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.681213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.681365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.681503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.681546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.681647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.681771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.681796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.681927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.682017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.682042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.682155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.682257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.682284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.682416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.682587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.682612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.682732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.682859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.682883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.683029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.683132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.683160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.683285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.683422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.683452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.683572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.683668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.683694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.683872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.683995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.684020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.684149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.684278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.684303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.684404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.684529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.684554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.166 [2024-11-29 09:51:09.684722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.684883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.166 [2024-11-29 09:51:09.684911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.166 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.685024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.685150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.685177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.685319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.685469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.685494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.685644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.685750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.685779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.685914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.686075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.686104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.686278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.686404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.686429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.686554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.686649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.686674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.686764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.686851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.686878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.687002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.687151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.687192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.687299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.687438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.687466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.687618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.687729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.687759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.687904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.688019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.688044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.688233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.688328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.688354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.688544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.688668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.688697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.688834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.688957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.688982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.689123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.689239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.689267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.689405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.689533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.689559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.689690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.689886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.689912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.690050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.690180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.690208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.690381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.690517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.690542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.690701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.690825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.690850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.690978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.691110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.691138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.691274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.691477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.691503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.691612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.691759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.691784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.691906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.692025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.692051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.692138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.692258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.692283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.692411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.692502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.692528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.692653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.692794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.692822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.692929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.693075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.693105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.167 qpair failed and we were unable to recover it. 00:27:47.167 [2024-11-29 09:51:09.693251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.167 [2024-11-29 09:51:09.693346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.693372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.693596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.693686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.693712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.693856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.693990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.694018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.694132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.694251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.694276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.694376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.694480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.694506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.694632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.694753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.694779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.694909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.695030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.695057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.695198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.695326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.695355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.695503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.695609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.695639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.695760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.695879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.695906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.696025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.696125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.696151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.696272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.696374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.696431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.696586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.696703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.696729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.696880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.696981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.697009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.697182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.697328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.697356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.697484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.697611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.697636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.697725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.697851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.697876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.698042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.698149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.698177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.698293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.698426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.698452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.698576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.698667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.698691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.698856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.698996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.699021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.699144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.699267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.699292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.699436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.699566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.699610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.699710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.699809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.699835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.699990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.700115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.700140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.700267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.700388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.700421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.700514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.700642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.700683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.700812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.700939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.700964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.701127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.701261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.701289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.168 qpair failed and we were unable to recover it. 00:27:47.168 [2024-11-29 09:51:09.701431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.168 [2024-11-29 09:51:09.701545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.701573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.701725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.701825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.701851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.701991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.702109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.702134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.702256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.702378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.702415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.702544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.702668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.702693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.702838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.702991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.703020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.703166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.703291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.703316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.703439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.703555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.703581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.703700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.703834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.703863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.704007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.704133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.704159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.704256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.704376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.704425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.704554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.704687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.704713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.704822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.704915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.704940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.705033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.705151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.705176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.705347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.705486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.705512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.705689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.705796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.705823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.705972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.706117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.706142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.706282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.706421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.706448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.706577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.706707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.706737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.706883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.707007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.707031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.707173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.707313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.707337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.707438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.707537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.707567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.707700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.707814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.707839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.708034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.708150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.708176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.708311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.708453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.708478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.708597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.708718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.708744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.708895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.709019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.709045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.709145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.709276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.709302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.709425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.709547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.709573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.169 qpair failed and we were unable to recover it. 00:27:47.169 [2024-11-29 09:51:09.709696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.169 [2024-11-29 09:51:09.709788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.709829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.709958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.710155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.710183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.710291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.710416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.710446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.710577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.710711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.710739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.710872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.711003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.711030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.711144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.711277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.711305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.711428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.711546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.711572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.711699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.711810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.711838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.712015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.712105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.712132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.712309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.712424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.712450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.712564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.712696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.712740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.712855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.712985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.713011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.713152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.713298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.713322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.713430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.713530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.713556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.713674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.713772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.713797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.713925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.714022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.714048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.714195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.714324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.714352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.714479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.714628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.714654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.714831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.714955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.714980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.715125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.715225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.715254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.715481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.715608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.715634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.715806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.715938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.715968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.716097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.716261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.716286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.716447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.716567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.716591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.716719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.716841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.716870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.170 [2024-11-29 09:51:09.716981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.717091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.170 [2024-11-29 09:51:09.717120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.170 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.717272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.717370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.717403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.717575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.717704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.717732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.717863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.717994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.718022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.718171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.718302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.718328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.718452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.718543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.718568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.718709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.718877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.718901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.718996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.719094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.719120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.719217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.719346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.719372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.719482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.719583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.719608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.719711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.719832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.719857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.720009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.720145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.720172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.720341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.720447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.720483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.720582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.720733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.720758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.720898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.721039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.721067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.721183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.721348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.721374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.721506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.721628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.721652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.721780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.721949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.721977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.722142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.722289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.722315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.722461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.722560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.722587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.722709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.722851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.722876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.723005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.723124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.723150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.723245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.723383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.723420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.723538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.723635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.723659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.723789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.723924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.723954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.724100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.724226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.724250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.724435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.724596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.724622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.724737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.724847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.724874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.725019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.725166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.725199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.171 [2024-11-29 09:51:09.725326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.725447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.171 [2024-11-29 09:51:09.725473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.171 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.725575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.725667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.725693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.725816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.725912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.725937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.726063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.726155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.726182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.726332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.726477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.726506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.726651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.726801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.726826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.726952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.727043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.727067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.727245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.727366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.727391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.727521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.727610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.727635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.727761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.727898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.727923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.728054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.728187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.728215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.728331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.728474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.728501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.728651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.728780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.728807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.728940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.729060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.729085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.729204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.729292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.729317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.729437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.729555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.729581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.729672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.729771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.729797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.729926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.730049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.730074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.730202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.730358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.730385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.730519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.730623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.730648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.730754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.730877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.730902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.731051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.731144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.731172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.731333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.731446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.731474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.731601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.731725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.731751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.731845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.731964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.731989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.732110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.732244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.732271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.732421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.732519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.732544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.732711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.732850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.732875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.733002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.733145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.733173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.172 qpair failed and we were unable to recover it. 00:27:47.172 [2024-11-29 09:51:09.733328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.733455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.172 [2024-11-29 09:51:09.733480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.733581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.733724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.733768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.733872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.733960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.733985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.734136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.734282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.734307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.734407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.734527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.734552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.734655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.734756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.734782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.734882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.734993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.735019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.735129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.735233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.735262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.735417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.735563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.735587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.735712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.735842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.735868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.735997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.736137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.736165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.736313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.736445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.736471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.736593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.736740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.736766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.736892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.737017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.737043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.737166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.737259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.737285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.737384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.737556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.737582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.737756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.737886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.737913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.738050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.738155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.738183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.738358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.738464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.738490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.738587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.738687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.738713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.738852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.738988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.739016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.739164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.739257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.739287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.739410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.739545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.739573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.739676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.739816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.739841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.739969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.740111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.740152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.740262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.740402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.740445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.740542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.740657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.740697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.740818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.740961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.740987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.741126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.741226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.741255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.173 qpair failed and we were unable to recover it. 00:27:47.173 [2024-11-29 09:51:09.741432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.173 [2024-11-29 09:51:09.741565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.741593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.741741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.741865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.741889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.742013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.742150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.742177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.742327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.742428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.742454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.742559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.742686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.742712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.742811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.742951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.742978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.743084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.743196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.743223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.743346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.743466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.743491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.743643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.743761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.743786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.743927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.744090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.744118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.744266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.744412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.744437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.744558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.744689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.744718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.744825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.744972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.744999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.745134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.745277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.745303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.745431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.745524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.745567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.745701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.745820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.745845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.745940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.746035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.746062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.746206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.746306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.746334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.746464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.746571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.746600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.746722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.746844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.746871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.747016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.747142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.747170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.747330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.747469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.747513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.747631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.747752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.747778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.747869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.747983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.748009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.748149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.748249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.748277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.748404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.748522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.174 [2024-11-29 09:51:09.748548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.174 qpair failed and we were unable to recover it. 00:27:47.174 [2024-11-29 09:51:09.748673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.748829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.748858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.748995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.749128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.749156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.749375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.749522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.749548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.749698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.749831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.749859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.750021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.750150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.750177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.750291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.750439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.750465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.750585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.750698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.750724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.750865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.751013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.751041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.751146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.751232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.751257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.751379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.751560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.751587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.751688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.751833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.751859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.752003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.752096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.752123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.752302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.752403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.752429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.752568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.752698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.752740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.752834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.752988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.753013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.753115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.753206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.753231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.753320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.753418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.753444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.753577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.753681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.753712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.753837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.753984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.754009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.754162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.754294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.754322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.754462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.754586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.754612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.754731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.754833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.754860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.755023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.755155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.755183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.755294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.755384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.755417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.755589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.755670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.755696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.755791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.755926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.755953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.756122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.756250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.756275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.756426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.756537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.756563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.175 [2024-11-29 09:51:09.756669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.756786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.175 [2024-11-29 09:51:09.756813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.175 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.756963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.757088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.757113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.757236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.757369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.757407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.757540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.757643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.757670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.757841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.757999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.758024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.758113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.758236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.758261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.758357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.758509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.758539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.758686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.758809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.758835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.758953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.759062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.759090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.759220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.759321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.759350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.759525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.759649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.759692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.759868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.759965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.759990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.760155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.760336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.760361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.760496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.760622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.760646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.760772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.760897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.760922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.761072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.761200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.761227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.761356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.761463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.761489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.761634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.761766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.761794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.761930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.762093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.762122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.762256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.762381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.762416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.762550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.762677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.762702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.762820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.762950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.762978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.763082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.763197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.763239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.763344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.763514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.763539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.763635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.763741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.763769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.763879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.764025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.764050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.764166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.764301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.764328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.764462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.764574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.764601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.764771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.764898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.764923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.176 [2024-11-29 09:51:09.765022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.765124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.176 [2024-11-29 09:51:09.765152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.176 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.765288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.765419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.765449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.765589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.765736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.765762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.765857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.765943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.765968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.766073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.766234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.766263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.766417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.766537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.766562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.766702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.766832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.766861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.766987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.767135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.767160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.767257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.767376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.767407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.767570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.767712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.767741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.767900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.768005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.768034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.768150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.768307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.768339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.768466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.768589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.768614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.768735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.768859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.768886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.769007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.769133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.769159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.769336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.769484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.769509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.769633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.769753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.769779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.769929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.770016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.770042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.770156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.770302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.770328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.770465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.770611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.770636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.770795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.770914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.770941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.771057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.771192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.771226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.771332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.771470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.771500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.771617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.771733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.771759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.771895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.771978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.772020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.772132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.772255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.772282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.772389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.772520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.772548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.772666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.772806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.772835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.772995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.773103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.773133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.177 qpair failed and we were unable to recover it. 00:27:47.177 [2024-11-29 09:51:09.773270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.177 [2024-11-29 09:51:09.773361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.773387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.773493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.773613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.773638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.773724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.773843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.773868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.773968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.774093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.774118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.774234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.774374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.774411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.774531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.774661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.774690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.774837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.774922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.774948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.775082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.775239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.775268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.775422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.775543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.775568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.775669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.775765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.775792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.775909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.776057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.776082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.776174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.776263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.776289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.776377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.776487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.776512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.776630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.776743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.776772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.776883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.776984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.777013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.777182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.777271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.777297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.777405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.777521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.777547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.777662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.777761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.777786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.777920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.778046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.778072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.778206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.778315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.778344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.778461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.778588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.778618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.778748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.778834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.778859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.779024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.779132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.779162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.779309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.779438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.779466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.779598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.779692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.779717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.779834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.779951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.779976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.780104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.780232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.780258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.780406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.780546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.780572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.780670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.780825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.780851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.178 qpair failed and we were unable to recover it. 00:27:47.178 [2024-11-29 09:51:09.780975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.178 [2024-11-29 09:51:09.781124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.781153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.781274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.781420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.781446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.781536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.781624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.781650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.781774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.781866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.781891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.781981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.782084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.782110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.782200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.782346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.782373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.782502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.782587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.782613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.782764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.782913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.782939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.783076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.783237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.783266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.783428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.783613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.783639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.783765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.783913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.783938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.784056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.784158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.784186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.784324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.784475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.784502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.784646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.784763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.784788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.784870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.785017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.785046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.785177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.785301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.785328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.785432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.785525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.785550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.785673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.785836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.785865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.785975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.786086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.786114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.786236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.786361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.786387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.786505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.786631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.786659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.786791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.786931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.786960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.787127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.787220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.787247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.787369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.787524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.787550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.787672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.787826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.787851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.787954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.788078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.179 [2024-11-29 09:51:09.788104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.179 qpair failed and we were unable to recover it. 00:27:47.179 [2024-11-29 09:51:09.788237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.788330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.788357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.788495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.788600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.788629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.788793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.788909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.788935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.789045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.789208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.789238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.789344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.789479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.789509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.789627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.789754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.789780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.789902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.790051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.790079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.790204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.790339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.790368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.790492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.790587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.790614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.790769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.790866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.790894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.791024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.791156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.791185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.791354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.791509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.791536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.791627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.791772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.791801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.791962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.792088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.792116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.792260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.792367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.792400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.792527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.792614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.792640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.792756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.792877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.792902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.793060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.793143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.793169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.793285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.793426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.793455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.793598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.793722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.793750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.793905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.794019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.794046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.794143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.794272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.794301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.794433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.794579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.794605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.794691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.794818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.794844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.794974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.795101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.795129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.795303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.795426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.795452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.795606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.795698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.795725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.795838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.795975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.796003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.180 [2024-11-29 09:51:09.796139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.796251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.180 [2024-11-29 09:51:09.796280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.180 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.796424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.796547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.796574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.796695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.796821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.796847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.796970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.797068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.797095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.797191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.797306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.797332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.797434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.797596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.797624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.797728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.797852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.797896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.798020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.798113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.798140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.798269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.798406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.798436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.798546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.798720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.798745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.798860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.799005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.799031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.799125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.799243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.799273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.799368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.799513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.799557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.799687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.799788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.799814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.799982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.800077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.800105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.800237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.800372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.800451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.800591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.800715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.800742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.800852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.800940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.800969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.801097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.801232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.801261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.801407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.801530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.801556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.801712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.801836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.801862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.801955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.802078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.802103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.802207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.802323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.802350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.802483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.802607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.802635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.802744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.802871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.802899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.803042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.803165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.803192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.803290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.803378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.803412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.803562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.803720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.803749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.803856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.803975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.804001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.181 [2024-11-29 09:51:09.804140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.804246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.181 [2024-11-29 09:51:09.804287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.181 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.804422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.804522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.804548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.804650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.804775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.804800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.804915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.805073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.805102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.805234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.805372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.805405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.805534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.805626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.805652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.805799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.805891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.805917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.806015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.806136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.806162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.806288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.806377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.806411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.806526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.806653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.806682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.806851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.807031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.807057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.807181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.807306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.807332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.807477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.807579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.807606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.807724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.807883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.807912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.808049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.808169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.808195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.808316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.808413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.808440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.808561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.808658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.808684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.808800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.808888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.808914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.809017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.809151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.809179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.809304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.809417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.809446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.809561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.809681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.809707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.809828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.809925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.809951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.810083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.810192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.810221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.810380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.810541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.810566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.810688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.810813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.810839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.810961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.811058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.811084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.811202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.811288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.811313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.811434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.811564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.811593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.811747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.811867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.811892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.182 [2024-11-29 09:51:09.811988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.812108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.182 [2024-11-29 09:51:09.812133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.182 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.812278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.812422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.812452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.812619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.812754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.812784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.812898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.813015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.813040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.813127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.813222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.813251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.813340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.813463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.813489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.813594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.813691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.813717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.813818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.813958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.813988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.814086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.814217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.814246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.814352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.814496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.814522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.814672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.814816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.814843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.814967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.815115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.815141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.815253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.815418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.815444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.815566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.815692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.815717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.815809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.815911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.815940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.816064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.816213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.816239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.816401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.816493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.816519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.816652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.816773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.816801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.816952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.817071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.817096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.817186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.817350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.817378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.817497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.817626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.817654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.817801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.817896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.817922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.818034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.818129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.818173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.818312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.818457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.818483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.818574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.818671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.818697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.818827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.818929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.818973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.819132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.819223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.819252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.819425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.819529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.183 [2024-11-29 09:51:09.819556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.183 qpair failed and we were unable to recover it. 00:27:47.183 [2024-11-29 09:51:09.819675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.819818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.819844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.819945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.820037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.820062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.820160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.820286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.820311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.820435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.820538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.820568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.820669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.820817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.820842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.820927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.821048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.821076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.821241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.821377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.821414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.821586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.821700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.821725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.821849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.821998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.822025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.822216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.822337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.822363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.822495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.822598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.822625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.822720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.822842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.822868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.823012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.823146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.823174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.823314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.823450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.823479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.823625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.823729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.823755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.823862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.824012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.824038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.824194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.824326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.824356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.824529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.824659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.824686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.824837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.824986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.825012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.825133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.825257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.825282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.825379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.825482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.825508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.825642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.825780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.825809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.825943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.826080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.826106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.826219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.826362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.826391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.826548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.826712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.826740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.826886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.827043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.827072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.184 [2024-11-29 09:51:09.827212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.827334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.184 [2024-11-29 09:51:09.827360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.184 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.827475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.827628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.827655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.827799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.827921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.827949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.828083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.828208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.828235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.828427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.828562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.828591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.828709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.828813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.828839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.828936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.829080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.829106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.829196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.829371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.829407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.829543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.829634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.829662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.829835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.829931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.829958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.830120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.830277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.830304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.830432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.830592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.830626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.830743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.830870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.830897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.831033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.831182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.831208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.831334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.831467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.831493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.831615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.831728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.831753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.831864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.831992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.832021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.832157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.832257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.832285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.832438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.832588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.832613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.832701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.832829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.832855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.832953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.833089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.833130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.833225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.833319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.833345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.833453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.833572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.833597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.833697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.833813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.833855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.833996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.834120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.834145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.834292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.834385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.834420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.834542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.834657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.834685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.834828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.834916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.834941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.835067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.835186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.835212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.185 [2024-11-29 09:51:09.835318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.835440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.185 [2024-11-29 09:51:09.835466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.185 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.835588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.835678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.835703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.835802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.835922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.835965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.836107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.836243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.836272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.836422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.836515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.836541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.836637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.836778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.836808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.836968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.837127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.837156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.837325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.837426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.837452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.837546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.837647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.837672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.837794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.837907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.837932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.838056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.838153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.838180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.838288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.838382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.838425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.838527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.838684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.838712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.838874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.838961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.838987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.839110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.839274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.839300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.839418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.839561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.839591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.839747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.839874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.839899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.840019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.840114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.840141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.840265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.840389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.840450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.840580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.840702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.840728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.840831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.840936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.840962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.841063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.841200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.841229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.841412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.841552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.841579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.841720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.841897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.841923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.842050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.842193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.842222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.842336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.842452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.842478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.842616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.842745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.842774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.842889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.843017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.843044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.843137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.843228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.843254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.186 [2024-11-29 09:51:09.843422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.843582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.186 [2024-11-29 09:51:09.843611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.186 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.843744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.843877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.843903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.844053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.844178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.844221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.844321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.844422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.844451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.844559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.844718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.844752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.844899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.845020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.845046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.845197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.845318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.845343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.845460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.845542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.845567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.845660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.845752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.845778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.845874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.846001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.846027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.846188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.846290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.846320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.846460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.846555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.846580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.846695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.846819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.846848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.846952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.847041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.847068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.847219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.847345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.847373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.847507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.847630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.847656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.847798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.847934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.847962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.848109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.848244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.848270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.848358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.848466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.848492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.848638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.848764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.848792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.848975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.849121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.849165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.849302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.849472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.849503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.849650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.849782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.849812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.849934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.850052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.850078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.850184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.850353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.850379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.850495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.850616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.850642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.850761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.850882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.850908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.851019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.851127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.851156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.851285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.851430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.851459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.187 [2024-11-29 09:51:09.851607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.851744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.187 [2024-11-29 09:51:09.851770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.187 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.851924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.852076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.852102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.852218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.852312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.852337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.852428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.852522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.852548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.852661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.852828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.852858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.853025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.853146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.853174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.853305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.853408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.853436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.853580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.853742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.853770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.853935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.854065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.854093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.854236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.854387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.854422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.854581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.854673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.854699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.854786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.854929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.854957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.855104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.855194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.855220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.855356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.855501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.855532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.855659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.855764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.855793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.855966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.856079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.856104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.856261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.856423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.856450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.856627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.856732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.856760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.856880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.857005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.857031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.857157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.857250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.857276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.857372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.857482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.857512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.857659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.857754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.857781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.857904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.858052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.858081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.858218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.858352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.858381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.858533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.858632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.858658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.188 [2024-11-29 09:51:09.858778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.858902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.188 [2024-11-29 09:51:09.858927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.188 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.859075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.859242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.859272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.859403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.859505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.859531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.859634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.859726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.859751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.859876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.859967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.859994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.860110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.860240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.860266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.860440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.860558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.860584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.860674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.860819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.860847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.860996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.861118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.861143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.861311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.861461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.861488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.861608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.861796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.861823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.861956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.862079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.862105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.862255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.862377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.862410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.862538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.862658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.862689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.862824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.862942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.862967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.863137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.863299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.863328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.863472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.863576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.863602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.863734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.863887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.863913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.864002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.864132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.864161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.864293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.864451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.864481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.864602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.864696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.864721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.864847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.864967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.864993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.865098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.865216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.865241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.865404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.865495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.865521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.865694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.865836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.865861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.866005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.866153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.866182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.866348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.866504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.866547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.866717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.866815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.866844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.189 qpair failed and we were unable to recover it. 00:27:47.189 [2024-11-29 09:51:09.866979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.867150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.189 [2024-11-29 09:51:09.867176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.867273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.867369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.867399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.867496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.867610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.867635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.867724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.867817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.867844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.868014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.868129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.868155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.868280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.868439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.868465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.868585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.868726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.868754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.868872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.868999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.869024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.869160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.869259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.869288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.869425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.869593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.869622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.869765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.869911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.869938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.870037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.870150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.870175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.870322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.870428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.870457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.870604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.870753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.870779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.870901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.871048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.871078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.871182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.871353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.871379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.871532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.871657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.871683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.871809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.871941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.871969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.872105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.872231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.872259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.872406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.872528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.872554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.872668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.872822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.872864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.873026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.873162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.873190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.873299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.873403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.873430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.873566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.873710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.873736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.873836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.873920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.873949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.874043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.874167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.874194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.190 qpair failed and we were unable to recover it. 00:27:47.190 [2024-11-29 09:51:09.874342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.190 [2024-11-29 09:51:09.874487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.874514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.874632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.874745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.874776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.874927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.875080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.875105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.875254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.875355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.875383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.875560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.875693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.875721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.875835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.875926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.875952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.876133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.876237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.876264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.876413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.876509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.876535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.876640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.876734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.876765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.876855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.876975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.877001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.877148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.877283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.877311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.877455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.877568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.877595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.877689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.877777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.877802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.877891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.878018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.878044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.878165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.878310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.878336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.878497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.878613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.878640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.878825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.878924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.878949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.879049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.879174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.879199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.879285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.879410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.879453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.879592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.879684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.879710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.879892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.880040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.880066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.880218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.880362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.880387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.880510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.880654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.880684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.880822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.880954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.880980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.881086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.881249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.881277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.881399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.881501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.881527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.881649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.881740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.881765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.881904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.882038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.882067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.191 qpair failed and we were unable to recover it. 00:27:47.191 [2024-11-29 09:51:09.882208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.191 [2024-11-29 09:51:09.882342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.882370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.882521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.882640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.882665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.882748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.882866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.882893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.883000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.883129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.883155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.883271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.883400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.883426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.883512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.883608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.883633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.883782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.883924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.883953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.884121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.884246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.884271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.884442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.884565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.884591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.884707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.884806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.884835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.884949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.885042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.885067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.885184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.885315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.885341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.885439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.885526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.885553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.885677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.885757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.885783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.885930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.886060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.886089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.886225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.886385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.886420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.886559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.886645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.886671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.886834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.886956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.886986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.887148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.887299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.887325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.887449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.887539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.887564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.887692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.887805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.887831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.887919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.888073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.888100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.888227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.888343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.888369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.888509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.888661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.888687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.888832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.888994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.889020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.889109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.889252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.889278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.192 qpair failed and we were unable to recover it. 00:27:47.192 [2024-11-29 09:51:09.889430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.192 [2024-11-29 09:51:09.889546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.889572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.889721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.889860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.889888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.890031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.890152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.890179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.890318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.890467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.890493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.890590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.890688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.890714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.890830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.890949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.890978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.891090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.891213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.891242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.891380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.891527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.891556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.891708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.891795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.891821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.891913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.892031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.892059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.892174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.892307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.892335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.892492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.892591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.892616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.892766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.892860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.892886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.893013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.893103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.893128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.893241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.893362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.893391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.893512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.893632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.893658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.893755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.893893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.893922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.894067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.894188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.894214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.894328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.894463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.894493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.894674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.894798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.894824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.894945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.895065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.895092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.895247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.895374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.895422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.895527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.895660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.895685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.193 qpair failed and we were unable to recover it. 00:27:47.193 [2024-11-29 09:51:09.895774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.193 [2024-11-29 09:51:09.895862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.895888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.896054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.896184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.896213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.896349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.896453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.896478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.896585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.896680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.896705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.896846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.896980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.897009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.897116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.897206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.897234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.897366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.897457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.897483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.897589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.897678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.897704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.897839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.897987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.898012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.898129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.898276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.898301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.898454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.898536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.898562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.898703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.898830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.898858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.898971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.899095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.899122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.899240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.899374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.899410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.899527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.899652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.899677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.899793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.899913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.899939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.900042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.900176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.900204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.900340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.900442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.900472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.900620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.900712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.900737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.900864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.900987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.901013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.901136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.901284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.901312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.901492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.901595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.901622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.901720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.901863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.901892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.902027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.902156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.902186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.902301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.902423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.902450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.194 qpair failed and we were unable to recover it. 00:27:47.194 [2024-11-29 09:51:09.902623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.902765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.194 [2024-11-29 09:51:09.902791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.902893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.902989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.903016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.903198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.903323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.903349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.903478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.903576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.903602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.903734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.903856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.903884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.904017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.904140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.904166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.904315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.904413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.904443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.904619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.904721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.904748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.904870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.904957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.904987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.905103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.905196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.905240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.905382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.905518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.905543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.905640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.905759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.905784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.905882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.906003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.906028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.906133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.906254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.906280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.906404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.906525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.906551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.906717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.906816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.906841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.906985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.907119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.907148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.907295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.907422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.907448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.907596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.907691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.907720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.907828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.907955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.907984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.908148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.908269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.908294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.908375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.908505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.908530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.908620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.908712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.908737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.908882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.909058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.909086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.909213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.909314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.909342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.909499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.909613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.909638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.909722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.909868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.909893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.909984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.910074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.910101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.195 qpair failed and we were unable to recover it. 00:27:47.195 [2024-11-29 09:51:09.910194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.195 [2024-11-29 09:51:09.910293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.910321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.910476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.910601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.910629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.910768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.910889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.910920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.911031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.911172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.911200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.911340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.911434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.911461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.911564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.911655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.911681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.911795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.911971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.911999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.912119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.912243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.912268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.912389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.912480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.912505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.912628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.912790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.912818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.912953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.913098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.913123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.913325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.913409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.913437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.913525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.913673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.913699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.913821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.913947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.913972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.914124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.914258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.914286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.914397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.914544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.914569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.914673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.914770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.914795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.914882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.915031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.915056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.915176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.915307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.915335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.915512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.915612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.915638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.915788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.915920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.915950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.916087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.916218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.916247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.916391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.916552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.916595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.916687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.916817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.916846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.917021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.917172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.917198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.917291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.917439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.917466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.917593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.917689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.917714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.917857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.917989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.918017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.196 qpair failed and we were unable to recover it. 00:27:47.196 [2024-11-29 09:51:09.918166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.196 [2024-11-29 09:51:09.918289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.918315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.918434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.918564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.918593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.918724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.918859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.918887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.919008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.919130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.919160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.919249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.919408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.919437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.919575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.919756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.919781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.919899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.920067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.920092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.920191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.920290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.920315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.920415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.920564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.920590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.920747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.920906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.920935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.921036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.921169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.921197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.921309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.921460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.921490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.921628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.921779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.921805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.921950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.922075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.922109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.922211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.922372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.922405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.922501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.922592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.922618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.922764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.922851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.922876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.923011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.923147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.923175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.923312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.923409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.923437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.923563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.923701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.923744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.923829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.923956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.923982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.924105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.924203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.924229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.924377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.924540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.924569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.924693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.924854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.924882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.925061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.925209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.925253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.925407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.925525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.925550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.925635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.925798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.925826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.925998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.926123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.926149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.926241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.926364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.926390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.926519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.926613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.926642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.926775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.926919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.926962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.197 qpair failed and we were unable to recover it. 00:27:47.197 [2024-11-29 09:51:09.927121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.197 [2024-11-29 09:51:09.927251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.927280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.927401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.927514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.927539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.927661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.927751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.927777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.927875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.927997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.928024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.928159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.928263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.928291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.928488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.928586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.928612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.928786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.928883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.928912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.929064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.929213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.929238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.929341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.929436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.929464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.929608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.929788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.929840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.929978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.930123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.930150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.930301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.930389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.930422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.930526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.930643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.930669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.930794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.930960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.930989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.931127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.931250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.931277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.931419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.931510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.931552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.931645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.931773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.931799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.931925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.932014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.932040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.932180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.932288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.932317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.932462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.932588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.932614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.932758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.932893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.932919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.933042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.933141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.933167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.933299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.933431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.933461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.933569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.933694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.933719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.933830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.933959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.933988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.934090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.934216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.934244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.934398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.934551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.198 [2024-11-29 09:51:09.934592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.198 qpair failed and we were unable to recover it. 00:27:47.198 [2024-11-29 09:51:09.934735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.934833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.934861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.934990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.935129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.935158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.935307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.935407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.935435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.935592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.935689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.935715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.935812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.935903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.935947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.936063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.936213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.936239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.936426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.936542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.936572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.936671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.936787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.936813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.936906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.937031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.937057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.937153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.937274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.937301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.937450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.937608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.937637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.937780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.937872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.937898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.938051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.938181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.938210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.938376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.938487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.938516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.938684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.938835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.938877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.939026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.939159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.939184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.939339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.939472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.939499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.939653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.939759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.939785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.939928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.940088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.940117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.940254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.940355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.940405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.940537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.940651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.940676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.940782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.940902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.940928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.941020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.941120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.941146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.941260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.941371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.941405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.941504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.941649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.941674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.941795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.941911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.941937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.942059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.942140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.942166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.942289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.942428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.942457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.942621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.942752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.942782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.942950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.943075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.943100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.943200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.943348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.199 [2024-11-29 09:51:09.943374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.199 qpair failed and we were unable to recover it. 00:27:47.199 [2024-11-29 09:51:09.943504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.943624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.943652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.943807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.943934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.943979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.944111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.944241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.944282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.944414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.944512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.944539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.944689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.944810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.944838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.944931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.945070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.945098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.945207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.945350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.945379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.945541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.945636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.945662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.945784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.945965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.945991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.946116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.946251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.946280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.946412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.946534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.946560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.946655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.946774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.946799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.946888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.947023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.947048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.947176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.947300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.947326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.947436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.947569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.947595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.947695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.947775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.947802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.947900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.948026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.948053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.948233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.948362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.948391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.948540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.948664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.948693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.948805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.948930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.948956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.949152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.949277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.949302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.949387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.949491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.949516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.949611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.949705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.949731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.949873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.950036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.950065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.950229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.950328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.950356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.950504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.950594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.950619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.950735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.950830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.950863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.950966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.951064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.951093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.951223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.951348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.951374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.951533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.951677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.951703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.951829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.951924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.951950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.200 qpair failed and we were unable to recover it. 00:27:47.200 [2024-11-29 09:51:09.952074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.200 [2024-11-29 09:51:09.952227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.952268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.952424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.952558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.952587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.952695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.952828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.952856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.952998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.953121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.953147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.953291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.953450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.953479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.953639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.953757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.953782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.953888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.954006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.954032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.954180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.954300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.954326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.954410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.954503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.954528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.954650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.954741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.954766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.954856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.955002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.955028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.955149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.955283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.955312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.955486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.955582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.955608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.955713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.955886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.955911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.956036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.956160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.956186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.956337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.956452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.956478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.956647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.956735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.956762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.956863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.957010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.957037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.957186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.957277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.957304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.957420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.957544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.957572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.957684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.957819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.957849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.958010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.958134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.958160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.958276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.958412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.958442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.958578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.958739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.958769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.958934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.959053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.959079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.959211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.959297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.959323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.959477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.959621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.959665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.959794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.959910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.959936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.960097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.960182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.960207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.960376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.960510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.960539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.960654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.960773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.960798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.960938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.961072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.961100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.961262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.961385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.201 [2024-11-29 09:51:09.961440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.201 qpair failed and we were unable to recover it. 00:27:47.201 [2024-11-29 09:51:09.961541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.961640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.961665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.961767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.961865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.961890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.961974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.962054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.962080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.962268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.962404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.962447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.962555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.962655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.962684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.962828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.962963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.962991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.963105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.963231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.963256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.963380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.963489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.963519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.963626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.963752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.963780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.963918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.964043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.964069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.964197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.964319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.964346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.964476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.964588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.964616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.964732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.964822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.964848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.964982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.965119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.965152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.965286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.965419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.965449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.965575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.965719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.965744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.965854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.965989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.966018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.966151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.966256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.966284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.966471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.966571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.966597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.966751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.966875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.966901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.966998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.967106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.967135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.967254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.967403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.967447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.967573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.967704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.967732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.967901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.967992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.968020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.968124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.968220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.968246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.968363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.968502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.968531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.968712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.968839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.968865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.968991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.969080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.969106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.969197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.969349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.969375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.202 [2024-11-29 09:51:09.969485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.969565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.202 [2024-11-29 09:51:09.969607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.202 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 09:51:09.969750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 09:51:09.969880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 09:51:09.969906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 09:51:09.969999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 09:51:09.970092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 09:51:09.970118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 09:51:09.970268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 09:51:09.970353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 09:51:09.970379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.203 [2024-11-29 09:51:09.970517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 09:51:09.970608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.203 [2024-11-29 09:51:09.970634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.203 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.970730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.970853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.970878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.970972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.971103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.971133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.971260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.971381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.971415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.971501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.971597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.971622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.971717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.971837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.971863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.971986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.972079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.972106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.972242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.972351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.972381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.972521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.972652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.972680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.972795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.972919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.972945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.973069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.973248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.973278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.973434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.973584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.973610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.973740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.973859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.973884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.973983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.974105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.974132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.974265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.974434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.974460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.974608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.974725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.974750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.974930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.975030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.975059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.975178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.975267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.975295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.975412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.975540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.975567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.975652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.975836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.975865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.975999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.976113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.976139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.976259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.976358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.976383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.976501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.976593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.976619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.976707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.976834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.976860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.976979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.977061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.977087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.977231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.977382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.497 [2024-11-29 09:51:09.977417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.497 qpair failed and we were unable to recover it. 00:27:47.497 [2024-11-29 09:51:09.977521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.977635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.977678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.977848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.977950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.977977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.978098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.978190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.978216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.978308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.978401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.978428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.978548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.978674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.978700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.978887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.979003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.979032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.979128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.979273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.979316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.979450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.979545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.979571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.979672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.979808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.979836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.980003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.980105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.980133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.980251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.980402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.980429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.980546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.980653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.980681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.980816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.980942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.980971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.981143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.981292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.981317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.981445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.981561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.981586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.981686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.981836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.981870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.981995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.982118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.982143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.982281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.982411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.982441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.982606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.982739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.982767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.982881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.982968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.982994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.983123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.983247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.983272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.983420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.983518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.983546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.983701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.983844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.983871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.983996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.984124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.984149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.984284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.984377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.984428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.984559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.984653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.984679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.984785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.984910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.984938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.985071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.985165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.985193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.498 qpair failed and we were unable to recover it. 00:27:47.498 [2024-11-29 09:51:09.985329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.985451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.498 [2024-11-29 09:51:09.985478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.985630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.985736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.985765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.985898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.986031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.986060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.986227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.986324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.986350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.986480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.986584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.986610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.986732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.986823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.986865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.986990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.987110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.987136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.987264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.987430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.987459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.987590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.987712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.987738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.987861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.987983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.988009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.988113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.988273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.988302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.988421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.988556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.988585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.988707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.988827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.988853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.989034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.989194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.989223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.989387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.989529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.989557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.989735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.989837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.989864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.989987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.990099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.990124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.990250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.990335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.990360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.990502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.990597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.990624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.990778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.990897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.990923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.991062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.991195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.991225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.991349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.991529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.991555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.991645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.991736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.991779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.991913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.992043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.992072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.992195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.992308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.992333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.992423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.992510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.992535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.992689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.992813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.992840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.992938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.993059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.993085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.993197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.993332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.993360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.499 qpair failed and we were unable to recover it. 00:27:47.499 [2024-11-29 09:51:09.993511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.993617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.499 [2024-11-29 09:51:09.993645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.993787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.993913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.993939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.994089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.994202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.994231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.994366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.994522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.994548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.994668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.994758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.994783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.994869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.994987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.995013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.995136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.995229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.995255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.995347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.995475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.995502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.995607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.995695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.995721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.995820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.995905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.995952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.996104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.996206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.996232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.996364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.996511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.996540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.996636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.996759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.996788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.996932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.997038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.997063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.997157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.997309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.997336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.997458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.997579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.997606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.997696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.997808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.997834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.997965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.998073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.998099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.998195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.998311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.998353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.998482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.998611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.998637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.998763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.998887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.998914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.999058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.999173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.999199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.999376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.999522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.999548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:09.999668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.999815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:09.999844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:10.000013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:10.000151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:10.000180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:10.000319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:10.000446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:10.000473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:10.000576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:10.000680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:10.000709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:10.000844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:10.000974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:10.001000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:10.001128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:10.001225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:10.001252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.500 qpair failed and we were unable to recover it. 00:27:47.500 [2024-11-29 09:51:10.001406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:10.001513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.500 [2024-11-29 09:51:10.001555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.001705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.001822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.001847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.001972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.002070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.002097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.002219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.002328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.002354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.002470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.002565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.002592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.002687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.002814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.002839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.002947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.003052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.003080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.003182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.003342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.003370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.003513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.003616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.003642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.003757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.003859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.003885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.003981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.004097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.004123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.004274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.004380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.004419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.004524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.004647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.004688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.004788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.004897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.004927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.005095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.005182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.005208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.005354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.005475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.005520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.005655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.005788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.005824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.005981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.006105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.006142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.006285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.006448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.006494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.006643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.006759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.006805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.006949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.007080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.007122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.007263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.007374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.007407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.007524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.007620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.007647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.007745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.007866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.007892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.501 [2024-11-29 09:51:10.008016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.008100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.501 [2024-11-29 09:51:10.008126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.501 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.008282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.008421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.008448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.008578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.008669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.008696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.008830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.008952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.008980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.009105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.009229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.009255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.009361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.009461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.009488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.009581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.009663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.009688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.009786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.009924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.009955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.010051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.010196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.010221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.010313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.010420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.010446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.010541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.010629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.010655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.010740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.010823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.010849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.010944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.011060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.011085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.011238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.011337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.011363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.011462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.011550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.011575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.011706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.011828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.011854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.011948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.012069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.012097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.012239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.012446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.012472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.012601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.012703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.012728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.012832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.012953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.012980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.013077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.013166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.013193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.013367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.013490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.013517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.013648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.013793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.013818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.013937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.014054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.014080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.014220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.014345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.014375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.014528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.014672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.014702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.014835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.015013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.015063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.015207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.015387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.015421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.502 qpair failed and we were unable to recover it. 00:27:47.502 [2024-11-29 09:51:10.015557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.015681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.502 [2024-11-29 09:51:10.015709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.015808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.015933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.015960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.016063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.016198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.016226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.016354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.016486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.016533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.016650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.016796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.016824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.016979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.017093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.017122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.017275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.017409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.017438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.017598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.017759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.017806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.017991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.018124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.018153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.018278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.018374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.018408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.018575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.018739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.018786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.018918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.019067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.019095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.019196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.019335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.019377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.019507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.019673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.019719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.019894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.020065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.020095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.020281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.020407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.020435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.020545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.020694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.020723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.020854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.021001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.021029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.021179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.021327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.021355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.021466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.021571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.021601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.021746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.021898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.021926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.022054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.022180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.022208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.022333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.022476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.022527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.022686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.022855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.022905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.023059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.023186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.023214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.023340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.023450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.023478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.023598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.023771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.023802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.023983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.024128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.024157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.024255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.024353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.024382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.503 qpair failed and we were unable to recover it. 00:27:47.503 [2024-11-29 09:51:10.024517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.503 [2024-11-29 09:51:10.024616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.024644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.024748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.024872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.024899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.024999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.025133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.025161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.025283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.025418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.025448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.025581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.025731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.025759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.025860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.025950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.025978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.026103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.026201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.026230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.026369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.026505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.026534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.026632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.026757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.026784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.026908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.027028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.027058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.027245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.027381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.027435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.027543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.027688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.027719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.027821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.027929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.027961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.028072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.028186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.028214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.028333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.028452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.028481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.028574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.028706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.028736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.028901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.029016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.029046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.029185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.029298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.029328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.029445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.029580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.029608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.029751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.029969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.030020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.030119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.030269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.030297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.030400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.030504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.030533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.030622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.030754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.030781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.030955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.031101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.031143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.031290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.031408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.031455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.031557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.031650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.031678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.031817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.031980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.032011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.032140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.032278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.032308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.504 qpair failed and we were unable to recover it. 00:27:47.504 [2024-11-29 09:51:10.032468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.504 [2024-11-29 09:51:10.032611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.032640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.032754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.032871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.032902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.033036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.033177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.033209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.033326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.033452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.033485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.033581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.033749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.033779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.033909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.034070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.034102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.034235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.034386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.034425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.034573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.034738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.034769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.034904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.035047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.035078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.035236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.035374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.035411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.035557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.035698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.035729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.035889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.036015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.036045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.036249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.036424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.036452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.036547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.036649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.036676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.036778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.036922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.036953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.037144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.037304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.037334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.037439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.037550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.037579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.037722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.037832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.037863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.037976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.038127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.038157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.038324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.038448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.038477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.038581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.038676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.038719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.038837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.038951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.038982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.039094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.039190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.039221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.039390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.039554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.039600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.039729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.039876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.039908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.040077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.040182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.040212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.040323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.040445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.040473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.040568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.040690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.040720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.505 qpair failed and we were unable to recover it. 00:27:47.505 [2024-11-29 09:51:10.040886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.505 [2024-11-29 09:51:10.041019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.041049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.041182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.041316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.041346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.041496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.041615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.041643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.041737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.041843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.041873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.042037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.042137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.042166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.042294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.042405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.042453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.042588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.042705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.042736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.042852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.042960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.042991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.043121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.043214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.043244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.043360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.043462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.043489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.043604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.043731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.043761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.043869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.043960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.043990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.044149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.044287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.044314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.044478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.044599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.044627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.044746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.044918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.044947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.045062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.045196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.045225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.045357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.045466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.045494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.045626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.045727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.045755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.045864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.046008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.046065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.046201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.046355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.046413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.046562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.046736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.046787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.046951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.047093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.047148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.047297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.047465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.047513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.047668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.047826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.047858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.506 [2024-11-29 09:51:10.047961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.048062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.506 [2024-11-29 09:51:10.048090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.506 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.048185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.048285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.048314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.048437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.048538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.048571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.048676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.048798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.048825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.048979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.049063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.049091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.049195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.049290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.049316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.049443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.049555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.049587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.049700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.049790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.049817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.049918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.050041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.050084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.050188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.050316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.050343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.050440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.050570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.050596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.050691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.050799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.050828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.050944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.051063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.051093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.051224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.051342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.051368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.051503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.051598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.051624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.051731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.051827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.051853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.052001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.052130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.052172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.052317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.052442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.052469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.052569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.052662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.052689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.052779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.052900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.052926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.053072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.053171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.053205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.053383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.053497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.053522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.053644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.053759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.053785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.053933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.054070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.054099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.054276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.054421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.054449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.054542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.054661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.054687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.054816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.054938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.054964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.507 qpair failed and we were unable to recover it. 00:27:47.507 [2024-11-29 09:51:10.055062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.055146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.507 [2024-11-29 09:51:10.055173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.055295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.055426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.055464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.055611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.055714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.055740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.055841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.055988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.056014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.056162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.056257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.056283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.056450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.056550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.056576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.056713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.056862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.056889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.057051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.057177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.057204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.057326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.057476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.057515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.057689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.057835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.057864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.058035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.058180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.058222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.058331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.058430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.058460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.058614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.058734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.058759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.058864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.058959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.058985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.059086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.059167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.059193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.059312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.059437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.059464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.059560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.059664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.059698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.059824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.059984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.060012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.060110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.060210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.060236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.060383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.060507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.060533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.060630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.060724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.060752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.060925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.061027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.061058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.061227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.061342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.061370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.061482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.061581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.061607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.061757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.061868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.061903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.062032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.062158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.062185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.062322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.062455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.062491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.062608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.062749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.062778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.062956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.063066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.063093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.508 qpair failed and we were unable to recover it. 00:27:47.508 [2024-11-29 09:51:10.063191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.508 [2024-11-29 09:51:10.063280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.063306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.063429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.063524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.063567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.063697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.063799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.063826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.063958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.064065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.064100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.064211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.064323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.064366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.064486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.064570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.064596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.064746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.064892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.064919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.065045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.065157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.065207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.065374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.065533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.065559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.065663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.065784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.065809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.065929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.066046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.066071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.066225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.066389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.066435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.066582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.066718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.066746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.066878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.067008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.067036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.067207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.067302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.067335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.067478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.067590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.067619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.067723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.067828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.067857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.068027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.068173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.068215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.068353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.068484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.068512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.068615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.068755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.068783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.068926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.069016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.069042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.069187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.069311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.069338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.069498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.069625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.069651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.069804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.069926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.069951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.070108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.070264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.070293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.070417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.070534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.070570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.070718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.070835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.070861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.070983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.071088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.509 [2024-11-29 09:51:10.071117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.509 qpair failed and we were unable to recover it. 00:27:47.509 [2024-11-29 09:51:10.071287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.071445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.071475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.071624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.071750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.071775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.071922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.072017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.072046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.072173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.072301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.072329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.072480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.072581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.072608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.072794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.072957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.072986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.073120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.073248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.073277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.073425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.073548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.073574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.073730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.073876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.073906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.074025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.074133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.074162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.074313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.074457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.074484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.074618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.074757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.074785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.074947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.075101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.075126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.075254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.075369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.075401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.075547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.075664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.075707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.075814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.075938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.075976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.076102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.076188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.076214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.076315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.076485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.076511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.076654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.076802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.076830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.076976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.077098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.077125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.077262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.077371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.077410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.077574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.077677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.077703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.077826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.077922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.077947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.078072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.078193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.078220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.078311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.078443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.078470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.078603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.078730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.078756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.078904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.079003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.079031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.079172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.079314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.079344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.510 qpair failed and we were unable to recover it. 00:27:47.510 [2024-11-29 09:51:10.079470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.510 [2024-11-29 09:51:10.079568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.079595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.079739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.079852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.079881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.079991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.080124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.080162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.080313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.080439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.080465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.080592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.080692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.080717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.080839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.080971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.081014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.081133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.081256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.081282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.081409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.081562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.081591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.081724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.081850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.081879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.082014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.082103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.082129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.082220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.082361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.082389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.082527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.082632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.082658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.082820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.082918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.082943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.083122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.083247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.083275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.083439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.083581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.083615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.083744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.083867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.083893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.084034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.084170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.084200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.084329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.084462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.084491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.084643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.084774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.084801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.084934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.085033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.085063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.085201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.085308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.085336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.085481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.085585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.085610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.085785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.085914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.085942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.086094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.086217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.086242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.511 qpair failed and we were unable to recover it. 00:27:47.511 [2024-11-29 09:51:10.086348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.511 [2024-11-29 09:51:10.086510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.086537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.086669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.086768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.086794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.086910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.087039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.087065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.087153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.087279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.087304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.087455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.087587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.087612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.087748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.087853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.087882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.088015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.088111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.088136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.088224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.088318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.088346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.088483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.088587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.088632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.088782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.088913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.088939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.089037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.089167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.089211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.089358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.089482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.089509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.089639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.089788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.089814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.089942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.090123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.090153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.090317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.090412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.090452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.090594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.090753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.090779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.090957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.091095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.091121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.091241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.091365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.091406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.091587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.091677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.091702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.091820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.091965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.091991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.092113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.092210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.092255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.092424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.092556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.092582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.092764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.092890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.092918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.093036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.093157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.093186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.093330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.093447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.093475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.093623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.093752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.093780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.093946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.094082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.094110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.094283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.094432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.094465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.094598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.094768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.512 [2024-11-29 09:51:10.094796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.512 qpair failed and we were unable to recover it. 00:27:47.512 [2024-11-29 09:51:10.094937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.095069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.095102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.095251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.095334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.095360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.095494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.095628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.095655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.095808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.095954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.095981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.096117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.096234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.096260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.096369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.096519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.096545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.096648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.096788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.096817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.096965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.097055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.097081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.097234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.097370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.097410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.097547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.097687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.097718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.097861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.097988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.098014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.098137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.098261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.098290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.098462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.098598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.098626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.098769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.098899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.098925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.099071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.099194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.099223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.099386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.099493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.099522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.099625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.099717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.099742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.099971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.100069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.100096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.100217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.100331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.100359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.100520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.100637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.100662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.100790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.100923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.100962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.101131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.101257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.101285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.101402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.101549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.101575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.101720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.101847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.101875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.101974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.102114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.102144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.102268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.102391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.102440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.102582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.102750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.102775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.102881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.102985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.103011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.513 [2024-11-29 09:51:10.103135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.103256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.513 [2024-11-29 09:51:10.103282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.513 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.103445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.103575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.103601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.103726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.103896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.103924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.104046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.104195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.104230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.104351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.104471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.104498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.104627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.104719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.104744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.104841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.104967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.104992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.105136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.105297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.105332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.105439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.105553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.105581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.105689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.105812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.105839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.105972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.106098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.106123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.106240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.106328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.106377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.106553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.106680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.106706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.106871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.106976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.107006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.107171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.107267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.107296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.107417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.107564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.107589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.107705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.107882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.107908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.108026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.108121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.108161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.108305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.108386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.108418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.108528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.108628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.108657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.108796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.108917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.108943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.109041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.109157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.109183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.109319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.109422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.109465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.109585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.109705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.109738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.109851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.109985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.110010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.110131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.110295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.110323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.110427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.110530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.110558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.110679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.110824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.110849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.110946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.111123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.111151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.514 [2024-11-29 09:51:10.111282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.111382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.514 [2024-11-29 09:51:10.111419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.514 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.111560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.111684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.111709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.111833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.111970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.111996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.112115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.112198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.112243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.112388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.112517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.112547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.112681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.112846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.112875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.112984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.113146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.113175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.113313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.113435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.113461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.113565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.113708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.113736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.113864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.114020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.114049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.114200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.114322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.114347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.114495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.114630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.114658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.114797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.114893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.114921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.115036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.115155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.115181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.115313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.115445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.115474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.115607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.115734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.115763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.115878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.116024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.116049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.116229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.116352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.116380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.116535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.116641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.116669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.116787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.116903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.116929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.117107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.117267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.117297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.117406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.117544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.117573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.117694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.117844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.117869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.118045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.118188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.118216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.118359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.118500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.118526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.118657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.118753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.118778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.515 qpair failed and we were unable to recover it. 00:27:47.515 [2024-11-29 09:51:10.118899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.515 [2024-11-29 09:51:10.119066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.119094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.119193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.119354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.119382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.119508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.119608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.119634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.119783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.119958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.119983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.120137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.120218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.120262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.120374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.120502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.120528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.120631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.120776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.120804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.120949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.121052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.121082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.121207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.121355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.121381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.121572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.121735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.121764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.121877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.122005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.122031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.122127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.122253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.122279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.122455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.122577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.122602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.122732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.122832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.122857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.123012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.123155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.123199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.123338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.123503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.123532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.123671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.123827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.123855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.124022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.124113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.124138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.124257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.124380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.124412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.124550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.124688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.124717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.124832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.124951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.124976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.125093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.125226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.125254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.125388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.125561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.125586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.125678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.125802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.125829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.125940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.126103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.126131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.126244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.126367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.516 [2024-11-29 09:51:10.126419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.516 qpair failed and we were unable to recover it. 00:27:47.516 [2024-11-29 09:51:10.126533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.126648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.126673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.126849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.126981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.127010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.127175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.127280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.127309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.127455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.127614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.127662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.127801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.127901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.127930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.128096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.128231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.128259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.128369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.128521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.128547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.128682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.128804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.128830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.128970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.129085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.129114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.129278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.129408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.129452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.129542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.129635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.129660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.129781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.129876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.129904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.130026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.130117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.130144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.130237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.130361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.130386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.130505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.130625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.130650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.130831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.130952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.130978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.131180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.131328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.131353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.131488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.131603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.131628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.131782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.131906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.131947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.132062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.132160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.132190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.132302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.132437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.132466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.132610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.132738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.132764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.132884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.133006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.133034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.133195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.133319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.133347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.133499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.133603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.133630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.133775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.133911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.133936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.134087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.134243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.134272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.134409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.134560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.134585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.134746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.134841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.517 [2024-11-29 09:51:10.134868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.517 qpair failed and we were unable to recover it. 00:27:47.517 [2024-11-29 09:51:10.135016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.135152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.135180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.135355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.135455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.135482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.135639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.135805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.135833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.135962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.136099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.136127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.136245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.136362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.136387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.136580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.136717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.136745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.136888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.136993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.137021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.137176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.137301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.137327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.137456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.137544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.137571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.137737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.137871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.137900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.138039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.138135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.138160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.138310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.138476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.138505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.138619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.138765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.138791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.138936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.139057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.139082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.139243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.139377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.139421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.139569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.139698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.139724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.139841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.139963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.139989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.140130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.140227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.140256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.140364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.140528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.140554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.140687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.140829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.140870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.141038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.141170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.141198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.141342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.141445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.141474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.141620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.141718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.141744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.141847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.141984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.142012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.142129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.142261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.142289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.142416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.142514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.142544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.142709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.142879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.142904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.143002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.143102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.143128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.518 [2024-11-29 09:51:10.143217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.143316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.518 [2024-11-29 09:51:10.143343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.518 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.143521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.143628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.143656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.143822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.143931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.143961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.144104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.144220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.144246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.144403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.144506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.144535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.144663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.144797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.144826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.144947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.145094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.145119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.145285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.145418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.145444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.145569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.145693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.145718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.145843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.145961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.145986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.146101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.146271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.146313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.146464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.146581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.146606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.146701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.146813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.146838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.146970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.147108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.147133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.147258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.147351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.147377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.147537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.147653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.147679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.147862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.147996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.148024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.148195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.148310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.148335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.148470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.148593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.148618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.148771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.148901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.148929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.149067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.149228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.149256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.149416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.149530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.149555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.149698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.149836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.149861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.149991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.150134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.150162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.150302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.150431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.150457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.150583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.150696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.150724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.150858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.150987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.151015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.151126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.151278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.151304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.151458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.151558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.151587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.519 qpair failed and we were unable to recover it. 00:27:47.519 [2024-11-29 09:51:10.151737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.519 [2024-11-29 09:51:10.151834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.151860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.151980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.152082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.152107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.152230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.152372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.152406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.152550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.152678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.152706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.152849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.152935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.152960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.153139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.153248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.153277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.153413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.153544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.153572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.153717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.153834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.153859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.154014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.154152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.154177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.154324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.154483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.154510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.154636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.154730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.154755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.154925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.155072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.155097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.155219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.155350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.155378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.155564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.155684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.155710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.155855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.156004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.156029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.156160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.156251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.156276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.156411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.156505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.156531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.156668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.156810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.156835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.156985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.157122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.157151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.157289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.157417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.157447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.157551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.157663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.157692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.157855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.158012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.158040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.158201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.158346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.158388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.158535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.158662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.158687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.158844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.159021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.159046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.159146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.159235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.159260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.159380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.159487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.159529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.159660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.159790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.159818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.159966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.160057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.520 [2024-11-29 09:51:10.160082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.520 qpair failed and we were unable to recover it. 00:27:47.520 [2024-11-29 09:51:10.160180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.160351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.160379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.160497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.160646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.160672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.160766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.160882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.160908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.161046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.161135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.161163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.161296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.161405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.161451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.161582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.161729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.161755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.161879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.161974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.161999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.162123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.162245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.162270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.162430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.162526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.162552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.162649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.162778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.162804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.162928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.163073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.163099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.163279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.163408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.163434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.163561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.163651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.163676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.163770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.163893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.163919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.164040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.164157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.164182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.164308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.164406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.164434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.164543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.164657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.164683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.164785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.164931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.164956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.165111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.165280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.165308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.165429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.165519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.165544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.165671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.165786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.165811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.165936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.166049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.166074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.166197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.166311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.166336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.166462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.166584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.166610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.166738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.166881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.166906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.521 qpair failed and we were unable to recover it. 00:27:47.521 [2024-11-29 09:51:10.167034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.521 [2024-11-29 09:51:10.167117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.167143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.167285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.167424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.167450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.167602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.167728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.167753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.167877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.168023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.168049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.168172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.168272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.168298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.168386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.168481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.168507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.168608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.168763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.168789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.168939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.169029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.169055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.169154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.169274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.169299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.169426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.169555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.169581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.169680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.169771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.169796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.169921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.170017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.170043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.170171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.170335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.170363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.170509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.170637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.170686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.170841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.171009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.171053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.171151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.171269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.171295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.171429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.171538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.171564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.171700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.171824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.171850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.171976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.172067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.172093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.172191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.172316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.172342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.172531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.172670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.172699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.172863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.173002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.173027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.173149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.173269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.173294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.173404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.173496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.173523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.173648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.173799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.173825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.173950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.174099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.174124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.174255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.174405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.174437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.174611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.174773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.174817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.174942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.175033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.175060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.522 qpair failed and we were unable to recover it. 00:27:47.522 [2024-11-29 09:51:10.175188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.522 [2024-11-29 09:51:10.175334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.175359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.175463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.175601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.175645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.175793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.175903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.175929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.176061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.176151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.176179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.176279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.176405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.176432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.176522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.176617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.176644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.176769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.176863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.176890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.177008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.177132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.177162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.177294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.177464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.177509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.177643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.177731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.177756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.177861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.178009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.178035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.178157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.178257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.178283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.178387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.178513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.178539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.178660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.178741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.178767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.178890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.178979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.179004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.179100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.179222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.179248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.179348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.179499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.179526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.179647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.179793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.179823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.179947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.180081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.180106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.180241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.180340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.180365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.180467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.180592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.180619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.180746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.180867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.180892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.181013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.181134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.181159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.181279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.181434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.181461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.181587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.181703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.181729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.181830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.181951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.181976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.182102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.182253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.182278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.182416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.182508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.182539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.523 [2024-11-29 09:51:10.182639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.182760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.523 [2024-11-29 09:51:10.182786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.523 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.182934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.183057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.183083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.183187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.183306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.183332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.183456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.183544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.183569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.183667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.183788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.183814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.183976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.184097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.184122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.184254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.184381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.184414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.184511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.184632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.184657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.184814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.184977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.185002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.185125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.185243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.185269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.185406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.185557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.185584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.185709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.185832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.185859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.185983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.186100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.186125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.186253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.186377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.186412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.186527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.186681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.186723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.186856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.186977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.187002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.187146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.187267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.187292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.187420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.187514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.187540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.187656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.187745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.187770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.187865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.188016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.188042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.188175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.188291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.188317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.188439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.188587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.188613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.188717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.188832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.188858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.188955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.189050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.189076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.189198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.189290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.189316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.189442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.189535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.189560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.189658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.189740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.189766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.189888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.189985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.190012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.190133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.190250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.190275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.524 qpair failed and we were unable to recover it. 00:27:47.524 [2024-11-29 09:51:10.190398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.524 [2024-11-29 09:51:10.190493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.190519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.190643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.190770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.190796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.190952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.191045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.191072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.191230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.191320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.191346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.191460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.191606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.191632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.191759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.191845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.191871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.191972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.192056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.192081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.192201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.192307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.192332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.192453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.192570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.192596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.192692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.192818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.192844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.192999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.193119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.193145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.193300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.193473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.193518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.193665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.193830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.193855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.193973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.194076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.194102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.194190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.194312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.194337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.194469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.194583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.194627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.194758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.194879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.194905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.195035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.195185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.195210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.195365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.195484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.195528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.195651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.195805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.195833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.195948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.196096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.196122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.196220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.196340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.196366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.196498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.196626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.196651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.196752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.196842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.196867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.197022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.197146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.197171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.197269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.197385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.525 [2024-11-29 09:51:10.197418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.525 qpair failed and we were unable to recover it. 00:27:47.525 [2024-11-29 09:51:10.197542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.197693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.197718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.197811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.197907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.197932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.198061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.198187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.198213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.198311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.198438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.198465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.198570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.198719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.198744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.198876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.199000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.199026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.199124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.199242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.199268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.199429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.199576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.199602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.199757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.199882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.199907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.200038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.200186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.200212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.200335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.200475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.200524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.200659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.200809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.200853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.200982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.201100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.201125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.201215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.201313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.201338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.201508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.201638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.201667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.201819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.201951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.201977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.202106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.202230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.202255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.202346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.202441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.202467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.202597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.202713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.202739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.202856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.202975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.203000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.203158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.203276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.203302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.203400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.203508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.203533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.203677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.203808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.203837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.203960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.204107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.204135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.204283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.204363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.204388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.204525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.204619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.204644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.526 [2024-11-29 09:51:10.204768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.204940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.526 [2024-11-29 09:51:10.204965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.526 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.205116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.205249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.205279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.205420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.205537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.205563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.205653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.205830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.205858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.205987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.206113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.206141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.206294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.206415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.206442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.206548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.206667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.206709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.206842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.206974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.207002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.207175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.207333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.207374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.207505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.207605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.207634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.207846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.207988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.208016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.208142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.208230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.208258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.208387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.208524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.208549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.208638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.208731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.208756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.208864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.208989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.209017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.209184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.209343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.209371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.209521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.209609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.209633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.209798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.209899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.209925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.210084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.210253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.210281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.210455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.210582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.210612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.210731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.210872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.210898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.211044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.211213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.211242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.211348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.211475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.211502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.211621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.211765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.211793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.211931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.212028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.212057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.212198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.212335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.212364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.212537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.212668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.212693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.212798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.212902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.212930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.527 [2024-11-29 09:51:10.213066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.213222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.527 [2024-11-29 09:51:10.213250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.527 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.213399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.213523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.213549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.213646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.213795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.213836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.213963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.214080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.214108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.214245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.214384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.214437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.214554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.214652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.214677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.214804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.214951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.214976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.215117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.215249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.215277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.215405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.215545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.215571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.215692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.215818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.215843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.215941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.216055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.216084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.216222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.216321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.216350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.216533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.216630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.216657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.216805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.216923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.216949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.217136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.217270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.217300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.217451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.217553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.217578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.217689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.217824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.217852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.218017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.218122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.218152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.218259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.218433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.218459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.218587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.218685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.218711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.218840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.218976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.219004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.219199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.219332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.219360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.219522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.219652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.219695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.219833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.219994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.220021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.220153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.220284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.220312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.220435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.220530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.220555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.220651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.220750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.220776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.220894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.221027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.221055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.528 qpair failed and we were unable to recover it. 00:27:47.528 [2024-11-29 09:51:10.221190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.221367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.528 [2024-11-29 09:51:10.221400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.221495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.221611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.221637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.221761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.221864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.221891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.221993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.222131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.222158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.222295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.222436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.222462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.222591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.222716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.222741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.222897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.223032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.223061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.223186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.223340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.223368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.223495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.223620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.223646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.223766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.223851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.223876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.224018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.224153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.224181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.224288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.224421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.224450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.224568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.224691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.224720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.224842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.224962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.224987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.225122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.225248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.225281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.225398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.225493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.225522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.225660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.225791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.225819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.225957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.226072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.226097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.226283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.226431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.226457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.226609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.226726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.226754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.226884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.227013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.227041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.227181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.227332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.227357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.227526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.227654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.227680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.227827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.227968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.227997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.228123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.228256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.228284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.228420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.228508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.228534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.228680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.228810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.228838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.228978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.229124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.229150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.229269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.229355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.229380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.529 qpair failed and we were unable to recover it. 00:27:47.529 [2024-11-29 09:51:10.229515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.529 [2024-11-29 09:51:10.229635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.229660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.229778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.229909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.229939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.230082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.230256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.230281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.230373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.230505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.230531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.230634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.230727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.230753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.230906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.231066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.231094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.231228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.231367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.231413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.231547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.231639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.231679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.231795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.231880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.231906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.232034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.232150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.232178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.232305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.232477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.232506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.232607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.232751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.232776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.232903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.233024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.233049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.233189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.233368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.233400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.233527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.233649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.233692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.233865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.234028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.234056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.234165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.234308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.234335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.234485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.234608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.234633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.234783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.234924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.234950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.235077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.235165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.235208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.235384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.235512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.235537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.235652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.235752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.235782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.235922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.236054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.236096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.530 qpair failed and we were unable to recover it. 00:27:47.530 [2024-11-29 09:51:10.236245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.236379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.530 [2024-11-29 09:51:10.236416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.236567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.236657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.236682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.236813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.236897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.236922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.237085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.237249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.237278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.237411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.237573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.237602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.237766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.237885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.237910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.238090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.238226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.238254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.238400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.238510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.238538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.238674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.238770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.238800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.238963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.239081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.239107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.239243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.239339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.239367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.239432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1077600 (9): Bad file descriptor 00:27:47.531 [2024-11-29 09:51:10.239652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.239829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.239858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.240014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.240112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.240139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.240317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.240496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.240526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.240655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.240784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.240810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.240969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.241092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.241120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.241244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.241483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.241510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.241610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.241735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.241761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.241884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.241972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.241999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.242127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.242244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.242269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.242422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.242583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.242609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.242737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.242892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.242918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.243046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.243173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.243198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.243308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.243481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.243507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.243612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.243703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.243729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.531 qpair failed and we were unable to recover it. 00:27:47.531 [2024-11-29 09:51:10.243851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.531 [2024-11-29 09:51:10.244005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.244030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.244130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.244251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.244276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.244408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.244533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.244559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.244685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.244781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.244808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.244941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.245061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.245086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.245213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.245370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.245406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.245587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.245729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.245756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.245908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.246083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.246111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.246303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.246438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.246465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.246585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.246680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.246705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.246827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.246949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.246975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.247132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.247227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.247254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.247356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.247452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.247478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.247603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.247725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.247752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.247891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.248044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.248070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.248214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.248345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.248374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.248543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.248678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.248706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.248867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.249023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.249050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.249249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.249505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.249531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.249624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.249722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.249748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.249849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.249983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.250008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.250110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.250209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.250235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.250389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.250517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.250542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.250669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.250764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.250789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.250877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.251000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.251026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.251127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.251289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.251317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.251463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.251616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.251641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.251734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.251858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.251883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.252038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.252167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.252192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.532 qpair failed and we were unable to recover it. 00:27:47.532 [2024-11-29 09:51:10.252352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.532 [2024-11-29 09:51:10.252479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.252504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.252635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.252760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.252786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.252916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.253041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.253068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.253193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.253376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.253410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.253526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.253645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.253671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.253797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.253923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.253948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.254074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.254195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.254219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.254319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.254428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.254454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.254582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.254669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.254694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.254788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.254936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.254966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.255097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.255222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.255247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.255338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.255465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.255492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.255591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.255740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.255765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.255858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.255978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.256003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.256159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.256277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.256302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.256430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.256527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.256552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.256686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.256803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.256828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.256947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.257065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.257090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.257279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.257382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.257413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.257537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.257632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.257662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.257788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.257910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.257936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.258041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.258198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.258222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.258351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.258483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.258509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.258625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.258777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.258802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.258959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.259110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.259135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.259282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.259424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.259450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.259572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.259697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.259724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.259819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.259944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.259969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.533 [2024-11-29 09:51:10.260120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.260210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.533 [2024-11-29 09:51:10.260236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.533 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.260355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.260484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.260515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.260643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.260785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.260810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.260908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.261061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.261085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.261228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.261425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.261466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.261586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.261733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.261758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.261847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.261964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.261989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.262142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.262236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.262261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.262415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.262533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.262558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.262686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.262804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.262830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.262919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.263039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.263064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.263188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.263298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.263342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.263524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.263630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.263658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.263823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.263933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.263962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.264090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.264312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.264340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.264500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.264606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.264632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.264754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.264878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.264904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.265011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.265101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.265126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.265224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.265348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.265373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.265473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.265628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.265654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.265809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.265931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.265957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.266083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.266232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.266258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.266444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.266585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.266610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.266739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.266832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.266859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.267008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.267126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.267151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.534 qpair failed and we were unable to recover it. 00:27:47.534 [2024-11-29 09:51:10.267279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.534 [2024-11-29 09:51:10.267417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.267444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.267541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.267634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.267659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.267753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.267872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.267897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.267998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.268110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.268135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.268262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.268385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.268416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.268540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.268639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.268665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.268814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.268943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.268968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.269083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.269192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.269221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.269357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.269504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.269533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.269655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.269882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.269910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.270108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.270289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.270317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.270430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.270549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.270575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.270676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.270771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.270798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.270900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.271032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.271057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.271160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.271256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.271281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.271414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.271514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.271539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.271633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.271753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.271779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.271932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.272052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.272077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.272181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.272285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.272314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.272482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.272609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.272634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.272731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.272882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.272907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.273029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.273148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.273173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.273333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.273471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.273497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.273629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.273749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.273774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.273875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.273969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.273994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.535 qpair failed and we were unable to recover it. 00:27:47.535 [2024-11-29 09:51:10.274110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.535 [2024-11-29 09:51:10.274253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.274280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.274435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.274567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.274592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.274696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.274784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.274810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.274936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.275027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.275053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.275179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.275299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.275324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.275456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.275590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.275615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.275747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.275902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.275927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.276053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.276179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.276204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.276334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.276434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.276459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.276562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.276681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.276706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.276832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.276965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.276990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.277081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.277192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.277221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.277379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.277481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.277508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.277636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.277724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.277749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.277904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.278004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.278029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.278159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.278280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.278305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.278435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.278562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.278587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.278711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.278798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.278823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.278975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.279128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.279153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.279264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.279474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.279501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.279627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.279743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.279769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.279857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.279980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.280007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.280118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.280216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.280243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.280342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.280435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.280461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.280551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.280664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.280689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.280842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.280929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.280955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.281045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.281201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.281226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.281383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.281506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.281531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.281661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.281812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.536 [2024-11-29 09:51:10.281837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.536 qpair failed and we were unable to recover it. 00:27:47.536 [2024-11-29 09:51:10.281931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.282056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.282082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.282235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.282347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.282375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.282510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.282633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.282658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.282788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.282908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.282933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.283064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.283211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.283236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.283361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.283498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.283524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.283675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.283794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.283819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.283974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.284125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.284149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.284275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.284404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.284430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.284549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.284669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.284695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.284837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.285063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.285091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.285229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.285338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.285363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.285523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.285638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.285666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.285797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.285980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.286008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.286167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.286301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.286329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.286436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.286527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.286552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.286674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.286802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.286827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.286954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.287074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.287100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.287228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.287348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.287373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.287505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.287601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.287626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.287723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.287815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.287840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.537 qpair failed and we were unable to recover it. 00:27:47.537 [2024-11-29 09:51:10.287968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.288062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.537 [2024-11-29 09:51:10.288089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.288213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.288351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.288379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.288530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.288679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.288704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.288792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.288918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.288943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.289075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.289196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.289221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.289358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.289498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.289524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.289674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.289818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.289843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.289943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.290065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.290090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.290256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.290435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.290461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.290553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.290676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.290703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.290827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.290950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.290975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.291069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.291179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.291207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.291361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.291514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.291541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.291695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.291822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.291847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.291972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.292066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.292092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.292243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.292401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.292427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.292585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.292706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.292733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.292864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.292988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.293013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.293101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.293271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.293299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.293444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.293570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.293594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.293720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.293847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.293872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.294024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.294109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.294135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.294281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.294422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.294449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.294544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.294667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.294693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.294824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.294917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.294943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.295031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.295127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.295154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.295314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.295483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.295509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.295634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.295759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.295784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.538 qpair failed and we were unable to recover it. 00:27:47.538 [2024-11-29 09:51:10.295916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.538 [2024-11-29 09:51:10.296006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.296031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.296178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.296325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.296354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.296526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.296647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.296672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.296821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.296965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.296990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.297136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.297315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.297348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.297495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.297604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.297629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.297783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.297916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.297941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.298068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.298185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.298215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.298349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.298531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.298557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.298683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.298804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.298829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.298968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.299068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.299096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.299237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.299367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.299411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.299591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.299774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.299803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.299937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.300153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.300181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.300341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.300460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.300492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.300642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.300730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.300756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.300852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.300946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.300971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.301071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.301213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.301241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.301405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.301517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.301542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.301636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.301731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.301757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.301857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.301977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.302002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.302096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.302212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.302240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.302378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.302502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.302528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.302654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.302745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.302770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.302868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.302988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.303018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.303171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.303269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.303293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.303403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.303553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.303578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.303670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.303786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.303811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.539 qpair failed and we were unable to recover it. 00:27:47.539 [2024-11-29 09:51:10.303912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.539 [2024-11-29 09:51:10.304031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 09:51:10.304057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 09:51:10.304183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 09:51:10.304330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 09:51:10.304359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 09:51:10.304484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 09:51:10.304591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 09:51:10.304616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 09:51:10.304741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 09:51:10.304880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 09:51:10.304907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 09:51:10.305038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 09:51:10.305149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 09:51:10.305194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.540 [2024-11-29 09:51:10.305364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 09:51:10.305493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.540 [2024-11-29 09:51:10.305521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.540 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.305657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.305769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.305817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.306018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.306255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.306283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.306430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.306549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.306585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.306696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.306852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.306889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.307039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.307177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.307204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.307327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.307443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.307468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.307561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.307669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.307694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.307791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.307911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.307936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.308042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.308163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.308188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.308306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.308421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.308447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.308540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.308659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.308684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.308790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.308882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.308907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.309031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.309143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.309170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.309292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.309411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.309437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.309555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.309674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.309699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.309794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.309912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.309937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.310023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.310149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.310175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.310302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.310425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.310450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.310547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.310642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.310671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.310811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.310909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.310937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.311133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.311314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.311341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.311471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.311559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.311584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.311733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.311875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.311903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.312074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.312217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.312242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.312375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.312536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.312563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.312665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.312761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.312788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.312880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.312973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.822 [2024-11-29 09:51:10.313000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.822 qpair failed and we were unable to recover it. 00:27:47.822 [2024-11-29 09:51:10.313122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.313211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.313237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.313343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.313488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.313514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.313620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.313778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.313803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.313905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.314021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.314047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.314196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.314347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.314373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.314485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.314584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.314609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.314722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.314824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.314852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.314985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.315117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.315145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.315308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.315466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.315492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.315591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.315689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.315716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.315827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.315960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.315988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.316127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.316290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.316333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.316462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.316589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.316615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.316750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.316891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.316916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.317019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.317116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.317158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.317270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.317402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.317428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.317523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.317623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.317648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.317745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.317837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.317862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.317949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.318067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.318094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.318207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.318310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.318340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.318466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.318563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.318588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.318707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.318814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.318842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.318989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.319114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.319142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.319261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.319361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.319389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.319551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.319644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.319670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.823 [2024-11-29 09:51:10.319788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.319932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.823 [2024-11-29 09:51:10.319960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.823 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.320067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.320206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.320233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.320334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.320466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.320492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.320583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.320681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.320707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.320815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.320910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.320938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.321043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.321205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.321234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.321342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.321478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.321505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.321628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.321731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.321774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.321914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.322048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.322076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.322227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.322360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.322388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.322533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.322649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.322676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.322776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.322902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.322928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.323036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.323189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.323217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.323374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.323479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.323505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.323599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.324166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.324199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.324348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.324469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.324496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.324603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.324718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.324762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.324876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.325014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.325042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.325244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.325368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.325404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.325525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.325623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.325649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.325770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.325898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.325926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.326083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.326230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.326271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.326374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.326507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.326533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.326637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.326750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.326778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.326890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.327038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.327062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.327195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.327318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.327346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.327486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.327581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.327606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.824 qpair failed and we were unable to recover it. 00:27:47.824 [2024-11-29 09:51:10.327738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.327831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.824 [2024-11-29 09:51:10.327856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.327951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.328056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.328086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.328268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.328445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.328471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.328572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.328739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.328764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.328865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.328987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.329029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.329132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.329256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.329283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.329440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.329533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.329557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.329654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.329773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.329798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.329950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.330054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.330096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.330217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.330311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.330339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.330459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.330548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.330573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.330664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.330790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.330815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.330991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.331148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.331177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.331288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.331387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.331419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.331528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.331628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.331653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.331770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.331860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.331885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.331992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.332101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.332127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.332271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.332368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.332404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.332526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.332625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.332650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.332750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.332848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.332873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.332964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.333087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.333112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.333265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.333402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.333446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.333552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.333685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.333710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.333884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.334023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.334047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.334262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.334437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.334463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.334596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.334733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.334761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.334908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.335083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.335111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.335333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.335476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.335502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.825 qpair failed and we were unable to recover it. 00:27:47.825 [2024-11-29 09:51:10.335602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.825 [2024-11-29 09:51:10.335742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.335767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.335863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.335985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.336011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.336162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.336264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.336290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.336448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.336544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.336570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.336720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.336875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.336900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.337024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.337124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.337149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.337278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.337436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.337463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.337588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.337683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.337708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.337798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.337897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.337924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.338070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.338201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.338231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.338340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.338461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.338488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.338591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.338682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.338707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.338869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.339045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.339073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.339178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.339282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.339310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.339414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.339541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.339568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.339690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.339791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.339821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.339961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.340121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.340148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.340290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.340422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.340453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.340565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.340663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.340690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.340777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.340881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.340909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.341055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.341204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.341230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.341346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.341474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.341501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.341621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.341737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.826 [2024-11-29 09:51:10.341762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.826 qpair failed and we were unable to recover it. 00:27:47.826 [2024-11-29 09:51:10.341857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.341951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.341977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.342117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.342245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.342280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.342386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.342508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.342533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.342656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.342747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.342772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.342876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.343006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.343047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.343167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.343261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.343305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.343440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.343541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.343566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.343661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.343784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.343810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.343896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.343997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.344022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.344156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.344250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.344275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.344437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.344550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.344576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.344688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.344791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.344824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.344974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.345092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.345117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.345291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.345417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.345458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.345561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.345687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.345713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.345835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.345963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.345988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.346099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.346247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.346290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.346421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.346525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.346550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.346652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.346740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.346766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.346889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.347062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.347090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.347185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.347364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.347388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.347524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.347664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.347694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.347796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.347937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.347965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.348099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.348226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.348268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.348390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.348501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.348526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.348627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.348783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.348809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.348950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.349088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.349117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.349262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.349364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.349389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.827 qpair failed and we were unable to recover it. 00:27:47.827 [2024-11-29 09:51:10.349499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.827 [2024-11-29 09:51:10.349621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.349647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.349814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.349913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.349941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.350093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.350225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.350251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.350380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.350520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.350550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.350645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.350760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.350788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.350903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.351048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.351073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.351237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.351366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.351422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.351559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.351660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.351703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.351880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.351972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.351999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.352117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.352289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.352314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.352447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.352552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.352577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.352670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.352790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.352815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.352962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.353095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.353120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.353207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.353306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.353332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.353456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.353550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.353575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.353675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.353782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.353826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.353992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.354126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.354154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.354266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.354356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.354381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.354499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.354613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.354638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.354783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.354929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.354954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.355076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.355230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.355255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.355387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.355506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.355531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.355681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.355798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.355823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.355987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.356115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.356141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.356306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.356421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.356468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.356562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.356712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.356737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.356864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.356989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.357015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.357169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.357264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.357293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.357401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.357576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.357602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.828 qpair failed and we were unable to recover it. 00:27:47.828 [2024-11-29 09:51:10.357727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.828 [2024-11-29 09:51:10.357875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.357901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.358057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.358197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.358225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.358365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.358485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.358511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.358600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.358746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.358772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.358942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.359064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.359089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.359231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.359363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.359388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.359561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.359661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.359686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.359780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.359867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.359893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.360014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.360147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.360176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.360294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.360436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.360462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.360581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.360709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.360734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.360861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.361007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.361035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.361128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.361282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.361307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.361432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.361583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.361608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.361794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.361902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.361930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.362042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.362195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.362220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.362325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.362419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.362446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.362573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.362665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.362691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.362807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.362962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.362987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.363155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.363279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.363304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.363403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.363553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.363578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.363700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.363852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.363894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.364073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.364213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.364238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.364359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.364457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.364502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.364671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.364764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.364790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.364966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.365114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.365139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.365286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.365423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.365452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.365571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.365719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.829 [2024-11-29 09:51:10.365744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.829 qpair failed and we were unable to recover it. 00:27:47.829 [2024-11-29 09:51:10.365846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.365963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.365989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.366088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.366208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.366250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.366428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.366518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.366544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.366670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.366837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.366865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.367001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.367167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.367196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.367338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.367462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.367488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.367576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.367692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.367722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.367830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.367996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.368025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.368150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.368298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.368325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.368451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.368574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.368599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.368747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.368849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.368874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.369005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.369124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.369149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.369258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.369379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.369412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.369556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.369724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.369753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.369874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.369999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.370024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.370143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.370313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.370338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.370461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.370583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.370609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.370705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.370826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.370852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.370957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.371086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.371113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.371244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.371399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.371425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.371581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.371673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.371697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.371849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.371990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.372015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.372153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.372284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.372310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.372408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.372503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.372528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.372619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.372734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.372759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.372885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.373015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.373059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.373184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.373322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.373347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.373487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.373602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.373630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.830 [2024-11-29 09:51:10.373764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.373892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.830 [2024-11-29 09:51:10.373921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.830 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.374070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.374161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.374186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.374290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.374382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.374434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.374608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.374737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.374764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.374881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.374972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.374997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.375112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.375272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.375300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.375426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.375535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.375563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.375704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.375793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.375819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.375962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.376081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.376110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.376272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.376424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.376456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.376554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.376645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.376671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.376807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.376954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.376979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.377127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.377265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.377295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.377425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.377577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.377604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.377719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.377835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.377864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.378004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.378092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.378117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.378242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.378337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.378363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.378522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.378608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.378633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.378750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.378875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.378900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.379022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.379176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.379217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.379319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.379430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.379460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.379592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.379752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.379781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.379903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.379994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.380019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.380171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.380289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.380314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.831 qpair failed and we were unable to recover it. 00:27:47.831 [2024-11-29 09:51:10.380440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.831 [2024-11-29 09:51:10.380584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.380612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.380744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.380873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.380899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.381021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.381115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.381154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.381307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.381482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.381508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.381630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.381751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.381775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.381901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.382006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.382035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.382160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.382323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.382350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.382495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.382585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.382610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.382733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.382863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.382891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.383006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.383117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.383147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.383285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.383420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.383445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.383567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.383703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.383730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.383825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.383928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.383956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.384065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.384218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.384243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.384422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.384526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.384569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.384671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.384775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.384818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.384943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.385059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.385084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.385202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.385323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.385348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.385455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.385554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.385580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.385679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.385806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.385831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.385933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.386053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.386081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.386185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.386308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.386336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.386467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.386561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.386587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.386724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.386877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.386905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.387044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.387151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.387178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.387296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.387387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.387422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.387524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.387620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.387647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.387788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.387921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.387949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.388068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.388155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.388181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.832 qpair failed and we were unable to recover it. 00:27:47.832 [2024-11-29 09:51:10.388308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.832 [2024-11-29 09:51:10.388424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.388458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.388583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.388699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.388727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.388848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.388934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.388959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.389092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.389237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.389261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.389350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.389450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.389476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.389598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.389721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.389747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.389847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.389945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.389974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.390064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.390200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.390227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.390358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.390492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.390519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.390622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.390763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.390792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.390893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.391025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.391054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.391171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.391265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.391291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.391429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.391541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.391566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.391657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.391759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.391786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.391967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.392055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.392080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.392200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.392331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.392359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.392519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.392610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.392639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.392733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.392858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.392884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.392993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.393081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.393108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.393202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.393353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.393381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.393537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.393635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.393660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.393757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.393849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.393873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.394037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.394144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.394169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.394291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.394385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.394435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.394534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.394660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.394686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.394823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.394922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.394949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.395086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.395172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.395198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.395322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.395466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.395509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.833 [2024-11-29 09:51:10.395608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.395725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.833 [2024-11-29 09:51:10.395753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.833 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.395896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.395995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.396020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.396230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.396320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.396345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.396437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.396539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.396565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.396665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.396758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.396784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.396916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.397050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.397078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.397241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.397341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.397370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.397526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.397646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.397675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.397770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.397911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.397939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.398040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.398144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.398172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.398291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.398449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.398475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.398599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.398740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.398769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.398873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.399003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.399031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.399209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.399307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.399332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.399488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.399638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.399663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.399771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.399903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.399932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.400079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.400208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.400234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.400340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.400471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.400497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.400585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.400686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.400712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.400816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.400942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.400967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.401091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.401215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.401240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.401359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.401472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.401509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.401610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.401747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.401772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.401936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.402062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.402097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.402237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.402362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.402390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.402551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.402638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.402664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.402777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.402930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.402955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.403040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.403201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.403225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.403341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.403443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.403470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.834 qpair failed and we were unable to recover it. 00:27:47.834 [2024-11-29 09:51:10.403574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.834 [2024-11-29 09:51:10.403709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.403737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.403870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.403996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.404025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.404174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.404322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.404347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.404484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.404577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.404602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.404756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.404876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.404905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.405053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.405174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.405199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.405377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.405489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.405515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.405618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.405763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.405791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.405927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.406041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.406066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.406209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.406343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.406371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.406523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.406614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.406640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.406738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.406864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.406889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.406988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.407130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.407158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.407310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.407411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.407448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.407578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.407688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.407713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.407868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.408007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.408040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.408166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.408267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.408295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.408423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.408549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.408575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.408697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.408818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.408843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.408947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.409099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.409128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.409282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.409424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.409450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.409572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.409712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.409741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.409834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.409970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.409998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.410172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.410317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.410357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.410493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.410614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.410641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.410808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.410935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.410964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.411082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.411188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.411214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.411336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.411444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.411469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.835 qpair failed and we were unable to recover it. 00:27:47.835 [2024-11-29 09:51:10.411585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.411711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.835 [2024-11-29 09:51:10.411735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.411864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.412010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.412036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.412167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.412330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.412358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.412515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.412634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.412661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.412794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.412908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.412934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.413123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.413276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.413301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.413452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.413577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.413602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.413699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.413816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.413841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.414034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.414164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.414189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.414314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.414414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.414439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.414561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.414654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.414680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.414829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.414950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.414976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.415143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.415287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.415315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.415443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.415567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.415592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.415745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.415855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.415883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.416018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.416121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.416150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.416285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.416418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.416452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.416559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.416650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.416675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.416812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.416913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.416943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.417117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.417237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.417262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.417385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.417555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.417580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.417686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.417805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.417832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.417980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.418099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.418125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.418226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.418342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.418402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.418518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.418655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.418687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.418823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.418944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.836 [2024-11-29 09:51:10.418969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.836 qpair failed and we were unable to recover it. 00:27:47.836 [2024-11-29 09:51:10.419121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.419256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.419286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.419439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.419575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.419603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.419776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.419951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.419984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.420115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.420242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.420269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.420371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.420525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.420553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.420665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.420788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.420813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.420921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.421108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.421136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.421296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.421428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.421457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.421598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.421698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.421723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.421876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.422013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.422037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.422214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.422336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.422361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.422492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.422617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.422643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.422738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.422870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.422895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.423033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.423172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.423198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.423294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.423447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.423473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.423606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.423748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.423776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.423938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.424088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.424116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.424258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.424382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.424413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.424539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.424672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.424700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.424830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.424934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.424961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.425084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.425172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.425198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.425337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.425468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.425495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.425627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.425763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.425791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.425930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.426051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.426076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.426189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.426372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.426405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.426500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.426666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.426697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.426845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.427000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.427051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.427189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.427352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.427380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.837 [2024-11-29 09:51:10.427498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.427596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.837 [2024-11-29 09:51:10.427625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.837 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.427765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.427919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.427945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.428119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.428245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.428281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.428447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.428538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.428566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.428701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.428850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.428875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.429040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.429165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.429190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.429358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.429475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.429503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.429671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.429789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.429830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.429965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.430130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.430163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.430305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.430407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.430442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.430583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.430709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.430735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.430885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.431026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.431053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.431178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.431305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.431333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.431493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.431617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.431642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.431735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.431885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.431910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.432025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.432123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.432166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.432321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.432434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.432468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.432655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.432760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.432789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.432953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.433088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.433121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.433299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.433428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.433471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.433616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.433737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.433765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.433914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.434009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.434033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.434181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.434278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.434303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.434439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.434571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.434600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.434713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.434872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.434900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.435060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.435180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.435205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.435321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.435456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.435486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.435624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.435787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.435813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.435939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.436058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.436088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.838 qpair failed and we were unable to recover it. 00:27:47.838 [2024-11-29 09:51:10.436255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.838 [2024-11-29 09:51:10.436382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.436419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.436580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.436680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.436708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.436819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.436911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.436938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.437050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.437183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.437211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.437317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.437423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.437452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.437600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.437728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.437754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.437911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.438084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.438109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.438209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.438331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.438356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.438451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.438579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.438605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.438768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.438909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.438943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.439080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.439217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.439245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.439388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.439513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.439538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.439664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.439794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.439823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.439958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.440109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.440137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.440275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.440400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.440428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.440550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.440679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.440708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.440811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.440973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.441002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.441141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.441241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.441267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.441406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.441569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.441596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.441763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.441922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.441950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.442104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.442224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.442249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.442426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.442538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.442568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.442687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.442818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.442847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.442993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.443117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.443144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.443305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.443459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.443488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.443630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.443760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.443788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.443931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.444057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.444083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.444231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.444371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.444405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.444508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.444635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.444663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.839 qpair failed and we were unable to recover it. 00:27:47.839 [2024-11-29 09:51:10.444807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.839 [2024-11-29 09:51:10.444928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.444954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.445120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.445290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.445318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.445479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.445629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.445654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.445804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.445919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.445944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.446091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.446195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.446223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.446383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.446557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.446582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.446683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.446804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.446829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.446972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.447084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.447122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.447257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.447383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.447422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.447533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.447684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.447709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.447864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.447993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.448022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.448138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.448303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.448332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.448456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.448589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.448615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.448759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.448893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.448921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.449096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.449221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.449256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.449376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.449627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.449667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.449768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.449871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.449899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.450034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.450133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.450163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.450289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.450380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.450420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.450572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.450695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.450723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.450867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.451001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.451034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.451154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.451282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.451307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.451466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.451596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.451625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.451736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.451900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.451926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.452047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.452183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.452209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.840 qpair failed and we were unable to recover it. 00:27:47.840 [2024-11-29 09:51:10.452333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.452514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.840 [2024-11-29 09:51:10.452544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.452713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.452828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.452853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.452976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.453094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.453119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.453251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.453343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.453370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.453509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.453666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.453709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.453855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.453973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.453998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.454145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.454327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.454352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.454481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.454594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.454622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.454801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.454921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.454945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.455093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.455195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.455223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.455391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.455534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.455562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.455716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.455835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.455861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.456030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.456127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.456155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.456262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.456420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.456455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.456571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.456722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.456747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.456850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.456992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.457020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.457166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.457261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.457290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.457456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.457607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.457632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.457734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.457892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.457917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.458009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.458105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.458131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.458258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.458376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.458408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.458559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.458662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.458690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.458802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.458965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.458993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.459108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.459224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.459250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.459431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.459592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.459620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.459769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.459903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.459931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.460072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.460200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.460225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.460389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.460534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.460559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.460700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.460807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.460836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.841 qpair failed and we were unable to recover it. 00:27:47.841 [2024-11-29 09:51:10.460985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.841 [2024-11-29 09:51:10.461107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.461134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.461270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.461408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.461437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.461547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.461661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.461687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.461796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.461925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.461950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.462072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.462182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.462210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.462371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.462534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.462563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.462721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.462835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.462860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.463002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.463146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.463174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.463309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.463419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.463447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.463586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.463706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.463732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.463881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.464016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.464044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.464142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.464269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.464298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.464414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.464550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.464575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.464704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.464791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.464831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.464993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.465091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.465119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.465273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.465402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.465427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.465586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.465728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.465756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.465865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.466004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.466032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.466177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.466301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.466326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.466481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.466589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.466616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.466713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.466867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.466894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.467042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.467165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.467191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.467372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.467498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.467523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.467678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.467836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.467864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.467983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.468106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.468133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.468260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.468374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.468407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.468544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.468684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.468712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.468848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.468971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.468997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.469158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.469318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.842 [2024-11-29 09:51:10.469346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.842 qpair failed and we were unable to recover it. 00:27:47.842 [2024-11-29 09:51:10.469515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.469615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.469642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.469761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.469889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.469914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.470062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.470158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.470186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.470318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.470482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.470511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.470653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.470768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.470793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.470903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.471007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.471036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.471171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.471307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.471336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.471449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.471580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.471605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.471723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.471849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.471875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.472025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.472132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.472161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.472302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.472449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.472475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.472626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.472749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.472776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.472899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.473026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.473052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.473177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.473304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.473329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.473459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.473593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.473621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.473782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.473944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.473972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.474113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.474199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.474224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.474340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.474438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.474466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.474609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.474723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.474753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.474932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.475023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.475049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.475191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.475320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.475349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.475493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.475636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.475660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.475808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.475929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.475955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.476108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.476246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.476274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.476419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.476574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.476599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.476715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.476804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.476829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.476925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.477050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.477077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.843 [2024-11-29 09:51:10.477204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.477345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.843 [2024-11-29 09:51:10.477373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.843 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.477525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.477652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.477681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.477844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.477949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.477978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.478114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.478251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.478279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.478422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.478521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.478545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.478696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.478800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.478829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.478980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.479097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.479122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.479240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.479340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.479365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.479514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.479653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.479678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.479797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.479961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.479989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.480167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.480286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.480311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.480435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.480566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.480601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.480736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.480870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.480898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.481069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.481194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.481236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.481360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.481495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.481520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.481652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.481783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.481811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.481917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.482038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.482064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.482168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.482315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.482343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.482494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.482593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.482620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.482786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.482885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.482910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.483059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.483217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.483245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.483374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.483541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.483571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.483664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.483787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.483812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.483952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.484053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.484081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.484216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.484315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.484345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.484517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.484616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.484643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.484796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.484917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.484944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.485103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.485271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.485299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.485408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.485516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.485542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.844 qpair failed and we were unable to recover it. 00:27:47.844 [2024-11-29 09:51:10.485646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.844 [2024-11-29 09:51:10.485799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.485824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.485964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.486096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.486124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.486238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.486359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.486398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.486566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.486742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.486767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.486889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.487006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.487031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.487154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.487273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.487300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.487416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.487555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.487583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.487719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.487850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.487877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.487990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.488110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.488136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.488288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.488413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.488442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.488610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.488774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.488803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.488937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.489028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.489053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.489232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.489347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.489372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.489495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.489620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.489646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.489737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.489856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.489880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.490010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.490170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.490198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.490306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.490432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.490475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.490569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.490690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.490716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.490894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.491053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.491080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.491213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.491346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.491374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.491523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.491642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.491667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.491862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.491959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.491986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.492157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.492280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.492306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.492474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.492565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.492591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.492688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.492809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.845 [2024-11-29 09:51:10.492834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.845 qpair failed and we were unable to recover it. 00:27:47.845 [2024-11-29 09:51:10.492977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.493115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.493143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.493271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.493365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.493391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.493560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.493701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.493729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.493895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.494025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.494054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.494210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.494356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.494408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.494547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.494649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.494677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.494812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.494938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.494966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.495113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.495237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.495262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.495377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.495518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.495545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.495684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.495810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.495838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.495955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.496046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.496072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.496202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.496322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.496347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.496439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.496573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.496600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.496727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.496887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.496912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.497067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.497194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.497221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.497329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.497435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.497464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.497589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.497696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.497721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.497839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.497968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.497996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.498137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.498244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.498272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.498386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.498500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.498526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.498646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.498735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.498760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.498888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.499054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.499094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.499187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.499336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.499361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.499490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.499629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.499657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.499797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.499898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.499926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.500080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.500206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.500230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.500382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.500505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.500533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.500713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.500829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.500854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.846 [2024-11-29 09:51:10.501009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.501178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.846 [2024-11-29 09:51:10.501206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.846 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.501380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.501530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.501570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.501662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.501787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.501811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.501901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.501993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.502018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.502144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.502260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.502302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.502440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.502536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.502564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.502678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.502835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.502860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.502999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.503138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.503168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.503296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.503430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.503458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.503594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.503683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.503708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.503876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.503979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.504006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.504140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.504259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.504287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.504438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.504568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.504594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.504745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.504878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.504907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.505047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.505213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.505241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.505361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.505511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.505536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.505690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.505794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.505822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.505960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.506060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.506087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.506243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.506342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.506367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.506509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.506667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.506697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.506832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.506958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.506986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.507117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.507253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.507282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.507383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.507515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.507542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.507673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.507817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.507843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.508002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.508121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.508146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.508300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.508454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.508481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.508613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.508713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.508743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.508874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.509019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.509045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.847 [2024-11-29 09:51:10.509170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.509292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.847 [2024-11-29 09:51:10.509319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.847 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.509409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.509539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.509567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.509710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.509825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.509855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.509987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.510116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.510142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.510295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.510442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.510475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.510579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.510676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.510703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.510837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.510985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.511010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.511164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.511263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.511291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.511399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.511554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.511604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.511782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.511939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.511983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.512136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.512233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.512259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.512388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.512533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.512576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.512706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.512834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.512862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.512991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.513106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.513132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.513236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.513325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.513351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.513458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.513557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.513584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.513721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.513879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.513906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.514037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.514164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.514190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.514341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.514432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.514458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.514630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.514779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.514822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.514950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.515072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.515099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.515222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.515374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.515405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.515524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.515695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.515744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.515891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.516018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.516044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.516163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.516249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.516275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.516404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.516487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.516513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.516614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.516728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.516754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.516899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.517017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.517047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.517177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.517302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.517327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.848 qpair failed and we were unable to recover it. 00:27:47.848 [2024-11-29 09:51:10.517470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.848 [2024-11-29 09:51:10.517624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.517667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.517799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.517891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.517917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.518061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.518161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.518188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.518330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.518501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.518546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.518718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.518872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.518914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.519033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.519163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.519197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.519358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.519486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.519530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.519675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.519837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.519862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.519982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.520099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.520125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.520286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.520445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.520473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.520603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.520759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.520785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.520937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.521083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.521108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.521195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.521340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.521372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.521505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.521705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.521748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.521832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.522034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.522060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.522212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.522328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.522354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.522532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.522697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.522739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.522887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.523015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.523059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.523187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.523309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.523334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.523510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.523673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.523720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.523865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.524040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.524067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.524168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.524316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.524342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.524456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.524583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.524614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.524820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.525004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.525053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.525152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.525274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.525299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.849 qpair failed and we were unable to recover it. 00:27:47.849 [2024-11-29 09:51:10.525450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.849 [2024-11-29 09:51:10.525623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.525648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.525829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.525943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.525970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.526070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.526217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.526243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.526411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.526536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.526562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.526726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.526886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.526913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.527020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.527141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.527166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.527260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.527377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.527414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.527564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.527678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.527705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.527834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.527988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.528019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.528122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.528272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.528298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.528427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.528575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.528618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.528798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.528909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.528937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.529039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.529163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.529188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.529286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.529385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.529421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.529546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.529671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.529698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.529822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.529973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.530006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.530137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.530231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.530257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.530425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.530577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.530622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.530717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.530866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.530897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.531027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.531187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.531215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.531341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.531494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.531538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.531652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.531819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.531862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.531983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.532102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.532128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.532261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.532382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.532422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.532569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.532732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.532776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.532923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.533098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.533123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.533281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.533443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.533470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.533596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.533720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.533746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.533898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.534020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.850 [2024-11-29 09:51:10.534046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.850 qpair failed and we were unable to recover it. 00:27:47.850 [2024-11-29 09:51:10.534174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.534298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.534331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.534473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.534606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.534635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.534796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.534940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.534966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.535085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.535231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.535257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.535338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.535483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.535528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.535646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.535812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.535856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.536014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.536106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.536132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.536265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.536358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.536383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.536500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.536667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.536693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.536840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.536977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.537003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.537103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.537195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.537222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.537373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.537481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.537507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.537607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.537706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.537732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.537880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.538010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.538037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.538136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.538286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.538312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.538470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.538563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.538589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.538743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.538838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.538865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.538992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.539113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.539139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.539265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.539388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.539420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.539537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.539630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.539656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.539762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.539860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.539887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.540021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.540112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.540139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.540286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.540420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.540447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.540536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.540685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.540712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.540840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.540996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.541023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.541178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.541296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.541322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.541469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.541577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.541603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.541755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.541940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.541985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.851 qpair failed and we were unable to recover it. 00:27:47.851 [2024-11-29 09:51:10.542081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.542206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.851 [2024-11-29 09:51:10.542232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.542382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.542547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.542592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.542771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.542892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.542939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.543095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.543220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.543246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.543406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.543523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.543549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.543675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.543793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.543819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.543971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.544074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.544101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.544238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.544387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.544429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.544539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.544656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.544683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.544781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.544931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.544957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.545108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.545241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.545269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.545406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.545551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.545577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.545706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.545841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.545868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.545969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.546059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.546085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.546191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.546354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.546380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.546518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.546615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.546642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.546737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.546835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.546863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.547032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.547153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.547180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.547331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.547477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.547523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.547625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.547744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.547770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.547890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.548002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.548029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.548157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.548247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.548274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.548409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.548530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.548556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.548679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.548799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.548825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.548956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.549079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.549107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.549244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.549414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.549464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.549615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.549792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.549819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.549942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.550040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.550066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.550221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.550315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.550341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.852 qpair failed and we were unable to recover it. 00:27:47.852 [2024-11-29 09:51:10.550467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.852 [2024-11-29 09:51:10.550598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.550625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.550722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.550847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.550872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.551009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.551158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.551183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.551343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.551474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.551501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.551663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.551789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.551815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.551915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.552071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.552096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.552252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.552347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.552373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.552587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.552748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.552794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.552935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.553077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.553103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.553191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.553319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.553345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.553469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.553599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.553625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.553729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.553859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.553886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.553993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.554086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.554111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.554268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.554360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.554386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.554490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.554585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.554613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.554736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.554839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.554871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.555005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.555162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.555188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.555314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.555442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.555469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.555580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.555732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.555757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.555884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.556012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.556039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.556170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.556259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.556285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.556383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.556517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.556543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.556645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.556805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.556831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.556933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.557091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.557118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.557255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.557352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.557379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.557520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.557641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.557667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.557830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.557954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.557980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.558137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.558289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.558316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.558421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.558591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.853 [2024-11-29 09:51:10.558620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.853 qpair failed and we were unable to recover it. 00:27:47.853 [2024-11-29 09:51:10.558757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.558947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.558990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.559115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.559215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.559242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.559338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.559488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.559515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.559687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.559849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.559892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.560015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.560111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.560138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.560290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.560416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.560443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.560536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.560626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.560653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.560797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.560964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.560991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.561121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.561223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.561250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.561358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.561547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.561591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.561712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.561867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.561910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.562056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.562206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.562233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.562359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.562509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.562536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.562690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.562841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.562867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.563015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.563117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.563144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.563270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.563399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.563432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.563565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.563667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.563693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.563782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.563877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.563903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.564051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.564174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.564200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.564334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.564470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.564519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.564651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.564745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.564771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.564900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.565049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.565075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.565232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.565383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.565415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.565530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.565693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.565738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.565913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.566049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.566092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.854 qpair failed and we were unable to recover it. 00:27:47.854 [2024-11-29 09:51:10.566222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.854 [2024-11-29 09:51:10.566340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.566366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.566487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.566584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.566610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.566766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.566917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.566942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.567092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.567238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.567264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.567423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.567524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.567553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.567748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.567938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.567984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.568113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.568263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.568288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.568423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.568543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.568587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.568729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.568886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.568931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.569082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.569187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.569218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.569374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.569516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.569559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.569735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.569890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.569932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.570074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.570225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.570250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.570375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.570499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.570524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.570646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.570735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.570760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.570892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.571016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.571048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.571176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.571298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.571325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.571476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.571673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.571717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.571895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.572032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.572059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.572201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.572322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.572351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.572456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.572558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.572585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.572718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.572814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.572839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.572964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.573056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.573082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.573208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.573337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.573363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.573500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.573651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.573676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.573834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.573931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.573957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.574104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.574189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.574216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.574385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.574562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.574591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.574742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.574871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.574914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.855 qpair failed and we were unable to recover it. 00:27:47.855 [2024-11-29 09:51:10.575058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.855 [2024-11-29 09:51:10.575170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.575202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.575332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.575500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.575545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.575680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.575817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.575847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.576009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.576150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.576176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.576302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.576481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.576527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.576650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.576774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.576800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.576924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.577083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.577108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.577208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.577332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.577358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.577497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.577639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.577682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.577823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.577954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.577981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.578114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.578282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.578312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.578443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.578543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.578570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.578665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.578783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.578809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.578959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.579108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.579134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.579231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.579318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.579344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.579485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.579607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.579634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.579786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.579950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.579975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.580129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.580228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.580253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.580374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.580532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.580559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.580714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.580840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.580867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.580988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.581102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.581128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.581255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.581372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.581407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.581513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.581660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.581686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.581821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.581968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.581994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.582116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.582236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.582262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.582416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.582558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.582600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.582735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.582881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.582907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.583034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.583167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.583194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.856 [2024-11-29 09:51:10.583317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.583487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.856 [2024-11-29 09:51:10.583516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.856 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.583633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.583768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.583793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.583917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.584013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.584039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.584172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.584322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.584348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.584491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.584594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.584621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.584722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.584878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.584903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.585029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.585150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.585177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.585297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.585424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.585458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.585585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.585680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.585707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.585863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.585959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.585986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.586079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.586164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.586190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.586281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.586369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.586403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.586530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.586641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.586667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.586797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.586925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.586951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.587088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.587221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.587249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.587349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.587445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.587473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.587625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.587739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.587764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.587894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.588027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.588053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.588207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.588332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.588357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.588485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.588639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.588665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.588787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.588932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.588958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.589051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.589226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.589251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.589406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.589555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.589581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.589704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.589864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.589907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.590035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.590121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.590147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.590268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.590358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.590385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.590508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.590635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.590661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.590788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.590936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.590961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.591084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.591178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.591204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.857 qpair failed and we were unable to recover it. 00:27:47.857 [2024-11-29 09:51:10.591327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.591453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.857 [2024-11-29 09:51:10.591479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.591631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.591742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.591772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.591938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.592028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.592055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.592156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.592272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.592298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.592440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.592588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.592614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.592738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.592860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.592886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.593008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.593158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.593183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.593303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.593427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.593453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.593579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.593696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.593721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.593856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.593947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.593974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.594102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.594221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.594246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.594366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.594487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.594533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.594675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.594814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.594840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.594970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.595094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.595119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.595221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.595314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.595341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.595471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.595603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.595647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.595753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.595876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.595903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.595995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.596091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.596117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.596237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.596384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.596431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.596529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.596651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.596677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.596803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.596929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.596954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.597086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.597229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.597254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.597387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.597521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.597546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.597648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.597760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.597789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.597939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.598113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.598141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.858 [2024-11-29 09:51:10.598276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.598450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.858 [2024-11-29 09:51:10.598481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.858 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.598593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.598693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.598722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.598853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.598972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.599001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.599109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.599275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.599304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.599419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.599526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.599551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.599664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.599806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.599834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.599942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.600035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.600063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.600155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.600291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.600319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.600477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.600575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.600601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.600761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.600949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.600978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.601089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.601218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.601246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.601363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.601463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.601488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.601606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.601690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.601715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.601889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.602049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.602078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.602179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.602331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.602357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.602500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.602656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.602686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.602805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.602988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.603018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.603223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.603358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.603385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.603545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.603661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.603690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.603862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.603999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.604029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.604203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.604330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.604356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.604512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.604615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.604643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.604851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.604979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.605008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.605146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.605269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.605295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.605384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.605477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.605503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.605600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.605731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.605757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.605882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.606028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.606053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.606173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.606296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.606321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.606470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.606607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.606636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.859 qpair failed and we were unable to recover it. 00:27:47.859 [2024-11-29 09:51:10.606803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.606954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.859 [2024-11-29 09:51:10.606987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.607154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.607288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.607313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.607460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.607679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.607712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.607984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.608115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.608141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.608263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.608416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.608460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.608599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.608732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.608760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.608920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.609096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.609121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.609244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.609359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.609384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.609529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.609632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.609660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.609846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.609976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.610004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.610141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.610294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.610319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.610477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.610674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.610715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.610987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.611178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.611204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.611329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.611469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.611498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.611612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.611747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.611775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.612023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.612204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.612229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.612386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.612522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.612551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.612665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.612776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.612818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.612936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.613082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.613107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.613257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.613354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.613379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.613561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.613756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.613784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.614010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.614154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.614179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.614306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.614468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.614497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.614691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.614927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.614989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.615127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.615273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.615298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.615388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.615502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.615530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.615707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.615835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.615863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.616013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.616162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.616188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.616322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.616454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.616481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.860 qpair failed and we were unable to recover it. 00:27:47.860 [2024-11-29 09:51:10.616578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.616666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.860 [2024-11-29 09:51:10.616691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.616808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.616896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.616922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.617024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.617171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.617196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.617291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.617389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.617421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.617558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.617669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.617702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.617792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.617910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.617935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.618053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.618176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.618201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.618301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.618422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.618448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.618546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.618639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.618664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.618789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.618904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.618929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.619030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.619123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.619149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.619244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.619334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.619359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.619484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.619585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.619611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.619737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.619860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.619885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.619988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.620083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.620108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.620232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.620382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.620415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.620512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.620659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.620683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.620809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.620907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.620932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.621030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.621155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.621180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.621305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.621404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.621430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.621557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.621711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.621737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.621835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.621954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.621980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.622073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.622193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.622222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.622375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.622495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.622520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.622645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.622742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.622768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.622922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.623015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.623040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.623157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.623254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.623279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.623371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.623497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.623522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.623618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.623715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.623739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.861 qpair failed and we were unable to recover it. 00:27:47.861 [2024-11-29 09:51:10.623890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.861 [2024-11-29 09:51:10.623992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.624018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.624169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.624287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.624313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.624473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.624559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.624584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.624709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.624800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.624824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.624952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.625048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.625075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.625207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.625294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.625319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.625454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.625548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.625574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.625671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.625772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.625798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.625896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.626041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.626066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.626170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.626262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.626287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.626439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.626527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.626552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.626687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.626828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.626853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.626983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.627069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.627095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.627245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.627372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.627404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.627541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.627636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.627661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.627785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.627901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.627925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.628044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.628192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.628216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.628319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.628416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.628442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.628540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.628652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.628678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.628775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.628873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.628899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.629025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.629172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.629197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.629298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.629388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.629420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.629566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.629653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.629680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.629808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.629930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.629956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.630081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.630192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.630217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.630343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.630472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.630498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.630598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.630694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.630720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.630826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.630951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.630975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.631069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.631155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.862 [2024-11-29 09:51:10.631179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.862 qpair failed and we were unable to recover it. 00:27:47.862 [2024-11-29 09:51:10.631300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.631431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.631457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.631577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.631684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.631710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.631806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.631927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.631951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.632084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.632172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.632197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.632292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.632422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.632449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.632553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.632679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.632706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.632793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.632912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.632937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.633031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.633143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.633169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.633288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.633443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.633469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.633596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.633719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.633744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.633871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.633966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.633991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.634136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.634268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.634293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.634415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.634534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.634558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.634685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.634809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.634833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.634955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.635074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.635098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.635222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.635317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.635346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.635485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.635583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.635608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.635727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.635840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.635865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.635993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.636114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.636138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.636261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.636389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.636438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.636565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.636662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.636686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.636785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.636888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.636913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.637033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.637147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.637172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.637340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.637506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.637532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.637662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.637786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.637812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.637938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.638059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.638089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.638221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.638338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.638363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:47.863 qpair failed and we were unable to recover it. 00:27:47.863 [2024-11-29 09:51:10.638515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.863 [2024-11-29 09:51:10.638654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.638683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 09:51:10.638832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.638973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.639017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 09:51:10.639149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.639247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.639273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 09:51:10.639367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.639470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.639498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 09:51:10.639656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.639781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.639806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 09:51:10.639904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.640018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.640044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 09:51:10.640166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.640292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.640318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 09:51:10.640494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.640614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.640640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 09:51:10.640742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.640866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.640892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 09:51:10.641049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.641175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.641201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 09:51:10.641351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.641529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.864 [2024-11-29 09:51:10.641573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:47.864 qpair failed and we were unable to recover it. 00:27:47.864 [2024-11-29 09:51:10.641726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.641885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.641929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.144 qpair failed and we were unable to recover it. 00:27:48.144 [2024-11-29 09:51:10.642054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.642156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.642181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.144 qpair failed and we were unable to recover it. 00:27:48.144 [2024-11-29 09:51:10.642301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.642432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.642458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.144 qpair failed and we were unable to recover it. 00:27:48.144 [2024-11-29 09:51:10.642550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.642638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.642663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.144 qpair failed and we were unable to recover it. 00:27:48.144 [2024-11-29 09:51:10.642789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.642934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.642959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.144 qpair failed and we were unable to recover it. 00:27:48.144 [2024-11-29 09:51:10.643112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.643236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.643263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.144 qpair failed and we were unable to recover it. 00:27:48.144 [2024-11-29 09:51:10.643353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.643487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.643513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.144 qpair failed and we were unable to recover it. 00:27:48.144 [2024-11-29 09:51:10.643625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.643779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.643805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.144 qpair failed and we were unable to recover it. 00:27:48.144 [2024-11-29 09:51:10.643937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.644035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.644060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.144 qpair failed and we were unable to recover it. 00:27:48.144 [2024-11-29 09:51:10.644179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.644271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.644295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.144 qpair failed and we were unable to recover it. 00:27:48.144 [2024-11-29 09:51:10.644416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.644514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.644539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.144 qpair failed and we were unable to recover it. 00:27:48.144 [2024-11-29 09:51:10.644702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.644819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.644844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.144 qpair failed and we were unable to recover it. 00:27:48.144 [2024-11-29 09:51:10.644992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.645073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.144 [2024-11-29 09:51:10.645099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.645220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.645366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.645391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.645569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.645677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.645706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.645859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.646001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.646027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.646154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.646299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.646324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.646428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.646542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.646570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.646750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.646937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.646980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.647100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.647211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.647236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.647388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.647534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.647577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.647706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.647820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.647845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.647992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.648112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.648136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.648237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.648355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.648380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.648517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.648632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.648656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.648742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.648836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.648863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.648961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.649083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.649109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.649234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.649382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.649416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.649557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.649651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.649676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.649811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.649905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.649930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.650046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.650192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.650217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.650340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.650486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.650516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.650672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.650774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.650798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.650917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.651038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.651062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.651185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.651275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.651301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.651441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.651562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.651589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.651680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.651806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.651831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.651956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.652115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.652141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.145 [2024-11-29 09:51:10.652275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.652431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.145 [2024-11-29 09:51:10.652457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.145 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.652585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.652737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.652762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.652878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.653028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.653055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.653148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.653298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.653323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.653501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.653650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.653678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.653806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.653973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.653998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.654120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.654207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.654234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.654368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.654505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.654534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.654657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.654804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.654830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.654953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.655097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.655123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.655254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.655343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.655369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.655519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.655687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.655717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.655819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.655916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.655942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.656060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.656182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.656207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.656322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.656473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.656510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.656644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.656794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.656823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.656985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.657084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.657112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.657235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.657337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.657364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.657518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.657638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.657680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.657816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.657973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.658001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.658123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.658307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.658336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.658468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.658590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.658616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.658777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.658880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.658908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.659013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.659180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.659207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.659373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.659497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.659523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.659652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.659818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.659846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.659964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.660136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.660163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.660330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.660488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.660513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.660658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.660771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.660799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.146 [2024-11-29 09:51:10.660913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.661048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.146 [2024-11-29 09:51:10.661075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.146 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.661209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.661349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.661376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.661517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.661610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.661635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.661763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.661851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.661877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.661966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.662062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.662088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.662209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.662359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.662386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.662563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.662658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.662683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.662824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.662994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.663018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.663193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.663326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.663354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.663506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.663630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.663656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.663830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.663982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.664007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.664183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.664292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.664326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.664459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.664579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.664605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.664986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.665152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.665182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.665336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.665480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.665507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.665633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.665783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.665808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.665932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.666067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.666096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.666233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.666359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.666388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.666513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.666631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.666656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.666778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.666909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.666937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.667075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.667203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.667231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.667355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.667489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.667514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.667701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.667862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.667889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.668033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.668154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.668180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.668298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.668423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.668449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.668624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.668756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.668784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.668944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.669103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.669132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.669278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.669413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.669439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.669596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.669734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.669760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.147 qpair failed and we were unable to recover it. 00:27:48.147 [2024-11-29 09:51:10.669885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.670008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.147 [2024-11-29 09:51:10.670037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.670184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.670272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.670297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.670478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.670589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.670617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.670768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.670898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.670927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.671072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.671169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.671194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.671322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.671433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.671462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.671563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.671696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.671727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.671838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.671964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.671990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.672116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.672245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.672273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.672449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.672537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.672562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.672661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.672809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.672834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.672985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.673152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.673180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.673280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.673424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.673450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.673574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.673669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.673696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.673867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.673964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.673992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.674152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.674263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.674291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.674459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.674558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.674583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.674709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.674856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.674881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.674978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.675064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.675090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.675177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.675264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.675289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.675437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.675545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.675573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.675735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.675897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.675925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.676069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.676217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.676242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.676356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.676547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.676573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.676664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.676785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.676810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.676937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.677024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.677050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.677167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.677260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.677288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.677427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.677549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.677574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.677709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.677860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.677902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.148 qpair failed and we were unable to recover it. 00:27:48.148 [2024-11-29 09:51:10.678039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.678166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.148 [2024-11-29 09:51:10.678195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.678296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.678466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.678495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.678636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.678801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.678842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.678979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.679074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.679117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.679220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.679309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.679338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.679457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.679550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.679577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.679735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.679859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.679887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.680024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.680119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.680147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.680294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.680421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.680447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.680580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.680709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.680738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.680911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.681044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.681072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.681180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.681299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.681324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.681506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.681641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.681669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.681807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.681938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.681966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.682078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.682205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.682231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.682383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.682526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.682554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.682705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.682799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.682827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.682962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.683091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.683117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.683246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.683376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.683423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.683581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.683706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.683732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.683888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.683980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.684005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.684158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.684259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.684287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.684430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.684578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.684603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.149 qpair failed and we were unable to recover it. 00:27:48.149 [2024-11-29 09:51:10.684725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.149 [2024-11-29 09:51:10.684848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.684873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.685020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.685148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.685176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.685342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.685449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.685478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.685625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.685776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.685801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.685948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.686074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.686102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.686202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.686309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.686337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.686495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.686589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.686614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.686743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.686894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.686922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.687065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.687178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.687203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.687356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.687454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.687482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.687604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.687723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.687752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.687857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.687956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.687984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.688131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.688282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.688306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.688422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.688569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.688595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.688726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.688835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.688863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.688983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.689082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.689108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.689264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.689445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.689474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.689639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.689742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.689770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.689885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.690005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.690030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.690175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.690353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.690378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.690480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.690641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.690669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.690818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.690967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.690992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.691149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.691245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.691274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.691445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.691598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.691623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.691726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.691870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.691896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.692008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.692140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.692167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.150 qpair failed and we were unable to recover it. 00:27:48.150 [2024-11-29 09:51:10.692271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.692404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.150 [2024-11-29 09:51:10.692434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.692581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.692709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.692736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.692884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.692980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.693009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.693113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.693274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.693302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.693475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.693623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.693666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.693836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.693981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.694006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.694130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.694230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.694262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.694414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.694497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.694523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.694649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.694807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.694835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.694941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.695036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.695064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.695207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.695324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.695349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.695519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.695623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.695651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.695782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.695915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.695940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.696067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.696187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.696213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.696348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.696486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.696512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.696632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.696749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.696792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.696927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.697023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.697048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.697183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.697323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.697348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.697558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.697680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.697706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.697821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.697942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.697968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.698119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.698282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.698310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.698449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.698549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.698577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.698747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.698860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.698885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.699011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.699152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.699180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.699285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.699421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.699451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.699590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.699689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.699716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.699812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.699897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.699922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.700107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.700262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.700287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.700412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.700539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.700564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.151 qpair failed and we were unable to recover it. 00:27:48.151 [2024-11-29 09:51:10.700711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.700812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.151 [2024-11-29 09:51:10.700840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.700974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.701103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.701131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.701305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.701452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.701496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.701662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.701795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.701824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.701959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.702086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.702113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.702256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.702354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.702379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.702511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.702643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.702672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.702806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.702972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.703001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.703146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.703294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.703319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.703501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.703660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.703688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.703825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.703959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.703987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.704157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.704279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.704306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.704459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.704583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.704611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.704747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.704874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.704902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.705045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.705189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.705214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.705390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.705521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.705549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.705709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.705840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.705868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.706004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.706125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.706150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.706272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.706403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.706429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.706526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.706628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.706653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.706774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.706861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.706887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.707001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.707107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.707135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.707265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.707415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.707444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.707620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.707735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.707760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.707903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.708037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.708065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.708164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.708306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.708335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.708517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.708627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.708652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.708764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.708925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.708953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.152 [2024-11-29 09:51:10.709053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.709197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.152 [2024-11-29 09:51:10.709226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.152 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.709378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.709504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.709548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.709660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.709835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.709860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.709987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.710128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.710156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.710279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.710402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.710428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.710566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.710701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.710730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.710832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.710960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.710988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.711106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.711258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.711283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.711463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.711598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.711627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.711788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.711888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.711915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.712088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.712170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.712202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.712383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.712520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.712548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.712678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.712814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.712842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.712959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.713080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.713106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.713287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.713416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.713445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.713580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.713673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.713715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.713833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.713956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.713981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.714088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.714219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.714247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.714347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.714458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.714486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.714624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.714773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.714798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.714985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.715088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.715116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.715222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.715314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.715342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.715493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.715591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.715617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.715768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.715902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.715930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.716040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.716134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.716163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.153 qpair failed and we were unable to recover it. 00:27:48.153 [2024-11-29 09:51:10.716305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.716390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.153 [2024-11-29 09:51:10.716420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.716533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.716635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.716665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.716805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.716917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.716945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.717083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.717215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.717239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.717403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.717526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.717553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.717680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.717841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.717866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.717961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.718082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.718107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.718233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.718325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.718366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.718483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.718589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.718614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.718740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.718864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.718889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.719029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.719162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.719189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.719313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.719475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.719504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.719640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.719756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.719781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.719923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.720032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.720072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.720195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.720317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.720342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.720433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.720549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.720574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.720721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.720854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.720883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.720985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.721147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.721175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.721305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.721458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.721484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.721651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.721771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.721799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.721900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.722057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.722086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.722206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.722353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.722378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.722501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.722635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.722663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.722761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.722860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.722887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.723038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.723163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.723189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.723335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.723471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.723501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.723633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.723765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.723794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.723936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.724058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.154 [2024-11-29 09:51:10.724084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.154 qpair failed and we were unable to recover it. 00:27:48.154 [2024-11-29 09:51:10.724273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.724384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.724415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.724542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.724703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.724731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.724880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.725004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.725029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.725178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.725282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.725310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.725472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.725609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.725634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.725758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.725851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.725876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.725972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.726104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.726132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.726259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.726357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.726384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.726531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.726615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.726644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.726784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.726907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.726935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.727063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.727224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.727252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.727379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.727531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.727558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.727682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.727830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.727855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.728018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.728189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.728217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.728387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.728475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.728500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.728642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.728785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.728813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.728939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.729072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.729100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.729240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.729385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.729417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.729569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.729704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.729732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.729866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.729982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.730025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.730144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.730289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.730315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.730485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.730600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.730628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.730770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.730929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.730957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.731075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.731207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.731232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.731358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.731469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.731495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.731626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.731739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.731769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.155 qpair failed and we were unable to recover it. 00:27:48.155 [2024-11-29 09:51:10.731903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.155 [2024-11-29 09:51:10.732026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.732051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.732171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.732268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.732298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.732446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.732607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.732635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.732777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.732927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.732952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.733098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.733259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.733287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.733421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.733514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.733542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.733714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.733836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.733861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.733970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.734132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.734160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.734331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.734435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.734461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.734577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.734700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.734725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.734877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.735013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.735041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.735172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.735270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.735311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.735432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.735584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.735610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.735790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.735911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.735936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.736074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.736206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.736234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.736376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.736500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.736526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.736668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.736771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.736800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.736905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.737043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.737071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.737208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.737327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.737352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.737479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.737603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.737629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.737720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.737845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.737870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.737984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.738102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.738127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.738275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.738421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.738448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.738542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.738667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.738692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.738828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.738975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.739000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.739159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.739246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.739270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.156 [2024-11-29 09:51:10.739425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.739519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.156 [2024-11-29 09:51:10.739547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.156 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.739689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.739834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.739860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.740054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.740170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.740195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.740341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.740472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.740501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.740652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.740744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.740769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.740937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.741044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.741073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.741179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.741314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.741343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.741495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.741585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.741616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.741717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.741834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.741859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.741991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.742150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.742178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.742301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.742423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.742449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.742593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.742722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.742750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.742887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.743043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.743071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.743192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.743305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.743330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.743472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.743604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.743632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.743758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.743854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.743882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.744022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.744113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.744139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.744292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.744438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.744467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.744604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.744734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.744762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.744908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.745006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.745031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.745144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.745310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.745338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.745485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.745637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.745662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.745767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.745915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.745941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.746083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.746213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.746243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.746386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.746522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.746550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.746680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.746802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.746828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.746953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.747085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.747112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.747220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.747356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.747384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.747566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.747685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.747710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.157 qpair failed and we were unable to recover it. 00:27:48.157 [2024-11-29 09:51:10.747885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.157 [2024-11-29 09:51:10.748044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.748073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.748179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.748269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.748296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.748422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.748544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.748569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.748678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.748763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.748788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.748909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.749074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.749102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.749246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.749340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.749366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.749515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.749655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.749683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.749846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.749977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.750005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.750139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.750258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.750283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.750461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.750561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.750591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.750700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.750863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.750891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.751031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.751118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.751144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.751336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.751462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.751488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.751618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.751759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.751787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.751936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.752082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.752107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.752220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.752353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.752381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.752522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.752618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.752646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.752773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.752869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.752894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.753017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.753167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.753192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.753290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.753442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.753471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.753594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.753716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.753742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.753839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.753970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.753999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.754178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.754298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.754325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.754448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.754569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.754594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.158 qpair failed and we were unable to recover it. 00:27:48.158 [2024-11-29 09:51:10.754688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.754831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.158 [2024-11-29 09:51:10.754859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.754957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.755095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.755120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.755268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.755414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.755457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.755565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.755710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.755735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.755860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.755948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.755988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.756137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.756263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.756296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.756462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.756613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.756641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.756749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.756848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.756876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.757008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.757162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.757187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.757373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.757503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.757532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.757694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.757832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.757859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.757972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.758071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.758096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.758246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.758408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.758436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.758599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.758758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.758786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.758930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.759081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.759107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.759261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.759435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.759466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.759559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.759681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.759722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.759893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.759999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.760024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.760119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.760210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.760250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.760385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.760588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.760616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.760767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.760860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.760887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.761038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.761173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.761201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.761366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.761502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.761530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.761695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.761846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.761871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.761985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.762147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.762174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.762315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.762441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.762469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.762586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.762704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.762729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.762895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.763053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.763081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.763230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.763379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.159 [2024-11-29 09:51:10.763409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.159 qpair failed and we were unable to recover it. 00:27:48.159 [2024-11-29 09:51:10.763533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.763680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.763705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.763875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.764023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.764048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.764193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.764297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.764326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.764476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.764600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.764625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.764738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.764879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.764907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.765039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.765171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.765199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.765311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.765402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.765428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.765564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.765658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.765683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.765834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.765940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.765968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.766080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.766195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.766220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.766322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.766437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.766463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.766605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.766737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.766765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.766885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.766972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.766998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.767169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.767296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.767324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.767423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.767529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.767557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.767725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.767847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.767872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.767987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.768144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.768173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.768307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.768438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.768468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.768630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.768779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.768804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.768956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.769085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.769113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.769248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.769348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.769375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.769492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.769620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.769645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.769741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.769878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.769906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.770064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.770245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.770271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.770424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.770512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.770537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.770692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.770777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.770802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.770968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.771124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.771152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.771314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.771408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.160 [2024-11-29 09:51:10.771436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.160 qpair failed and we were unable to recover it. 00:27:48.160 [2024-11-29 09:51:10.771621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.771767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.771792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.771974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.772123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.772148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.772271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.772383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.772414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.772527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.772691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.772719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.772856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.772965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.772993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.773105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.773208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.773233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.773359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.773509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.773537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.773669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.773813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.773838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.773987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.774082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.774107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.774279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.774377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.774417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.774579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.774706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.774734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.774883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.775000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.775025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.775196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.775319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.775347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.775508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.775605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.775634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.775774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.775875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.775900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.776051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.776198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.776223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.776357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.776511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.776537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.776658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.776747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.776772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.776915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.777069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.777098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.777260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.777357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.777384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.777521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.777641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.777668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.777840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.777978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.778011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.778176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.778345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.778373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.778529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.778642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.778667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.778809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.778905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.778935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.779065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.779192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.779220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.779368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.779526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.779551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.779685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.779855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.779882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.161 qpair failed and we were unable to recover it. 00:27:48.161 [2024-11-29 09:51:10.780017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.161 [2024-11-29 09:51:10.780143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.780171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.780318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.780440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.780466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.780614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.780734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.780762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.780899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.781030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.781059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.781202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.781319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.781345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.781502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.781632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.781661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.781824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.781958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.781986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.782127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.782248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.782273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.782436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.782606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.782635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.782795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.782922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.782950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.783093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.783218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.783244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.783362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.783525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.783556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.783693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.783823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.783852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.784004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.784123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.784149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.784321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.784444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.784473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.784580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.784739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.784767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.784934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.785097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.785126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.785252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.785346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.785374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.785514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.785673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.785701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.785826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.785971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.785996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.786151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.786252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.786283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.786460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.786595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.786623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.786762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.786865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.786890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.787045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.787136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.787181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.787312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.787424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.787455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.787567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.787684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.787709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.787879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.788034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.788062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.788201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.788293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.788321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.788472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.788619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.788644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.162 qpair failed and we were unable to recover it. 00:27:48.162 [2024-11-29 09:51:10.788817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.162 [2024-11-29 09:51:10.788937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.788965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.789104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.789252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.789277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.789390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.789513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.789538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.789689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.789822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.789855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.790003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.790140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.790168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.790342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.790446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.790472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.790669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.790787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.790812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.790918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.791038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.791081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.791223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.791340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.791365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.791469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.791556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.791599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.791729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.791857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.791885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.792033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.792164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.792189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.792310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.792421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.792450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.792611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.792724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.792752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.792874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.792965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.792991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.793149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.793278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.793305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.793439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.793532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.793560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.793704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.793798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.793823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.793947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.794084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.794112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.794246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.794341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.794369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.794492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.794610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.794636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.794804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.794936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.794964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.795104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.795219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.795244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.795414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.795500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.795526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.795638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.795768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.795796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.163 qpair failed and we were unable to recover it. 00:27:48.163 [2024-11-29 09:51:10.795897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.163 [2024-11-29 09:51:10.796036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.796064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.796216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.796315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.796341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.796501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.796622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.796650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.796821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.796945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.796970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.797064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.797183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.797210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.797296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.797417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.797446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.797607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.797737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.797764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.797901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.798024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.798050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.798226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.798318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.798346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.798476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.798597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.798622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.798768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.798892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.798917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.799109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.799241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.799266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.799369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.799521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.799548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.799669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.799815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.799839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.800016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.800182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.800209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.800334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.800470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.800499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.800642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.800783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.800824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.800991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.801146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.801174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.801277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.801368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.801403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.801542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.801633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.801659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.801821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.801976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.802004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.802138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.802239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.802267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.802375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.802506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.802532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.802655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.802780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.802804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.803014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.803130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.803157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.803308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.803428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.803455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.803584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.803717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.803747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.803907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.804079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.804104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.804255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.804403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.164 [2024-11-29 09:51:10.804446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.164 qpair failed and we were unable to recover it. 00:27:48.164 [2024-11-29 09:51:10.804610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.804715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.804750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.804879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.805002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.805030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.805199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.805318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.805343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.805495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.805627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.805657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.805823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.805926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.805954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.806073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.806158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.806183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.806310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.806404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.806430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.806551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.806699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.806727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.806841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.806936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.806962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.807064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.807184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.807210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.807312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.807452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.807481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.807601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.807695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.807720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.807809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.807907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.807934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.808078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.808211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.808239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.808361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.808451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.808476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.808625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.808745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.808772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.808906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.809061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.809089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.809231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.809318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.809343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.809489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.809648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.809676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.809804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.809961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.809989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.810131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.810253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.810279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.810433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.810570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.810596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.810712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.810816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.810857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.811004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.811097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.811122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.811263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.811426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.811455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.811588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.811718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.811745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.811850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.811979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.812004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.165 [2024-11-29 09:51:10.812156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.812294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.165 [2024-11-29 09:51:10.812322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.165 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.812455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.812587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.812617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.812736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.812852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.812878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.812972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.813121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.813149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.813280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.813406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.813434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.813574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.813692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.813717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.813838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.813964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.813992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.814158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.814292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.814317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.814425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.814551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.814576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.814698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.814789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.814817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.814976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.815110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.815138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.815284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.815422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.815448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.815591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.815756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.815784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.815916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.816074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.816102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.816271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.816422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.816463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.816628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.816725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.816752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.816853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.816960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.816988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.817107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.817191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.817217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.817355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.817517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.817546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.817706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.817839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.817867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.817979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.818105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.818131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.818259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.818352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.818377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.818478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.818599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.818624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.818744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.818828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.818853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.818952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.819124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.819157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.819284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.819418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.819447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.819564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.819664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.819689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.819778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.819911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.819938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.820040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.820183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.820213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.166 [2024-11-29 09:51:10.820357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.820457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.166 [2024-11-29 09:51:10.820483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.166 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.820641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.820747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.820775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.820931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.821059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.821087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.821226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.821325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.821350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.821472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.821606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.821636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.821744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.821881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.821914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.822059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.822176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.822201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.822316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.822455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.822485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.822619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.822753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.822781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.822888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.822969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.822994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.823137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.823255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.823283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.823381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.823547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.823576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.823721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.823863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.823889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.824037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.824179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.824203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.824329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.824521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.824549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.824670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.824787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.824812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.824960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.825086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.825114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.825280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.825389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.825423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.825549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.825670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.825695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.825813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.825973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.826001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.826133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.826266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.826294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.826451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.826550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.826577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.826724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.826858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.826886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.827016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.827184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.827212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.827384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.827519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.827544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.827738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.827850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.827876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.827967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.828108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.828136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.828279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.828402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.828428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.828600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.828734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.167 [2024-11-29 09:51:10.828764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.167 qpair failed and we were unable to recover it. 00:27:48.167 [2024-11-29 09:51:10.828912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.829032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.829059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.829206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.829296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.829321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.829460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.829562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.829590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.829738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.829834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.829859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.830019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.830108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.830135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.830279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.830386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.830420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.830557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.830647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.830675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.830801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.830933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.830959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.831088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.831213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.831241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.831334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.831466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.831495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.831618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.831702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.831727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.831886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.832005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.832031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.832159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.832296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.832321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.832453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.832541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.832566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.832710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.832852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.832882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.833023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.833130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.833158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.833292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.833412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.833438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.833606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.833731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.833759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.833935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.834078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.834104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.834224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.834342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.834367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.834466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.834590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.834615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.834758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.834860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.834888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.834996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.835110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.835135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.835242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.835421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.835447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.835573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.835695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.835720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.835848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.835994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.168 [2024-11-29 09:51:10.836020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.168 qpair failed and we were unable to recover it. 00:27:48.168 [2024-11-29 09:51:10.836184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.836303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.836331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.836494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.836655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.836689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.836835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.836951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.836977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.837134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.837225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.837250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.837372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.837548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.837577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.837736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.837825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.837850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.837944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.838084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.838113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.838222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.838351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.838380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.838509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.838593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.838618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.838747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.838844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.838869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.838965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.839105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.839133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.839272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.839389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.839421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.839549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.839688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.839715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.839860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.839984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.840011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.840156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.840258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.840285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.840386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.840496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.840540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.840702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.840870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.840898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.841016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.841163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.841189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.841338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.841499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.841528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.841692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.841852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.841879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.841994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.842120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.842145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.842300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.842415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.842444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.842583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.842707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.842734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.842909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.843009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.843036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.843186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.843308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.843336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.843483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.843569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.843594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.843748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.843910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.843938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.844051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.844152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.844181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.844309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.844436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.169 [2024-11-29 09:51:10.844465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.169 qpair failed and we were unable to recover it. 00:27:48.169 [2024-11-29 09:51:10.844611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.844727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.844752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.844897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.845064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.845089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.845192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.845281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.845309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.845480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.845598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.845624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.845778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.845906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.845934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.846074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.846186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.846212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.846336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.846425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.846451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.846550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.846713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.846742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.846901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.847001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.847028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.847174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.847256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.847281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.847391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.847501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.847529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.847694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.847830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.847858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.848004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.848150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.848176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.848319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.848431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.848460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.848565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.848698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.848723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.848879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.849041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.849066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.849178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.849334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.849362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.849517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.849610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.849637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.849754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.849872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.849897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.850006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.850140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.850168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.850295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.850403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.850432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.850552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.850652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.850677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.850803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.850900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.850926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.851047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.851212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.851245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.851366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.851471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.851497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.851606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.851725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.851768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.851866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.851968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.851996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.852103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.852220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.852245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.852355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.852493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.170 [2024-11-29 09:51:10.852523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.170 qpair failed and we were unable to recover it. 00:27:48.170 [2024-11-29 09:51:10.852701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.852832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.852857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.852982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.853073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.853098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.853254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.853422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.853451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.853584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.853742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.853770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.853923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.854016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.854041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.854214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.854356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.854381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.854534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.854643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.854673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.854842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.854973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.854998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.855091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.855202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.855232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.855419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.855554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.855584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.855704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.855831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.855857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.855976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.856078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.856106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.856250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.856421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.856447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.856570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.856714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.856739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.856856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.856986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.857014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.857155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.857281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.857309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.857446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.857561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.857588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.857747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.857847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.857875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.857996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.858152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.858179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.858289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.858434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.858459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.858586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.858750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.858778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.858903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.859065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.859094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.859198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.859291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.859316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.859444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.859533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.859577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.859750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.859896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.859921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.860017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.860136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.860162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.860311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.860418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.860447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.860549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.860673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.860701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.171 qpair failed and we were unable to recover it. 00:27:48.171 [2024-11-29 09:51:10.860869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.860989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.171 [2024-11-29 09:51:10.861014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.861162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.861297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.861325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.861444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.861577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.861607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.861754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.861872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.861897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.862067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.862162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.862189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.862321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.862476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.862506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.862651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.862773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.862800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.862980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.863111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.863139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.863272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.863418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.863446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.863590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.863674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.863699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.863842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.863967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.863995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.864121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.864252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.864280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.864434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.864597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.864623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.864781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.864913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.864941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.865051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.865219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.865245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.865402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.865526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.865567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.865669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.865825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.865854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.865958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.866082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.866115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.866254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.866374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.866407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.866555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.866682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.866710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.866846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.866942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.866970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.867151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.867239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.867264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.867419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.867587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.867615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.867727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.867905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.867930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.868051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.868183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.868208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.868389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.868565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.868594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.172 qpair failed and we were unable to recover it. 00:27:48.172 [2024-11-29 09:51:10.868729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.172 [2024-11-29 09:51:10.868857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.868885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.869022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.869139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.869169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.869315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.869472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.869501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.869667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.869795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.869823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.869970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.870090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.870115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.870248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.870355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.870383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.870521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.870624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.870652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.870821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.870942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.870968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.871107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.871239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.871269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.871377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.871533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.871563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.871690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.871836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.871862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.871979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.872109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.872137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.872275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.872408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.872437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.872587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.872720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.872745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.872937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.873062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.873087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.873177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.873267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.873291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.873385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.873540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.873565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.873713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.873817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.873845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.873969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.874067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.874097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.874243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.874331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.874358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.874520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.874645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.874670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.874801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.874946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.874971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.875107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.875233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.875258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.875413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.875585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.875613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.875709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.875869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.875897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.876009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.876162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.876187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.876369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.876508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.876537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.876644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.876770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.876799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.876916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.877013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.173 [2024-11-29 09:51:10.877039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.173 qpair failed and we were unable to recover it. 00:27:48.173 [2024-11-29 09:51:10.877130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.877248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.877274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.877369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.877515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.877544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.877724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.877823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.877848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.877948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.878123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.878151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.878306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.878439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.878481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.878603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.878706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.878731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.878884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.879016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.879044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.879144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.879276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.879305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.879460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.879582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.879607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.879756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.879882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.879910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.880011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.880149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.880177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.880288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.880441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.880466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.880619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.880749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.880777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.880936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.881116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.881142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.881290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.881404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.881430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.881552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.881643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.881683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.881846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.881992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.882020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.882170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.882281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.882306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.882412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.882528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.882556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.882689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.882813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.882838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.882963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.883118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.883143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.883308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.883427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.883454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.883541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.883655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.883680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.883804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.883925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.883954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.884103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.884240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.884267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.884371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.884524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.884549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.884644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.884765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.884791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.884912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.884994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.885019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.885152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.885310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.174 [2024-11-29 09:51:10.885338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.174 qpair failed and we were unable to recover it. 00:27:48.174 [2024-11-29 09:51:10.885462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.885560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.885585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.885684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.885800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.885826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.885953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.886075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.886101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.886197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.886341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.886366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.886518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.886644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.886672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.886819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.886956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.886984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.887098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.887222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.887249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.887422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.887550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.887577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.887711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.887836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.887864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.888008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.888153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.888178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.888347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.888468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.888494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.888665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.888825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.888853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.888993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.889118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.889144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.889232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.889380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.889415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.889558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.889718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.889746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.889896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.889987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.890012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.890143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.890273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.890298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.890451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.890598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.890623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.890744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.890858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.890883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.891067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.891196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.891224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.891348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.891486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.891515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.891638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.891785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.891811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.891956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.892084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.892112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.892273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.892409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.892440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.892600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.892683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.892708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.892832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.893006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.893031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.893181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.893322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.893350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.893459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.893606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.893631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.175 qpair failed and we were unable to recover it. 00:27:48.175 [2024-11-29 09:51:10.893766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.175 [2024-11-29 09:51:10.893898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.893928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.894090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.894265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.894291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.894416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.894541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.894566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.894703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.894835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.894865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.895012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.895138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.895163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.895258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.895345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.895370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.895478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.895625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.895650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.895795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.895911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.895939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.896052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.896172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.896197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.896332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.896469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.896498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.896627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.896746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.896771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.896898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.897048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.897089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.897250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.897380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.897416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.897556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.897685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.897713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.897859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.897971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.897996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.898140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.898269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.898297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.898445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.898640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.898665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.898783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.898877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.898907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.899035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.899176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.899204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.899366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.899492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.899522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.899637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.899758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.899783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.899909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.900000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.900025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.900161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.900302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.900332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.900495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.900611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.900636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.900799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.900958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.900986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.901095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.901233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.901261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.901368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.901463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.901489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.901626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.901750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.901778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.901888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.901993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.902021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.176 qpair failed and we were unable to recover it. 00:27:48.176 [2024-11-29 09:51:10.902159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.176 [2024-11-29 09:51:10.902303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.902328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.902482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.902609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.902637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.902772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.902895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.902923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.903065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.903212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.903238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.903423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.903564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.903589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.903714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.903827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.903853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.903980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.904079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.904104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.904251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.904351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.904379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.904545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.904671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.904700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.904881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.905000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.905025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.905126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.905211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.905236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.905367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.905484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.905509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.905625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.905773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.905798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.905946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.906106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.906134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.906271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.906426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.906456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.906620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.906715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.906740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.906839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.906972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.907000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.907141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.907255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.907283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.907429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.907524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.907549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.907683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.907817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.907845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.907984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.908153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.908181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.908324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.908445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.908470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.908571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.908714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.908740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.908924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.909061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.909089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.909240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.909361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.909388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.177 qpair failed and we were unable to recover it. 00:27:48.177 [2024-11-29 09:51:10.909569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.177 [2024-11-29 09:51:10.909700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.909729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.909874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.909960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.909985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.910116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.910234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.910259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.910414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.910589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.910616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.910745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.910841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.910869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.910977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.911101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.911126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.911252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.911348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.911390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.911525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.911666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.911691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.911811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.911900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.911925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.912098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.912266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.912294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.912400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.912538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.912580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.912703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.912799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.912824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.912955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.913081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.913109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.913242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.913372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.913406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.913551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.913674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.913704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.913879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.914001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.914029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.914187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.914316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.914344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.914496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.914627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.914652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.914812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.914899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.914924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.915046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.915148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.915190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.915316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.915430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.915457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.915612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.915719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.915748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.915881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.915991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.916019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.916140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.916256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.916281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.916411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.916558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.916583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.916700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.916830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.916859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.916999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.917091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.917116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.917218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.917314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.917339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.917527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.917648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.178 [2024-11-29 09:51:10.917673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.178 qpair failed and we were unable to recover it. 00:27:48.178 [2024-11-29 09:51:10.917862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.917954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.917979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.918099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.918237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.918265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.918370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.918517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.918545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.918685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.918799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.918823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.918912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.919035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.919060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.919201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.919361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.919390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.919527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.919656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.919682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.919807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.919900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.919944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.920055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.920184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.920214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.920353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.920485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.920510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.920667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.920763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.920807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.920950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.921039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.921064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.921188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.921304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.921328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.921489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.921588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.921616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.921760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.921888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.921916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.922060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.922145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.922170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.922322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.922476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.922505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.922665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.922791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.922820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.922991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.923140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.923182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.923321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.923455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.923483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.923647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.923794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.923819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.923978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.924094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.924119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.924279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.924405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.924434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.924534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.924665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.924708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.924799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.924890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.924915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.925012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.925157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.925183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.925360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.925496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.925539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.925663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.925779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.925805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.925954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.926079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.179 [2024-11-29 09:51:10.926107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.179 qpair failed and we were unable to recover it. 00:27:48.179 [2024-11-29 09:51:10.926233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.926327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.926355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.926506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.926597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.926622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.926726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.926847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.926889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.927051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.927158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.927186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.927303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.927428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.927455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.927604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.927701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.927729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.927863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.928001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.928029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.928148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.928230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.928260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.928415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.928560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.928589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.928753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.928909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.928939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.929085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.929235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.929261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.929410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.929536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.929564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.929666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.929794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.929823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.929946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.930094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.930119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.930235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.930404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.930433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.930544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.930667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.930694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.930836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.930924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.930951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.931048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.931170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.931200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.931302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.931435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.931461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.931582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.931705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.931731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.931859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.931949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.931991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.932111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.932246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.932274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.932428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.932543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.932568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.932707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.932865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.932893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.933045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.933205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.933233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.933342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.933473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.933498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.933642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.933812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.933841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.933946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.934088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.934116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.934277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.934373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.180 [2024-11-29 09:51:10.934405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.180 qpair failed and we were unable to recover it. 00:27:48.180 [2024-11-29 09:51:10.934578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.934727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.934752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.934920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.935025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.935053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.935165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.935284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.935309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.935434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.935559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.935587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.935713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.935837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.935865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.935983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.936109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.936134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.936280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.936413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.936442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.936532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.936665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.936695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.936863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.937008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.937033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.937192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.937321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.937348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.937502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.937654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.937679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.937871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.937988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.938013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.938232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.938374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.938421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.938554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.938686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.938714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.938857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.938949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.938975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.939108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.939192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.939218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.939382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.939488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.939516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.939671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.939792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.939817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.939968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.940123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.940151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.940287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.940496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.940525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.940662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.940810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.940835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.940955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.941133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.941159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.941309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.941467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.941497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.941701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.941820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.941847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.942071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.942239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.942267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.181 [2024-11-29 09:51:10.942405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.942504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.181 [2024-11-29 09:51:10.942533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.181 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.942654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.942778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.942804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.942936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.943068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.943096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.943230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.943361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.943410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.943548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.943698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.943724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.943899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.944023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.944050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.944256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.944417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.944446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.944621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.944754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.944779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.944907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.945024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.945049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.945136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.945309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.945337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.945481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.945607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.945632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.945783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.945980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.946006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.946149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.946256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.946284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.946461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.946555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.946580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.946767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.946882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.946916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.947026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.947152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.947180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.947333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.947462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.947488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.947646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.947754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.947781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.947911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.948023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.948052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.948178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.948291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.948316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.948425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.948523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.948551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.948684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.948794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.948823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.948931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.949126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.949151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.949328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.949511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.949537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.949651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.949792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.949820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.949977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.950089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.950115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.950292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.950467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.950493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.950614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.950745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.950773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.950918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.951008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.951034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.951238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.951371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.951425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.951566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.951770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.182 [2024-11-29 09:51:10.951801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.182 qpair failed and we were unable to recover it. 00:27:48.182 [2024-11-29 09:51:10.951966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.952083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.952108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.952255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.952386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.952422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.952560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.952725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.952753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.952883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.952981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.953006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.953105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.953252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.953280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.953378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.953487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.953517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.953637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.953724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.953749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.953868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.953991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.954016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.954144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.954227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.954253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.954409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.954608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.954636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.954776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.954936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.954963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.955092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.955217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.955245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.955391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.955497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.955523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.955634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.955767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.955795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.955941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.956079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.956107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.956255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.956417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.956443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.956581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.956713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.956741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.956874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.957048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.957073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.957225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.957373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.957422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.957593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.957731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.957759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.957854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.957951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.957979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.958092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.958222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.958247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.958361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.958475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.958504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.958634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.958723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.958751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.958924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.959013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.959038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.959215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.959373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.959415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.959528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.959692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.959717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.959817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.959937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.959963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.960145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.960279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.960307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.960443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.960547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.960575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.960712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.960843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.183 [2024-11-29 09:51:10.960868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.183 qpair failed and we were unable to recover it. 00:27:48.183 [2024-11-29 09:51:10.961027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.961159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.961184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 09:51:10.961344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.961457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.961481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 09:51:10.961573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.961719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.961743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 09:51:10.961870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.962042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.962085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 09:51:10.962202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.962340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.962368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 09:51:10.962486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.962605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.962631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 09:51:10.962769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.962906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.962936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 09:51:10.963041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.963177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.963205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 09:51:10.963359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.963484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.963509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.184 [2024-11-29 09:51:10.963657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.963797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.184 [2024-11-29 09:51:10.963825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.184 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.963961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.964111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.964137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.964290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.964410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.964436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.964565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.964710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.964739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.964908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.965042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.965070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.965219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.965332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.965358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.965480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.965587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.965616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.965747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.965913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.965938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.966061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.966182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.966207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.966331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.966468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.966497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.966626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.966720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.966748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.966879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.967074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.967117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.967283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.967415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.967443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.967569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.967694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.967722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.967867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.967989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.968014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.968198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.968294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.968322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.968503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.968633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.968661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.466 qpair failed and we were unable to recover it. 00:27:48.466 [2024-11-29 09:51:10.968804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.466 [2024-11-29 09:51:10.968920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.968945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.969095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.969221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.969249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.969379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.969548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.969576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.969724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.969844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.969869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.969987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.970111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.970139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.970270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.970443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.970469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.970594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.970761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.970804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.970969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.971070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.971100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.971244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.971342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.971370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.971517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.971632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.971657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.971809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.971930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.971955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.972068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.972192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.972217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.972335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.972458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.972484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.972594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.972733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.972758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.972847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.972969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.972994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.973090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.973205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.973230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.973386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.973517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.973545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.973678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.973848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.973875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.974017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.974138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.974164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.974268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.974403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.974432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.974542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.974686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.974713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.974834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.974981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.975006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.975113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.975260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.975286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.975419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.975577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.975605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.975746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.975862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.975887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.976008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.976183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.976209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.976331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.976494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.976523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.976665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.976757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.976782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.976868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.976999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.467 [2024-11-29 09:51:10.977045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.467 qpair failed and we were unable to recover it. 00:27:48.467 [2024-11-29 09:51:10.977207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.977340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.977368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.977512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.977630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.977655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.977830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.977992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.978017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.978149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.978321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.978349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.978531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.978621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.978647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.978766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.978905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.978934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.979066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.979204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.979229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.979379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.979492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.979518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.979664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.979792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.979820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.979966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.980113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.980146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.980242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.980355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.980380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.980528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.980653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.980681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.980847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.980983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.981011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.981147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.981258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.981284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.981434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.981570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.981598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.981768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.981888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.981916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.982085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.982206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.982234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.982391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.982521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.982549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.982687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.982845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.982874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.983054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.983221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.983248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.983428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.983547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.983573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.983676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.983762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.983787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.983943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.984090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.984115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.984290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.984387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.984422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.984565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.984713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.984739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.984891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.985036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.985080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.985234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.985356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.985382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.985561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.985686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.985715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.985870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.986015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.468 [2024-11-29 09:51:10.986041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.468 qpair failed and we were unable to recover it. 00:27:48.468 [2024-11-29 09:51:10.986168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.986269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.986298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.986440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.986574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.986603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.986748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.986897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.986939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.987080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.987239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.987267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.987374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.987482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.987513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.987629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.987778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.987803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.987954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.988097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.988127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.988289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.988384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.988418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.988559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.988653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.988680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.988772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.988887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.988915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.989052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.989174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.989202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.989328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.989490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.989516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.989632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.989760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.989789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.989923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.990055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.990083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.990231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.990380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.990411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.990567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.990734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.990762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.990888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.991008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.991036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.991223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.991340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.991365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.991504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.991597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.991625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.991788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.991950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.991978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.992110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.992200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.992225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.992350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.992522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.992551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.992713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.992843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.992870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.992983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.993071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.993096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.993195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.993345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.993370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.993466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.993588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.993615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.993712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.993806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.993832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.993986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.994116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.994145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.469 qpair failed and we were unable to recover it. 00:27:48.469 [2024-11-29 09:51:10.994278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.469 [2024-11-29 09:51:10.994382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.994414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.994532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.994622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.994647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.994785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.994913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.994941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.995047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.995214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.995247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.995361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.995457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.995483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.995661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.995789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.995816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.995918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.996096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.996121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.996241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.996371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.996403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.996564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.996725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.996750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.996872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.996962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.997004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.997146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.997269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.997294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.997448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.997608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.997636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.997777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.997903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.997932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.998073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.998218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.998242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.998360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.998454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.998482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.998618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.998751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.998779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.998917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.999065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.999090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.999245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.999384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.999435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.999588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.999735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.999760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:10.999879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.999967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:10.999994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:11.000141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:11.000267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:11.000295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:11.000399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:11.000545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:11.000570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:11.000694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:11.000812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:11.000837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:11.000989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:11.001087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:11.001114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:11.001223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:11.001356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:11.001384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:11.001505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:11.001593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:11.001618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.470 qpair failed and we were unable to recover it. 00:27:48.470 [2024-11-29 09:51:11.001735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:11.001822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.470 [2024-11-29 09:51:11.001847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.001992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.002097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.002125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.002262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.002407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.002434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.002583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.002718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.002748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.002846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.002934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.002962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.003108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.003220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.003245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.003389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.003567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.003592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.003742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.003875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.003904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.004014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.004103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.004129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.004265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.004365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.004414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.004531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.004693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.004721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.004835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.004925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.004951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.005125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.005255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.005283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.005445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.005581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.005609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.005744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.005836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.005862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.005983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.006087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.006115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.006239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.006373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.006408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.006576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.006693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.006718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.006880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.006983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.007008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 148646 Killed "${NVMF_APP[@]}" "$@" 00:27:48.471 [2024-11-29 09:51:11.007153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.007327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.007352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.007466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 09:51:11 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:48.471 [2024-11-29 09:51:11.007560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.007586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 09:51:11 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:48.471 [2024-11-29 09:51:11.007743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 09:51:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:48.471 [2024-11-29 09:51:11.007854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.007883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 09:51:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:48.471 [2024-11-29 09:51:11.008025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 09:51:11 -- common/autotest_common.sh@10 -- # set +x 00:27:48.471 [2024-11-29 09:51:11.008132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.008162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.008308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.008465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.008492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.008619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.008731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.008759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.008922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.009023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.009052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.471 qpair failed and we were unable to recover it. 00:27:48.471 [2024-11-29 09:51:11.009191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.471 [2024-11-29 09:51:11.009285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.009311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.009441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.009606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.009635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.009769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.009937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.009962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.010088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.010179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.010205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.010358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.010506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.010535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.010679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.010774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.010799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.010908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.011007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.011032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.011162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 09:51:11 -- nvmf/common.sh@469 -- # nvmfpid=149781 00:27:48.472 [2024-11-29 09:51:11.011298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.011326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 09:51:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:48.472 [2024-11-29 09:51:11.011435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 09:51:11 -- nvmf/common.sh@470 -- # waitforlisten 149781 00:27:48.472 [2024-11-29 09:51:11.011564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.011592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 09:51:11 -- common/autotest_common.sh@829 -- # '[' -z 149781 ']' 00:27:48.472 [2024-11-29 09:51:11.011715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.011810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 09:51:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:48.472 [2024-11-29 09:51:11.011836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 09:51:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:48.472 [2024-11-29 09:51:11.011959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.012052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.012098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 wit 09:51:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:48.472 h addr=10.0.0.2, port=4420 00:27:48.472 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 09:51:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:48.472 [2024-11-29 09:51:11.012241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 09:51:11 -- common/autotest_common.sh@10 -- # set +x 00:27:48.472 [2024-11-29 09:51:11.012418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.012448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.012565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.012687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.012712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.012847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.013015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.013043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.013146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.013276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.013304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.013424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.013551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.013577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.013677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.013764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.013789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.013913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.014054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.014083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.014260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.014358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.014384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.014516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.014659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.014696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.014836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.014980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.015007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.015111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.015202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.015228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.015324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.015465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.015491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.015664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.015789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.015817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.015986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.016108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.016133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.016251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.016411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.016438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.016598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.016710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.472 [2024-11-29 09:51:11.016740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.472 qpair failed and we were unable to recover it. 00:27:48.472 [2024-11-29 09:51:11.016874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.016971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.016996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.017169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.017275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.017303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.017470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.017639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.017667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.017820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.017916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.017943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.018059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.018196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.018224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.018335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.018473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.018503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.018676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.018765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.018791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.018945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.019035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.019060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.019181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.019325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.019353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.019506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.019631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.019656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.019848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.019971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.019999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.020137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.020268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.020296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.020430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.020551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.020577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.020771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.020923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.020948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.021051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.021175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.021205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.021312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.021436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.021463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.021614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.021772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.021817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.021931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.022067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.022096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.022264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.022388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.022418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.022570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.022678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.022706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.022870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.023015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.023042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.023156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.023281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.023306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.023462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.023596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.023625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.023729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.023860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.023889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.024028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.024156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.024182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.024303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.024415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.024443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.024541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.024674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.024702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.024847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.024970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.024995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.025120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.025292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.473 [2024-11-29 09:51:11.025320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.473 qpair failed and we were unable to recover it. 00:27:48.473 [2024-11-29 09:51:11.025494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.025647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.025672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.025792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.025892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.025919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.026105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.026279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.026304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.026390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.026559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.026587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.026759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.026890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.026932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.027093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.027192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.027219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.027325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.027458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.027499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.027598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.027747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.027772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.027951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.028116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.028145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.028277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.028427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.028453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.028553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.028702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.028727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.028879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.029039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.029066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.029197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.029335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.029362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.029492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.029592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.029618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.029737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.029883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.029913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.030080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.030212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.030240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.030381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.030501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.030527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.030731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.030859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.030884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.031011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.031136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.031162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.031250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.031366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.031391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.031561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.031681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.031706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.031826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.031973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.031998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.032124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.032242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.032267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.032366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.032494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.032520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.032644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.032740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.032766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.032887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.032988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.033015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.033153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.033268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.033294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.033442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.033594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.033619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.033748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.033838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.474 [2024-11-29 09:51:11.033863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.474 qpair failed and we were unable to recover it. 00:27:48.474 [2024-11-29 09:51:11.033954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.034035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.034060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.034158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.034258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.034284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.034377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.034496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.034522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.034681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.034810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.034835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.034959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.035065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.035091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.035212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.035333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.035359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.035469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.035582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.035608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.035708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.035819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.035844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.035934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.036086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.036111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.036233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.036399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.036425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.036549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.036646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.036672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.036774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.036897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.036922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.037026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.037153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.037178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.037269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.037368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.037400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.037549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.037638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.037663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.037814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.037960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.037985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.038106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.038198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.038224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.038353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.038475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.038501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.038601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.038687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.038713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.038819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.038942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.038967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.039065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.039154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.039179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.039280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.039405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.039432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.039557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.039707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.039733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.039821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.039922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.039947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.040082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.040180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.475 [2024-11-29 09:51:11.040205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.475 qpair failed and we were unable to recover it. 00:27:48.475 [2024-11-29 09:51:11.040317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.040448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.040474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.040593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.040713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.040738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.040895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.040980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.041005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.041155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.041245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.041270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.041364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.041520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.041547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.041702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.041824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.041851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.041978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.042092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.042117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.042227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.042371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.042401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.042522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.042636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.042661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.042792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.042905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.042930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.043032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.043187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.043213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.043369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.043469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.043499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.043626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.043738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.043764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.043867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.043987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.044012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.044108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.044236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.044262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.044354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.044454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.044481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.044631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.044762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.044787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.044916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.045015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.045042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.045157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.045246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.045271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.045368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.045489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.045516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.045622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.045759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.045784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.045926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.046009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.046034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.046140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.046233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.046260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.046364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.046511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.046538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.046635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.046724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.046750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.046873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.047020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.047045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.047196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.047292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.047317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.047415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.047501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.047526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.476 [2024-11-29 09:51:11.047617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.047742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.476 [2024-11-29 09:51:11.047768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.476 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.047878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.047966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.047991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.048090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.048213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.048239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.048362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.048492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.048518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.048621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.048721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.048746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.048842] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:48.477 [2024-11-29 09:51:11.048869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.048914] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:48.477 [2024-11-29 09:51:11.048993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.049019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.049144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.049247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.049271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.049403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.049498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.049523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.049676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.049797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.049822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.049917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.050065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.050090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.050218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.050320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.050346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.050477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.050562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.050589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.050682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.050784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.050810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.050904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.050995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.051021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.051172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.051315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.051340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.051440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.051588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.051614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.051744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.051869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.051895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.052039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.052128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.052154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.052255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.052379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.052414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.052546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.052667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.052693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.052846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.052938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.052963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.053055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.053178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.053203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.053325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.053415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.053443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.053573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.053693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.053723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.053843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.053938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.053964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.054092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.054190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.054215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.054308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.054443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.054470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.054575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.054721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.054747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.054879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.054973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.477 [2024-11-29 09:51:11.054998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.477 qpair failed and we were unable to recover it. 00:27:48.477 [2024-11-29 09:51:11.055136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.055235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.055260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.055351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.055457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.055483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.055576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.055676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.055702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.055788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.055885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.055910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.056028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.056146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.056176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.056283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.056417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.056444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.056542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.056664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.056689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.056782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.056900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.056926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.057031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.057176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.057201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.057292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.057402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.057427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.057551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.057645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.057670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.057801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.057897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.057921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.058032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.058142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.058166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.058256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.058371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.058410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.058548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.058658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.058689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.058814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.058945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.058972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.059074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.059198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.059225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.059323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.059436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.059466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.059593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.059696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.059723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.059837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.059971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.059997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.060125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.060210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.060236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.060362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.060477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.060503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.060634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.060739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.060765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.060862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.060962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.060989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.061089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.061194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.061221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.061386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.061524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.061550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.061676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.061770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.061798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.061902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.062030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.062056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.062182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.062364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.478 [2024-11-29 09:51:11.062402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.478 qpair failed and we were unable to recover it. 00:27:48.478 [2024-11-29 09:51:11.062499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.062596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.062622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.062750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.062841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.062867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.062995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.063116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.063143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.063273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.063387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.063431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.063530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.063633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.063659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.063793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.063948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.063973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.064103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.064202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.064228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.064329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.064432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.064461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.064580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.064680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.064710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.064832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.064978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.065003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.065106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.065202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.065228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.065353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.065485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.065513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.065664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.065790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.065816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.065942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.066038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.066064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.066190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.066313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.066340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.066454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.066541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.066567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.066723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.066823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.066850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.066972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.067065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.067090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.067181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.067285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.067310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.067412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.067544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.067570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.067699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.067787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.067814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.067905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.068006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.068032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.068142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.068267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.068293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.068400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.068503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.068528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.068618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.068741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.068766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.068890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.069021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.069047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.069215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.069373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.069417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.069525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.069623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.069650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.479 [2024-11-29 09:51:11.069776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.069865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.479 [2024-11-29 09:51:11.069890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.479 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.070014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.070131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.070157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.070253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.070376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.070417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.070547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.070666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.070691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.070816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.070939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.070964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.071058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.071173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.071200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.071324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.071439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.071466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.071567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.071669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.071694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.071861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.072087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.072116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.072243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.072369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.072412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.072541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.072637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.072664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.072789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.072935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.072961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.073087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.073293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.073321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.073479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.073577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.073603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.073709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.073804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.073831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.073922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.074066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.074092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.074244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.074336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.074363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.074501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.074622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.074647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.074756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.074883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.074908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.075064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.075183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.075209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.075336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.075448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.075475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.075569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.075660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.075687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.075779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.075904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.075930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.076027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.076152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.076177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.076278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.076405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.076431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.076556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.076650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.076675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.480 qpair failed and we were unable to recover it. 00:27:48.480 [2024-11-29 09:51:11.076792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.480 [2024-11-29 09:51:11.076880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.076905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.076992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.077112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.077138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.077261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.077385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.077418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.077546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.077671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.077704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.077823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.078013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.078039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.078190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.078278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.078303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.078438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.078536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.078561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.078657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.078766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.078793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.078919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.079041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.079067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.079191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.079311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.079336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.079470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.079594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.079619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.079748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.079831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.079856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.079974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.080066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.080091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.080214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.080299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.080325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.080480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.080578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.080605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.080705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.080834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.080859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.080988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.081101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.081126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.081247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.081401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.081426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.081526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.081622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.081648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.081775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.081925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.081950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.082048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.082196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.082221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.082316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.082421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.082446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.082538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.082664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.082689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.082811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.082934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.082960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.083109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 EAL: No free 2048 kB hugepages reported on node 1 00:27:48.481 [2024-11-29 09:51:11.083230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.083255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.083345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.083456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.083481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.083583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.083669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.083698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.083821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.083938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.083962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.084086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.084207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.481 [2024-11-29 09:51:11.084231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.481 qpair failed and we were unable to recover it. 00:27:48.481 [2024-11-29 09:51:11.084407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.084521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.084545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.084638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.084735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.084760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.084859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.084977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.085002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.085153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.085283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.085309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.085444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.085540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.085566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.085663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.085784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.085809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.085908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.085998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.086023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.086144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.086238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.086264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.086399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.086497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.086523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.086625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.086731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.086756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.086879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.086995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.087021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.087146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.087244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.087270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.087397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.087513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.087539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.087636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.087742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.087768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.087874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.087965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.087992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.088092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.088190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.088215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.088328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.088487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.088513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.088644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.088776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.088801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.088902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.089001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.089025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.089153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.089309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.089334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.089473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.089621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.089647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.089744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.089864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.089889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.090042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.090160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.090186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.090286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.090420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.090451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.090579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.090728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.090752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.090889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.091011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.091035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.091126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.091255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.091279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.091368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.091466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.091492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.482 [2024-11-29 09:51:11.091589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.091713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.482 [2024-11-29 09:51:11.091738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.482 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.091862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.091956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.091980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.092095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.092182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.092210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.092343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.092456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.092482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.092575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.092692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.092718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.092842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.092929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.092963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.093059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.093153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.093178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.093271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.093363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.093387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.093485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.093634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.093659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.093758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.093908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.093933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.094056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.094148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.094173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.094274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.094433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.094459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.094566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.094683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.094710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.094803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.094924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.094949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.095048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.095169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.095194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.095297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.095430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.095460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.095582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.095709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.095734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.095841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.095940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.095966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.096112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.096229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.096254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.096424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.096552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.096577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.096668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.096811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.096835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.096966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.097063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.097087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.097172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.097268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.097295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.097409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.097495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.097521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.097644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.097791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.097817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.097916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.098064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.098095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.098220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.098314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.098340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.098458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.098552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.098577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.098724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.098841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.098866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.483 qpair failed and we were unable to recover it. 00:27:48.483 [2024-11-29 09:51:11.098990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.099105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.483 [2024-11-29 09:51:11.099129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.099260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.099353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.099377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.099491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.099611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.099635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.099791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.099887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.099911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.100016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.100104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.100128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.100229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.100376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.100407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.100502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.100626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.100652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.100763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.100891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.100916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.101037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.101142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.101167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.101261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.101377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.101429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.101530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.101653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.101679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.101802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.101901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.101927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.102020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.102115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.102140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.102241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.102358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.102383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.102545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.102662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.102687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.102810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.102927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.102953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.103090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.103239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.103265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.103401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.103522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.103546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.103666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.103783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.103808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.103918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.104035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.104060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.104151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.104299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.104324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.104435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.104560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.104584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.104726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.104844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.104868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.104956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.105072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.105096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.105196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.105312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.105337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.484 [2024-11-29 09:51:11.105436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.105619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.484 [2024-11-29 09:51:11.105644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.484 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.105743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.105839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.105865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.105972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.106097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.106122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.106249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.106346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.106371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.106475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.106621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.106647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.106767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.106867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.106892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.107040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.107127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.107152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.107304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.107405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.107431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.107532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.107649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.107674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.107771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.107892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.107916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.108019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.108138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.108162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.108284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.108367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.108391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.108508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.108653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.108677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.108799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.108919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.108943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.109045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.109167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.109192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.109348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.109469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.109495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.109584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.109704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.109730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.109835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.109932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.109957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.110056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.110203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.110228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.110327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.110455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.110482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.110629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.110719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.110744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.110896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.111016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.111041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.111147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.111264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.111289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.111383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.111474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.111499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.111629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.111745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.111771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.111859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.111947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.111971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.112060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.112180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.112207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.112361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.112494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.112520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.112609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.112728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.112753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.485 qpair failed and we were unable to recover it. 00:27:48.485 [2024-11-29 09:51:11.112842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.485 [2024-11-29 09:51:11.112994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.113020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.113147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.113270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.113295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.113439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.113582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.113608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.113739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.113837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.113861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.113958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.114084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.114108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.114196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.114315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.114342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.114463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.114587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.114612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.114768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.114889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.114915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.115015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.115135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.115160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.115283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.115436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.115461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.115553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.115671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.115696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.115821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.115943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.115967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.116085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.116184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.116209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.116379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.116500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.116525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.116648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.116760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.116785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.116980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.117105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.117130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.117250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.117372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.117416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.117506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.117546] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:48.486 [2024-11-29 09:51:11.117624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.117648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.117740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.117839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.117863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.118014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.118145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.118169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.118314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.118427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.118453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.118549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.118677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.118702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.118827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.118953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.118977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.119104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.119227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.119252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.119342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.119468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.119493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.119650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.119782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.119806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.119910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.120031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.120055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.120177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.120272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.120297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.120402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.120525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.486 [2024-11-29 09:51:11.120549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.486 qpair failed and we were unable to recover it. 00:27:48.486 [2024-11-29 09:51:11.120652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.120769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.120793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.120908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.120997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.121021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.121171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.121252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.121278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.121430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.121549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.121573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.121667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.121763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.121787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.121912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.122030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.122054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.122202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.122344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.122369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.122504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.122632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.122657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.122777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.122882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.122906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.123029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.123177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.123203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.123303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.123399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.123425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.123575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.123667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.123692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.123814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.123905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.123929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.124018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.124097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.124122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.124272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.124443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.124474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.124608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.124733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.124760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.124861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.124983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.125009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.125145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.125270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.125295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.125424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.125553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.125579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.125733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.125854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.125880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.125979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.126099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.126125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.126278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.126423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.126453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.126584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.126675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.126701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.126796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.126939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.126965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.127112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.127241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.127268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.127376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.127506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.127532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.127629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.127734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.127759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.127900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.128061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.128087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.487 qpair failed and we were unable to recover it. 00:27:48.487 [2024-11-29 09:51:11.128251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.128370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.487 [2024-11-29 09:51:11.128403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.128512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.128608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.128635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.128768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.128883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.128908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.129033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.129186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.129212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.129339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.129550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.129579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.129727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.129876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.129902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.130045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.130156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.130182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.130305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.130458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.130484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.130584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.130715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.130740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.130870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.131071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.131097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.131201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.131330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.131355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.131490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.131584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.131611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.131844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.131951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.131977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.132127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.132249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.132275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.132408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.132507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.132533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.132631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.132780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.132806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.132930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.133081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.133107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.133201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.133316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.133341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.133451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.133577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.133603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.133704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.133805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.133832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.133957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.134079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.134104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.134198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.134320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.134345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.134471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.134561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.134586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.134734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.134827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.134853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.134955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.135077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.135103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.135226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.135324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.135350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.135474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.135572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.135598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.135725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.135811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.135836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.135944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.136035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.136060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.488 qpair failed and we were unable to recover it. 00:27:48.488 [2024-11-29 09:51:11.136162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.488 [2024-11-29 09:51:11.136255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.136281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.136403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.136495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.136520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.136648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.136767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.136793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.136890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.136982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.137008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.137131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.137252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.137277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.137371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.137539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.137565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.137659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.137755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.137780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.137906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.138000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.138030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.138157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.138279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.138305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.138406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.138556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.138581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.138710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.138810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.138835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.138962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.139085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.139111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.139206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.139326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.139351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.139480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.139605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.139631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.139730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.139827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.139853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.140024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.140143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.140168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.140272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.140365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.140391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.140497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.140599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.140628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.140731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.140850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.140877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.140996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.141118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.141143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.141240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.141334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.141361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.141502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.141625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.141650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.141777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.141879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.141905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.142032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.142152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.142177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.142269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.142364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.142388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.142548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.142647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.489 [2024-11-29 09:51:11.142672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.489 qpair failed and we were unable to recover it. 00:27:48.489 [2024-11-29 09:51:11.142770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.142879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.142905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.143030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.143150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.143180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.143298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.143388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.143422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.143554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.143677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.143704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.143825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.143931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.143956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.144046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.144193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.144218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.144337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.144427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.144453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.144558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.144647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.144672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.144758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.144852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.144877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.144973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.145063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.145087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.145176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.145331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.145357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.145491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.145636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.145666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.145795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.145891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.145918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.146013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.146144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.146170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.146265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.146363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.146388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.146521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.146611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.146637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.146785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.146906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.146932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.147079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.147166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.147191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.147289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.147380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.147412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.147534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.147632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.147657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.147749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.147841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.147865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.147987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.148112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.148137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.148265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.148366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.148391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.148522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.148618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.148643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.148766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.148869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.148894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.148994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.149108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.149133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.149253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.149368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.149408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.149519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.149650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.149675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.490 [2024-11-29 09:51:11.149779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.149868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.490 [2024-11-29 09:51:11.149893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.490 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.149991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.150089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.150115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.150219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.150320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.150344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.150466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.150593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.150618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.150749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.150874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.150899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.151032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.151132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.151157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.151251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.151370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.151400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.151521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.151646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.151672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.151793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.151911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.151937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.152094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.152241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.152267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.152403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.152501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.152528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.152632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.152749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.152774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.152870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.152983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.153008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.153104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.153220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.153245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.153342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.153487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.153514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.153631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.153721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.153748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.153839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.153970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.153995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.154120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.154248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.154273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.154400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.154519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.154545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.154705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.154824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.154849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.154971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.155058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.155084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.155209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.155357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.155382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.155481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.155599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.155624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.155721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.155844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.155869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.155995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.156145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.156171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.156264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.156398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.156426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.156521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.156645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.156670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.156797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.156916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.156941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.157091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.157212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.157238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.491 qpair failed and we were unable to recover it. 00:27:48.491 [2024-11-29 09:51:11.157367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.491 [2024-11-29 09:51:11.157492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.157518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.157637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.157756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.157782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.157910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.158009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.158034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.158165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.158284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.158311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.158437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.158535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.158561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.158712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.158808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.158834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.158937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.159062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.159088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.159181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.159309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.159335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.159436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.159561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.159586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.159681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.159829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.159855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.159958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.160082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.160107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.160257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.160355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.160382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.160487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.160582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.160608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.160705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.160850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.160876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.160977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.161078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.161103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.161209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.161309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.161333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.161429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.161527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.161552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.161676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.161797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.161823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.161951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.162073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.162098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.162186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.162282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.162308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.162434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.162528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.162553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.162655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.162801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.162826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.162919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.163013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.163038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.163128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.163247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.163271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.163356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.163457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.163483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.163588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.163689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.163717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.163823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.163915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.163941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.164041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.164137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.164163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.164251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.164404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.164430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.492 qpair failed and we were unable to recover it. 00:27:48.492 [2024-11-29 09:51:11.164527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.492 [2024-11-29 09:51:11.164629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.164654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.164775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.164867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.164892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.164977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.165096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.165124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.165252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.165345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.165370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.165530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.165625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.165651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.165746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.165828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.165854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.165946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.166044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.166070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.166169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.166316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.166342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.166484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.166585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.166610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.166709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.166832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.166857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.166982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.167075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.167102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.167222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.167314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.167340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.167462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.167560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.167585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.167712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.167807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.167832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.167955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.168075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.168101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.168193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.168286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.168311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.168441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.168537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.168572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.168702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.168799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.168824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.168949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.169077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.169102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.169219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.169304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.169330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.169459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.169564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.169590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.169687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.169778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.169804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.169928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.170070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.170096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.170217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.170306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.170332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.170454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.170574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.170600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.493 [2024-11-29 09:51:11.170698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.170817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.493 [2024-11-29 09:51:11.170843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.493 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.170967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.171086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.171115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.171214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.171309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.171334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.171427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.171530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.171554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.171682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.171776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.171801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.171928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.172018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.172042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.172171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.172262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.172286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.172380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.172485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.172510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.172614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.172704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.172728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.172844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.172974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.172999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.173100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.173187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.173212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.173338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.173435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.173460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.173557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.173678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.173704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.173830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.173929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.173954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.174077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.174206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.174232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.174350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.174440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.174465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.174565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.174685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.174710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.174834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.174984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.175009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.175102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.175218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.175243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.175334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.175455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.175481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.175615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.175742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.175767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.175917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.176007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.176033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.176157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.176241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.176266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.176358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.176483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.176509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.176596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.176712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.176737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.176882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.177002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.177027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.177152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.177274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.177298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.177390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.177493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.177519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.177635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.177779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.177803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.494 qpair failed and we were unable to recover it. 00:27:48.494 [2024-11-29 09:51:11.177894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.177989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.494 [2024-11-29 09:51:11.178013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.178163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.178281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.178306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.178440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.178536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.178560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.178697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.178793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.178818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.178943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.179090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.179114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.179281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.179377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.179408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.179535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.179628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.179652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.179747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.179859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.179884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.179990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.180116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.180141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.180268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.180366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.180391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.180498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.180591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.180615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.180712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.180811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.180836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.180937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.181052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.181076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.181177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.181291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.181317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.181421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.181546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.181572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.181662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.181795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.181820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.181940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.182060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.182085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.182188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.182286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.182311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.182436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.182557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.182583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.182706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.182800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.182824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.182945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.183092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.183117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.183210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.183306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.183331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.183433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.183549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.183575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.183682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.183796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.183825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.183927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.184045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.184070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.184193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.184311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.184335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.184465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.184567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.184592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.184712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.184819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.184843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.184941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.185066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.185091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.495 [2024-11-29 09:51:11.185219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.185316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.495 [2024-11-29 09:51:11.185342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.495 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.185451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.185591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.185616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.185724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.185820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.185845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.186005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.186104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.186129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.186253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.186404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.186429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.186584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.186675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.186699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.186828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.186920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.186945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.187029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.187186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.187211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.187312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.187435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.187461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.187611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.187703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.187728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.187850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.187946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.187971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.188195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.188286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.188310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.188434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.188581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.188606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.188704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.188832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.188857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.188955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.189047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.189072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.189184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.189306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.189330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.189438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.189540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.189565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.189694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.189818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.189843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.189935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.190055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.190081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.190210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.190299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.190325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.190453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.190551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.190577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.190670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.190788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.190813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.190927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.191023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.191047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.191145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.191266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.191290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.191388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.191524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.191549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.191673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.191811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.191840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.191969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.192121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.192148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.192239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.192387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.192421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.192522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.192615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.192641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.496 [2024-11-29 09:51:11.192765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.192856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.496 [2024-11-29 09:51:11.192884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.496 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.192993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.193090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.193117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.193250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.193377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.193409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.193506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.193588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.193613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.193728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.193829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.193855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.193948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.194081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.194107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.194200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.194302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.194326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.194429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.194521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.194547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.194649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.194767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.194792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.194891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.194977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.195002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.195104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.195223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.195248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.195371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.195464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.195490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.195634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.195760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.195785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.195909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.196002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.196028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.196129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.196253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.196278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.196403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.196493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.196517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.196622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.196721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.196749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.196855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.196947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.196972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.197073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.197169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.197195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.197291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.197426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.197453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.197550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.197647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.197673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.197768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.197891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.197916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.198066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.198164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.198191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.198286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.198431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.198457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.198555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.198640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.198666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.198757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.198846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.198870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.199019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.199122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.199152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.199303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.199402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.199428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.199550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.199638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.199663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.497 [2024-11-29 09:51:11.199770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.199858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.497 [2024-11-29 09:51:11.199884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.497 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.200007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.200096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.200120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.200238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.200388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.200421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.200514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.200611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.200636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.200734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.200827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.200852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.200982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.201071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.201096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.201214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.201334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.201359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.201456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.201603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.201628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.201740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.201838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.201863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.201958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.202065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.202091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.202185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.202337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.202363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.202531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.202627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.202652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.202744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.202896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.202921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.203018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.203141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.203165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.203262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.203349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.203374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.203483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.203602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.203627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.203735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.203847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.203873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.203997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.204088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.204113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.204215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.204317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.204342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.204494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.204586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.204612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.204709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.204831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.204856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.204978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.205063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.205088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.205184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.205329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.205354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.205454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.205545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.205569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.205669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.205792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.205817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.498 qpair failed and we were unable to recover it. 00:27:48.498 [2024-11-29 09:51:11.205916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.205996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.498 [2024-11-29 09:51:11.206022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.206146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.206264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.206290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.206405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.206529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.206555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.206688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.206802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.206828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.206957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.207081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.207107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.207207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.207328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.207354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.207453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.207550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.207576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.207701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.207794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.207819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.207937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.208054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.208079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.208187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.208333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.208357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.208501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.208605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.208631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.208758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.208879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.208903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.208994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.209120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.209145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.209268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.209399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.209425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.209525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.209617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.209642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.209737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.209860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.209885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.209975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.210097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.210122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.210243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.210335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.210360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.210466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.210560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.210585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.210673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.210819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.210843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.210938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.211038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.211063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.211182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.211283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.211309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.211416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.211543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.211568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.211666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.211763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.211792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.211916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.212033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.212058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.212156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.212250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.212275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.212400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.212491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.212516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.212639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.212771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.212796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.212912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.212993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.213019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.499 qpair failed and we were unable to recover it. 00:27:48.499 [2024-11-29 09:51:11.213145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.213261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.499 [2024-11-29 09:51:11.213287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.213407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.213527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.213554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.213677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.213769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.213793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.213913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.214040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.214066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.214194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.214292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.214316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.214432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.214531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.214556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.214681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.214810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.214835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.214957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.215060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.215085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.215211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.215332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.215356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.215484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.215613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.215638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.215770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.215866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.215892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.216017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.216140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.216165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.216286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.216372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.216403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.216529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.216654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.216679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.216836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.216953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.216978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.217074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.217169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.217193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.217307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.217407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.217434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.217557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.217658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.217684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.217806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.217903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.217929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.218054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.218171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.218196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.218317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.218437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.218463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.218568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.218693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.218717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.218805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.218923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.218949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.219044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.219197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.219222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.219342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.219484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.219509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.219611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.219734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.219760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.219860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.219951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.219977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.220078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.220172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.220198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.220318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.220422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.220448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.500 [2024-11-29 09:51:11.220551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.220669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.500 [2024-11-29 09:51:11.220693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.500 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.220789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.220905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.220931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.221049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.221138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.221163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.221257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.221405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.221431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.221553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.221677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.221702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.221807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.221903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.221928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.222080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.222185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.222210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.222324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.222451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.222476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.222568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.222684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.222708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.222826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.222927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.222951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.223070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.223216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.223241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.223333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.223435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.223461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.223580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.223674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.223699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.223845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.223964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.223990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.224119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.224240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.224265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.224388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.224525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.224551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.224676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.224776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.224807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.224905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.225029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.225053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.225176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.225303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.225327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.225429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.225527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.225551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.225654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.225752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.225777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.225873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.226002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.226028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.226126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.226243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.226268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.226418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.226512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.226537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.226631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.226727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.226752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.226852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.226964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.226990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.227136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.227281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.227306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.227413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.227505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.227529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.227625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.227752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.227777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.501 [2024-11-29 09:51:11.227881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.228007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.501 [2024-11-29 09:51:11.228032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.501 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.228154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.228302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.228327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.228481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.228608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.228633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.228793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.228922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.228946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.229042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.229138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.229163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.229258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.229340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.229365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.229487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.229618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.229643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.229768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.229854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.229879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.229980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.230068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.230093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.230102] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:48.502 [2024-11-29 09:51:11.230187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.230226] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:48.502 [2024-11-29 09:51:11.230245] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:48.502 [2024-11-29 09:51:11.230258] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:48.502 [2024-11-29 09:51:11.230275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.230299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.230413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.230539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.230501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:48.502 [2024-11-29 09:51:11.230566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.230535] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:48.502 [2024-11-29 09:51:11.230667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.230588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:48.502 [2024-11-29 09:51:11.230591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:48.502 [2024-11-29 09:51:11.230764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.230788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.230888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.230980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.231005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.231142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.231274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.231299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.231409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.231512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.231537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.231661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.231762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.231787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.231889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.231982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.232006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.232104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.232228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.232252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.232342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.232443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.232468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.232562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.232680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.232706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.232831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.232922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.232947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.233032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.233127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.233152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.233263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.233375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.233405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.233502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.233616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.233642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.502 qpair failed and we were unable to recover it. 00:27:48.502 [2024-11-29 09:51:11.233755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.502 [2024-11-29 09:51:11.233862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.233888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.233987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.234085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.234112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.234216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.234307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.234332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.234432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.234557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.234581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.234679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.234771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.234796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.234890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.235010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.235034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.235159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.235277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.235302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.235400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.235498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.235524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.235619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.235740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.235764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.235859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.235976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.236000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.236089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.236180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.236205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.236295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.236378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.236407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.236504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.236593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.236618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.236733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.236851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.236875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.236999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.237117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.237142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.237263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.237354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.237386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.237486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.237610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.237634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.237739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.237826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.237851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.237954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.238053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.238078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.238176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.238289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.238314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.238424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.238551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.238576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.238662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.238746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.238772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.238863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.238988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.239017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.239152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.239278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.239304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.239409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.239545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.239570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.239669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.239772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.239802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.239925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.240042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.240067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.240158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.240239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.240264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.240351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.240452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.503 [2024-11-29 09:51:11.240478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.503 qpair failed and we were unable to recover it. 00:27:48.503 [2024-11-29 09:51:11.240576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.240663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.240688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.240809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.240893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.240918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.241008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.241100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.241125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.241237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.241330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.241355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.241513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.241594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.241619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.241711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.241804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.241829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.241927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.242022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.242049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.242146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.242263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.242288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.242408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.242494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.242519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.242618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.242709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.242733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.242824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.242917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.242943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.243076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.243164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.243189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.243334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.243434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.243459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.243554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.243655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.243680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.243783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.243907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.243932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.244025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.244141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.244166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.244274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.244368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.244398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.244497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.244615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.244640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.244751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.244841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.244866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.244977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.245073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.245098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.245226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.245313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.245339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.245430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.245542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.245566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.245661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.245756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.245781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.245871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.245968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.245993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.246089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.246179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.246204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.246299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.246423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.246450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.246543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.246659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.246684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.246786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.246878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.246904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.246998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.247108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.504 [2024-11-29 09:51:11.247133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.504 qpair failed and we were unable to recover it. 00:27:48.504 [2024-11-29 09:51:11.247253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.247349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.247374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.247482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.247577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.247602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.247704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.247830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.247855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.247952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.248075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.248099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.248188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.248276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.248301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.248408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.248504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.248530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.248628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.248713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.248738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.248837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.248929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.248955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.249046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.249130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.249154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.249269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.249391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.249421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.249526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.249619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.249643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.249738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.249884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.249909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.249997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.250088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.250113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.250200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.250292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.250317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.250414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.250505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.250530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.250630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.250728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.250757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.250844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.250944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.250969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.251087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.251170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.251195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.251295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.251389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.251418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.251519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.251638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.251662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.251753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.251841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.251866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.251966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.252062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.252087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.252178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.252334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.252358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.252472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.252564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.252589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.252681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.252775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.252800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.252922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.253041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.253071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.253169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.253268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.253293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.253402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.253491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.253516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.253613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.253705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.253729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.505 qpair failed and we were unable to recover it. 00:27:48.505 [2024-11-29 09:51:11.253816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.505 [2024-11-29 09:51:11.253912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.253936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.254047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.254140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.254165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.254292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.254399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.254424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.254533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.254627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.254651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.254740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.254828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.254852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.254955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.255069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.255095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.255196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.255344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.255369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.255477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.255572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.255597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.255696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.255780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.255805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.255902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.255995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.256019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.256146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.256268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.256292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.256388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.256526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.256553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.256665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.256752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.256777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.256904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.257026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.257051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.257149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.257315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.257339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.257464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.257564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.257589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.257711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.257800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.257824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.257925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.258013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.258038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.258192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.258283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.258308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.258402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.258493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.258518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.258608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.258696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.258720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.258823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.258930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.258955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.259046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.259140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.259165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.259264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.259360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.259385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.259483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.259584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.259608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.259709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.259833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.259859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.259962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.260043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.260068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.260183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.260277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.260302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.260402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.260494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.260520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.506 qpair failed and we were unable to recover it. 00:27:48.506 [2024-11-29 09:51:11.260629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.506 [2024-11-29 09:51:11.260746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.260771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.260907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.260999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.261023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.261145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.261231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.261256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.261345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.261451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.261476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.261595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.261679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.261704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.261801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.261919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.261944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.262038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.262153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.262179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.262273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.262388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.262420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.262515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.262608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.262635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.262727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.262811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.262836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.262929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.263011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.263035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.263184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.263277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.263301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.263383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.263510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.263535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.263642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.263739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.263765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.263891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.263977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.264002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.264090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.264200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.264225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.264315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.264408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.264434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.264522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.264616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.264641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.264730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.264841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.264871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.264991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.265089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.265113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.265226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.265325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.265349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.265453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.265546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.265571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.265691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.265785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.265811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.265930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.266017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.266042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.266170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.266268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.266292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.507 [2024-11-29 09:51:11.266386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.266576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.507 [2024-11-29 09:51:11.266601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.507 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.266725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.266818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.266843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.266931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.267018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.267043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.267169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.267284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.267309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.267420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.267512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.267537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.267636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.267753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.267777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.267864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.267954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.267978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.268078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.268207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.268231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.268352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.268444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.268469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.268557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.268667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.268692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.268805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.268926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.268959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.269060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.269175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.269200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.269326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.269425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.269450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.269570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.269666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.269691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.269794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.269921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.269946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.270039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.270156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.270180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.270283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.270371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.270402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.270501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.270639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.270664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.270764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.270855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.270880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.270969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.271069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.271095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.271198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.271293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.271318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.271417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.271518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.271545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.271636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.271724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.271749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.271839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.271935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.271960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.272062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.272181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.272207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.272301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.272425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.272451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.272581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.272668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.272693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.272788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.272900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.272926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.273024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.273120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.273144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.508 [2024-11-29 09:51:11.273245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.273356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.508 [2024-11-29 09:51:11.273380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.508 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.273481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.273579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.273604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.273705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.273850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.273874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.273994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.274112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.274137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.274263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.274362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.274387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.274483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.274570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.274595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.274696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.274792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.274817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.274920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.275010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.275036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.275137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.275234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.275258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.275377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.275503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.275529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.275624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.275726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.275751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.275878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.275966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.275990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.276087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.276204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.276229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.276320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.276418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.276444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.276543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.276662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.276687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.276788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.276877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.276907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.277003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.277099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.277125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.277219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.277305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.277330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.277426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.277524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.277548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.277669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.277753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.277779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.277883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.277973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.277998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.278108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.278201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.278226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.278318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.278443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.278470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.278581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.278689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.278715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.278829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.278917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.278943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.279067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.279155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.279179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.279273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.279396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.279421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.279522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.279604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.279629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.279724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.279855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.279880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.279977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.280094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.509 [2024-11-29 09:51:11.280118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.509 qpair failed and we were unable to recover it. 00:27:48.509 [2024-11-29 09:51:11.280214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.280314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.280338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.280478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.280571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.280596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.280699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.280828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.280853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.280956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.281052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.281077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.281172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.281295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.281320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.281471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.281559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.281584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.281694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.281789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.281814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.281915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.282007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.282032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.282122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.282213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.282238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.282364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.282482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.282508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.282608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.282701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.282727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.282825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.282953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.282979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.283073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.283157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.283181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.283280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.283408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.283434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.283563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.283650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.283675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.283774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.283890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.283915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 A controller has encountered a failure and is being reset. 00:27:48.510 [2024-11-29 09:51:11.284053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.284181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.510 [2024-11-29 09:51:11.284230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.510 qpair failed and we were unable to recover it. 00:27:48.510 [2024-11-29 09:51:11.284376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.284499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.284530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.795 qpair failed and we were unable to recover it. 00:27:48.795 [2024-11-29 09:51:11.284635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.284737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.284765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.795 qpair failed and we were unable to recover it. 00:27:48.795 [2024-11-29 09:51:11.284887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.285065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.285091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.795 qpair failed and we were unable to recover it. 00:27:48.795 [2024-11-29 09:51:11.285199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.285325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.285351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.795 qpair failed and we were unable to recover it. 00:27:48.795 [2024-11-29 09:51:11.285521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.285622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.285648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.795 qpair failed and we were unable to recover it. 00:27:48.795 [2024-11-29 09:51:11.285745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.285836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.285863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.795 qpair failed and we were unable to recover it. 00:27:48.795 [2024-11-29 09:51:11.285959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.286047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.286073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.795 qpair failed and we were unable to recover it. 00:27:48.795 [2024-11-29 09:51:11.286168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.795 [2024-11-29 09:51:11.286269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.286295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.286387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.286541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.286567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.286673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.286769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.286795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.286891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.286985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.287012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.287106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.287207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.287233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.287353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.287450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.287477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.287615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.287699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.287724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.287848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.287986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.288014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.288141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.288237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.288264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.288363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.288471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.288498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.288596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.288715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.288741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.288843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.288945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.288971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.289077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.289179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.289205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.289301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.289403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.289430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.289532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.289626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.289653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.289836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.289957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.289984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.290076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.290167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.290191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.290316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.290418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.290445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.290542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.290664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.290690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.290806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.290896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.290920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.291071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.291162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.291188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.291314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.291407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.291433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.291576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.291690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.291723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.291825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.291914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.291939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.292033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.292124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.292149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.292255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.292346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.292371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.292482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.292578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.292604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.292717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.292809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.292835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.292925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.293047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.293072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.796 qpair failed and we were unable to recover it. 00:27:48.796 [2024-11-29 09:51:11.293174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.796 [2024-11-29 09:51:11.293297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.293323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.293422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.293629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.293656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.293771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.293887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.293913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.294005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.294098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.294123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.294223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.294339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.294364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.294507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.294600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.294625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.294726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.294816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.294842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.294930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.295050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.295077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.295177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.295304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.295329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.295418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.295538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.295563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.295665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.295794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.295819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.295915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.296004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.296029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.296156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.296246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.296273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.296390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.296527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.296553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.296655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.296788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.296814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.296937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.297027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.297052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.297150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.297273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.297300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.297397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.297505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.297530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.297618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.297741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.297765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.297895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.297981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.298006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.298102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.298194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.298219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.298340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.298431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.298456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.298540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.298636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.298661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.298793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.298917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.298943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.299031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.299159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.299184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.299316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.299424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.299451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.299567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.299692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.299725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.299821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.299916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.299943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.797 [2024-11-29 09:51:11.300046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.300143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.797 [2024-11-29 09:51:11.300168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.797 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.300271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.300397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.300424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.300516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.300605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.300630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.300751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.300867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.300892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.301022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.301118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.301145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.301274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.301415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.301442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.301542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.301634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.301661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.301760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.301860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.301885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.301986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.302087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.302112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.302203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.302327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.302353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.302474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.302566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.302591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.302704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.302831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.302856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.302952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.303045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.303070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.303167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.303284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.303309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.303406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.303511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.303536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.303663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.303760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.303791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.303901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.303993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.304018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.304140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.304341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.304367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.304483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.304568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.304594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.304685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.304771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.304796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.304918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.304999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.305024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.305140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.305257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.305282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.305383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.305493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.305518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.305609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.305710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.305735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.305827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.305975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.305999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.306120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.306212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.306249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.306372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.306483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.306509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.306603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.306688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.306713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.306812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.306901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.306927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.798 qpair failed and we were unable to recover it. 00:27:48.798 [2024-11-29 09:51:11.307023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.798 [2024-11-29 09:51:11.307114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.307140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.307233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.307354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.307380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.307501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.307593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.307618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.307711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.307832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.307857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.307970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.308065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.308092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.308195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.308291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.308317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.308418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.308523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.308554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.308649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.308769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.308795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.308890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.309013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.309038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.309129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.309218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.309244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.309362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.309539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.309566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.309670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.309770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.309798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.309892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.309987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.310011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.310106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.310207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.310232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.310354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.310487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.310513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.310635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.310732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.310757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.310847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.310934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.310964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.311086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.311177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.311201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.311286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.311405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.311432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.311554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.311647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.311672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.311792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.311881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.311907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.311992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.312078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.312103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.312254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.312354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.312379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.312495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.312585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.312611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.312740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.312859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.312884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.312986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.313080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.313104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.313204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.313289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.313315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.313413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.313506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.313531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.313629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.313715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.313740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.799 qpair failed and we were unable to recover it. 00:27:48.799 [2024-11-29 09:51:11.313837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.799 [2024-11-29 09:51:11.313935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.313962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.314059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.314177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.314203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.314327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.314444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.314470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.314575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.314673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.314699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.314817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.314944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.314969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.315064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.315152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.315178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.315280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.315432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.315459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.315557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.315649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.315674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.315809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.315957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.315983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.316104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.316199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.316224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.316315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.316428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.316453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.316547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.316662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.316687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.316836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.316961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.316985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.317075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.317223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.317248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.317345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.317442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.317468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.317564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.317686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.317711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.317840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.317937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.317964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.318088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.318200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.318225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.318385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.318492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.318517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.318616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.318741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.318766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.318856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.318958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.318984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.319113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.319205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.319231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.319366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.319466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.319492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.800 qpair failed and we were unable to recover it. 00:27:48.800 [2024-11-29 09:51:11.319581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.800 [2024-11-29 09:51:11.319670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.319695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.319817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.319910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.319935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.320038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.320155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.320180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.320277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.320362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.320387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.320492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.320581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.320606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.320725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.320818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.320843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.320937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.321059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.321084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.321203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.321304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.321331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.321427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.321522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.321547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.321656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.321773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.321798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.321890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.321976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.322001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.322093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.322194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.322221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.322340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.322443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.322470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.322577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.322664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.322689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.322788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.322887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.322912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.323038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.323163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.323189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.323312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.323413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.323439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.323558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.323677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.323702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.323795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.323893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.323917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.324019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.324120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.324145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.324253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.324347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.324372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.324480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.324573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.324598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.324725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.324850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.324875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.324972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.325067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.325092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.325219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.325315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.325339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.325473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.325566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.325592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.325689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.325813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.325839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.325966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.326083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.326109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.326236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.326356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.801 [2024-11-29 09:51:11.326383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.801 qpair failed and we were unable to recover it. 00:27:48.801 [2024-11-29 09:51:11.326483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.326604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.326630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.326717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.326846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.326871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.326992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.327080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.327107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.327252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.327338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.327365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.327508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.327605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.327631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.327734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.327857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.327884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.327999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.328144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.328169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.328285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.328374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.328407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.328501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.328587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.328612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.328708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.328830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.328856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.329010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.329099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.329123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.329224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.329375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.329407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.329504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.329623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.329649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.329742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.329864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.329889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.330038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.330159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.330184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.330278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.330370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.330403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.330503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.330605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.330631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.330762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.330854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.330878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.330978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.331069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.331096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.331189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.331305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.331331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.331470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.331588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.331613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.331734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.331824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.331850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.331953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.332039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.332064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.332178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.332293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.332318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.332412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.332535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.332562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.332691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.332820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.332845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.332994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.333148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.333173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.333273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.333389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.333419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.333520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.333603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.802 [2024-11-29 09:51:11.333628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.802 qpair failed and we were unable to recover it. 00:27:48.802 [2024-11-29 09:51:11.333754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.333847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.333872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.333985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.334096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.334121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.334242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.334357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.334382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.334532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.334621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.334647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.334737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.334853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.334878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.335006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.335137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.335164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.335284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.335375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.335409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.335505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.335605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.335631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.335731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.335829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.335855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.335949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.336065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.336090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.336219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.336313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.336338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.336477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.336577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.336603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.336724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.336847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.336872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.336989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.337106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.337134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.337234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.337329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.337353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.337449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.337540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.337566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.337656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.337805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.337830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.337928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.338053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.338080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.338174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.338292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.338318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.338436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.338526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.338551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.338651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.338740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.338765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.338889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.339040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.339065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.339235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.339342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.339367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.339511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.339667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.339692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.339789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.339874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.339899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.340003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.340125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.340152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.340276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.340426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.340452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.340578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.340670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.340695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.803 qpair failed and we were unable to recover it. 00:27:48.803 [2024-11-29 09:51:11.340794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.803 [2024-11-29 09:51:11.340912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.340937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.341084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.341178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.341206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.341329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.341443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.341469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.341575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.341667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.341693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.341816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.341913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.341940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.342065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.342184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.342209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.342302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.342397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.342423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.342545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.342637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.342663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.342762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.342854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.342879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.342976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.343069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.343102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.343226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.343315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.343340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.343425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.343518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.343543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.343638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.343758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.343784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.343880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.343969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.343995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.344093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.344214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.344239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.344325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.344418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.344444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.344543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.344631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.344657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.344784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.344880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.344906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.345033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.345132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.345158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.345277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.345366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.345401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.345501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.345587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.345612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.345723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.345840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.345866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.345961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.346090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.346116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.346207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.346299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.346326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.346421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.346526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.804 [2024-11-29 09:51:11.346551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.804 qpair failed and we were unable to recover it. 00:27:48.804 [2024-11-29 09:51:11.346655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.346748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.346774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.346905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.346995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.347022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.347147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.347242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.347268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.347366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.347497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.347524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.347622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.347739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.347769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.347866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.347964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.347989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.348081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.348210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.348235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.348328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.348424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.348451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.348554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.348649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.348676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.348763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.348848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.348872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.348969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.349084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.349110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.349197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.349300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.349326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.349457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.349581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.349607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.349698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.349798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.349824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.349912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.350001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.350031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.350150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.350240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.350266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.350366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.350463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.350489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.350591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.350714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.350739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.350863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.350954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.350979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.351074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.351191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.351216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.351314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.351412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.351439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.351534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.351649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.351674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.351801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.351901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.351927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.352027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.352149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.352175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.352270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.352387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.352430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.352533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.352653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.352680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.352772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.352888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.352914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.352999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.353093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.353120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.805 [2024-11-29 09:51:11.353247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.353335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.805 [2024-11-29 09:51:11.353360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.805 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.353468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.353567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.353594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.353710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.353812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.353838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.353960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.354081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.354107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.354233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.354339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.354364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.354465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.354582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.354608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.354727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.354847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.354874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.355002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.355089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.355115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.355208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.355296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.355321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.355453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.355546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.355572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.355660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.355747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.355773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.355870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.355994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.356019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.356112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.356256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.356281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.356402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.356495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.356521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.356614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.356732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.356758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.356882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.357006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.357033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.357126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.357240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.357265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.357418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.357533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.357559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.357688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.357811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.357836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.357930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.358024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.358050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.358153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.358273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.358299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.358389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.358485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.358509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.358627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.358716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.358741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.358837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.358931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.358958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.359065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.359157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.359181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.359305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.359404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.359430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.359525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.359643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.359669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.359826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.359918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.359943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.806 qpair failed and we were unable to recover it. 00:27:48.806 [2024-11-29 09:51:11.360034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.806 [2024-11-29 09:51:11.360151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.360177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.360300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.360390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.360423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.360523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.360618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.360645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.360743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.360835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.360860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.360957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.361074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.361099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.361215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.361309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.361334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.361434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.361531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.361557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.361676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.361763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.361787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.361874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.361993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.362018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.362117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.362205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.362230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.362345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.362466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.362492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.362589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.362684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.362710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.362803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.362892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.362919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.363010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.363098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.363123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.363216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.363342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.363368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.363468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.363567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.363593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.363693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.363841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.363867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.363961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.364109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.364135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.364227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.364316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.364342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.364474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.364565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.364592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.364689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.364778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.364804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.364891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.364979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.365005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.365123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.365222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.365249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.365340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.365431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.365458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.365553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.365666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.365692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.365780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.365901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.365927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.366022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.366136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.366162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.366265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.366356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.366382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.807 qpair failed and we were unable to recover it. 00:27:48.807 [2024-11-29 09:51:11.366481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.807 [2024-11-29 09:51:11.366595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.366620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.366736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.366847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.366875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.366975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.367074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.367099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.367221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.367310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.367335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.367437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.367556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.367581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.367675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.367797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.367823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.367951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.368071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.368096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.368195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.368284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.368310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.368403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.368494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.368519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.368645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.368737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.368765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.368857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.368944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.368970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.369066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.369156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.369182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.369277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.369368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.369411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.369503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.369599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.369624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.369712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.369861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.369887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.369988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.370120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.370146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.370274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.370400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.370427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.370526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.370617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.370643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.370728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.370812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.370837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.370923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.371019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.371046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.371179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.371271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.371296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.371391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.371494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.371518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.371619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.371739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.371764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.371852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.371947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.371972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.372069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.372152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.372178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.372300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.372382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.372415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.372505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.372591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.372616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.372701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.372819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.808 [2024-11-29 09:51:11.372844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.808 qpair failed and we were unable to recover it. 00:27:48.808 [2024-11-29 09:51:11.372929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.373049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.373073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.373171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.373301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.373327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.373451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.373549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.373575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.373699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.373820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.373845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.373941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.374055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.374081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.374174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.374289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.374315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.374413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.374506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.374532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.374629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.374722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.374748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.374870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.374990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.375016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.375110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.375201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.375227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.375315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.375433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.375460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.375550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.375644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.375669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.375766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.375849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.375874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.375965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.376062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.376088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.376186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.376273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.376299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.376388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.376516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.376544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.376635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.376729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.376756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.376876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.377014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.377040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.377159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.377249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.377274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.377402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.377492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.377518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.377647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.377736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.377761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.377864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.377958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.377983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.378076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.378194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.378220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.378315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.378428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.378459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.809 qpair failed and we were unable to recover it. 00:27:48.809 [2024-11-29 09:51:11.378552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.809 [2024-11-29 09:51:11.378674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.378701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.378787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.378880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.378905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.378999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.379114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.379140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.379237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.379385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.379418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.379519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.379605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.379631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.379748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.379836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.379862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.379991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.380080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.380106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.380229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.380312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.380338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.380440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.380525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.380550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.380641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.380762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.380797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.380896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.381024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.381050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.381148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.381234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.381260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.381390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.381494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.381520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.381612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.381732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.381757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.381852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.381942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.381968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.382060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.382145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.382171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.382269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.382398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.382424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.382521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.382644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.382669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.382793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.382914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.382940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.383062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.383181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.383212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.383312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.383411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.383438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.383536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.383632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.383657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.383758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.383848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.383874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.383995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.384090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.384115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.384239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.384357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.384383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.384510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.384605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.384632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.384726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.384842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.384868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.384996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.385081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.385107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.810 qpair failed and we were unable to recover it. 00:27:48.810 [2024-11-29 09:51:11.385201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.810 [2024-11-29 09:51:11.385293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.385318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.385440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.385538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.385569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.385665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.385782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.385807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.385901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.385998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.386024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.386194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.386281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.386306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.386400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.386499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.386524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.386617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.386739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.386765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.386854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.386947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.386974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.387067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.387153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.387179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.387277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.387397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.387423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.387518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.387614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.387640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.387728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.387816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.387842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.387943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.388056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.388081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.388177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.388264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.388289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.388377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.388478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.388505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.388629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.388747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.388772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.388896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.388990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.389016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.389108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.389230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.389255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.389371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.389476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.389503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.389594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.389710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.389736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.389824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.389945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.389970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.390091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.390215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.390240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.390362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.390492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.390518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.390608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.390700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.390726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.390828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.390943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.390968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.391090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.391205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.391229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.391323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.391451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.391478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.811 [2024-11-29 09:51:11.391569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.391666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.811 [2024-11-29 09:51:11.391690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.811 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.391792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.391902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.391928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.392079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.392201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.392228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.392349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.392445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.392471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.392618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.392705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.392730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.392836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.392930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.392955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.393048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.393169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.393194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.393321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.393417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.393444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.393536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.393652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.393678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.393769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.393887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.393913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.394004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.394099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.394126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.394215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.394311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.394337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.394461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.394556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.394582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.394708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.394832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.394858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.394978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.395065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.395090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.395196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.395287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.395312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.395412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.395537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.395562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.395657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.395746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.395771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.395860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.395951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.395975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.396095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.396186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.396213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.396312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.396429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.396456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.396556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.396683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.396709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.396836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.396925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.396951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.397070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.397164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.397190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.397315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.397436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.397462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.397571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.397687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.397713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.397815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.397909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.397934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.398025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.398140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.398165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.398254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.398337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.812 [2024-11-29 09:51:11.398362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.812 qpair failed and we were unable to recover it. 00:27:48.812 [2024-11-29 09:51:11.398495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.398614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.398638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.398736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.398826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.398851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.398955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.399056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.399080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.399168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.399265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.399291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.399391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.399493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.399519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.399638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.399731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.399756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.399854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.399943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.399968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.400093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.400175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.400200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.400329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.400424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.400449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.400540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.400636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.400661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.400751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.400835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.400860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.400962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.401111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.401136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.401233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.401320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.401345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.401469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.401566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.401591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.401686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.401806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.401831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.401951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.402044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.402070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.402179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.402287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.402315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.402455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.402550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.402576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.402679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.402764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.402789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.402915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.403005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.403030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.403128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.403216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.403241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.403362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.403497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.403523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.403619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.403717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.403744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.403837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.403957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.403983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.404083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.404206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.404231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.404317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.404436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.404463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.404584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.404692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.404720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.404827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.404913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.404938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.813 qpair failed and we were unable to recover it. 00:27:48.813 [2024-11-29 09:51:11.405033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.813 [2024-11-29 09:51:11.405123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.405149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.405311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.405438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.405464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.405585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.405685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.405711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.405833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.405930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.405956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.406083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.406203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.406227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.406318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.406435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.406462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.406580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.406700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.406725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.406820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.406909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.406934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.407034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.407128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.407153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.407256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.407357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.407383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.407486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.407579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.407604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.407702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.407819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.407845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.407973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.408065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.408089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.408185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.408284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.408309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.408431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.408525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.408551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.408671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.408765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.408790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.408914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.409033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.409059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.409152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.409237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.409262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.409363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.409460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.409490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.409586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.409680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.409704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.409806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.409930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.409957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.410049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.410170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.410195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.410285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.410377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.410409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.410517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.410610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.410635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.410758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.410850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.814 [2024-11-29 09:51:11.410876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.814 qpair failed and we were unable to recover it. 00:27:48.814 [2024-11-29 09:51:11.410971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.411051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.411077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.411168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.411288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.411312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.411408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.411500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.411525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.411627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.411714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.411739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.411877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.411969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.411994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.412144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.412228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.412252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.412342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.412442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.412468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.412572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.412690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.412714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.412804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.412926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.412951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.413100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.413191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.413216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.413308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.413401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.413428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.413551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.413674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.413699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.413821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.413939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.413964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.414060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.414152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.414179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.414285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.414380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.414411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.414505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.414600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.414624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.414715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.414828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.414852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.414977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.415093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.415118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.415209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.415329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.415354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.415454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.415545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.415569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.415657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.415741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.415766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.415883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.415970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.415995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.416117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.416207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.416232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.416332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.416457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.416483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.416583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.416669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.416695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.416791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.416875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.416900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.417018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.417110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.417135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.417264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.417390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.417420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.417522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.417619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.815 [2024-11-29 09:51:11.417644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.815 qpair failed and we were unable to recover it. 00:27:48.815 [2024-11-29 09:51:11.417746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.417865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.417890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.418010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.418097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.418122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.418243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.418335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.418359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.418469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.418589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.418615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.418701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.418794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.418820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.418913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.419005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.419030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.419162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.419281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.419305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.419400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.419486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.419511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.419607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.419693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.419717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.419805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.419925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.419951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.420047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.420137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.420161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.420282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.420365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.420390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.420488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.420578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.420611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.420737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.420859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.420884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.421003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.421124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.421149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.421242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.421323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.421354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.421462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.421547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.421572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.421668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.421765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.421789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.421878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.421964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.421989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.422080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.422167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.422192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.422286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.422372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.422405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.422503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.422589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.422615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.422714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.422809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.422834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.422955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.423047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.423071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.423171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.423263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.423287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.423382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.423474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.423505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.423656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.423772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.423798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.423889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.423978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.424003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.816 [2024-11-29 09:51:11.424132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.424213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.816 [2024-11-29 09:51:11.424238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.816 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.424363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.424462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.424487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.424613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.424706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.424731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.424818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.424961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.424986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.425088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.425177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.425202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.425297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.425384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.425416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.425517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.425631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.425656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.425778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.425876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.425902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.426000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.426086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.426111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.426198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.426288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.426312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.426434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.426587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.426613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.426701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.426785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.426809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.426908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.427054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.427078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.427175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.427289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.427314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.427464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.427563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.427588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.427683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.427807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.427832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.427923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.428007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.428032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.428127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.428215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.428241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.428337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.428455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.428481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.428574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.428673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.428699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.428831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.428933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.428957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.429075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.429162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.429187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.429283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.429373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.429421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.429549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.429633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.429657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.429748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.429869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.429894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.430015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.430107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.430132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.430258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.430376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.430408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.430566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.430654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.430679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.430771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.430855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.430881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.817 [2024-11-29 09:51:11.430999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.431120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.817 [2024-11-29 09:51:11.431145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.817 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.431236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.431327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.431352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.431454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.431546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.431572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.431699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.431795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.431819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.431935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.432020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.432045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.432142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.432229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.432254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.432378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.432484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.432510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.432602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.432728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.432753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.432855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.432944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.432969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.433061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.433178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.433203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.433298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.433387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.433419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.433526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.433640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.433665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.433770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.433895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.433919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.434018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.434133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.434158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.434251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.434377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.434419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.434523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.434608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.434634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.434728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.434840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.434865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.434987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.435077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.435103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.435196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.435321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.435345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.435478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.435574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.435608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.435696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.435816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.435842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.435939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.436022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.436047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.436142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.436236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.436261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.436356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.436470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.436496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.436590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.436674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.436699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.436793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.436882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.436907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.818 qpair failed and we were unable to recover it. 00:27:48.818 [2024-11-29 09:51:11.437021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.818 [2024-11-29 09:51:11.437164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.437190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.437281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.437371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.437411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.437507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.437593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.437618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.437717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.437810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.437834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.437937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.438036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.438061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.438158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.438273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.438298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.438398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.438491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.438515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.438611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.438727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.438752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.438850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.438972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.438997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.439085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.439230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.439256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.439348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.439436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.439462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.439564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.439681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.439706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.439796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.439894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.439919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.440016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.440163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.440188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.440282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.440399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.440423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.440526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.440613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.440638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.440728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.440826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.440851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.440942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.441024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.441050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.441138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.441226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.441252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.441354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.441460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.441486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.441577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.441665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.441690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.441781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.441894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.441919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.442001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.442117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.442142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.442232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.442324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.442348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.442455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.442546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.442572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.442673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.442795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.442820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.442907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.443026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.443052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.443145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.443294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.443318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.443412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.443501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.443525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.819 qpair failed and we were unable to recover it. 00:27:48.819 [2024-11-29 09:51:11.443613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.819 [2024-11-29 09:51:11.443711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.443735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.443836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.443925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.443949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.444037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.444151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.444175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.444262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.444357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.444381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.444482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.444568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.444592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.444684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.444811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.444836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.444927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.445020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.445045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.445165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.445250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.445275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.445369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.445458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.445483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.445572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.445691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.445716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.445821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.445910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.445934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.446056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.446144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.446168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.446260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.446370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.446400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.446510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.446629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.446654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.446750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.446845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.446871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.446986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.447080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.447111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.447214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.447304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.447330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.447436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.447518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.447544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.447639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.447726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.447750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.447871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.447986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.448011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.448114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.448213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.448238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.448325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.448418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.448444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.448565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.448651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.448676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.448763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.448881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.448906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.449000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.449090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.449114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.449202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.449317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.449342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.820 qpair failed and we were unable to recover it. 00:27:48.820 [2024-11-29 09:51:11.449500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.449617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.820 [2024-11-29 09:51:11.449643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.449734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.449859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.449885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.449978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.450070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.450095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.450190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.450283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.450308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.450405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.450499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.450525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.450621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.450719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.450746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.450848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.450969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.450994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.451099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.451189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.451213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.451338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.451425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.451451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.451534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.451630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.451656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.451785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.451880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.451905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.452000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.452093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.452118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.452220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.452337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.452363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.452490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.452587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.452613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.452704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.452798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.452824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.452910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.453002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.453027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.453116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.453226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.453250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.453350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.453482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.453508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.453605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.453720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.453745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.453839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.453959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.453984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.454121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.454227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.454255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.454385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.454477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.454502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.454596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.454679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.454705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.454790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.454886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.454912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.821 [2024-11-29 09:51:11.455005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.455132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.821 [2024-11-29 09:51:11.455158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.821 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.455275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.455358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.455385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.455521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.455645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.455671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.455768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.455860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.455885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.455986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.456071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.456096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.456213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.456300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.456325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.456433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.456543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.456572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.456669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.456791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.456817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.456914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.457036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.457061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.457162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.457251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.457276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.457372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.457503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.457531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.457657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.457775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.457800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.457918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.458040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.458066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.458187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.458305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.458330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.458421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.458545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.458571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.458666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.458811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.458836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.458984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.459080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.459106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.459226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.459314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.459339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.459442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.459536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.459561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.459653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.459771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.459796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.459889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.459984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.460011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.460111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.460224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.460250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.460350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.460452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.460481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.460571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.460660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.460685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.460773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.460856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.460882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.460998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.461089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.461115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.461235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.461339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.461366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.822 qpair failed and we were unable to recover it. 00:27:48.822 [2024-11-29 09:51:11.461477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.461573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.822 [2024-11-29 09:51:11.461597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.461690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.461816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.461841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.461936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.462030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.462057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.462156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.462278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.462304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.462436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.462533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.462559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.462691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.462778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.462804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.462898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.463014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.463040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.463159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.463281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.463307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.463405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.463533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.463559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.463662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.463759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.463784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.463876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.463993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.464018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.464152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.464264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.464289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.464385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.464520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.464547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.464640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.464731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.464758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.464879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.464969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.464994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.465093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.465216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.465242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.465340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.465435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.465462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.465579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.465674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.823 [2024-11-29 09:51:11.465700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.823 qpair failed and we were unable to recover it. 00:27:48.823 [2024-11-29 09:51:11.465788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.465876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.465901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.465996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.466111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.466142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.466237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.466355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.466381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.467171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.467284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.467311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.467408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.467503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.467529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.467631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.467720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.467746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.467832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.467920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.467946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.468094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.468239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.468265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.468361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.468481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.468508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.468631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.468722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.468748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.468850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.468967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.468993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.469087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.469175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.469206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.469297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.469429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.469455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.469576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.469664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.469689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.469780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.469869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.469896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.469995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.470089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.470115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.470221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.470343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.470368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.470485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.470604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.470629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.470755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.470852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.470879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.471033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.471116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.471141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.471234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.471323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.471349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.471482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.471570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.471601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.471725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.471815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.471840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.471928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.472024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.472050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.472142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.472290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.472315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.472412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.472506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.472532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.824 qpair failed and we were unable to recover it. 00:27:48.824 [2024-11-29 09:51:11.472626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.824 [2024-11-29 09:51:11.472744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.472770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.472915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.472997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.473022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.473147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.473234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.473259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.473351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.473448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.473475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.473570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.473665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.473690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.473807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.473893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.473923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.474042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.474133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.474161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.474260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.474409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.474446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.474536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.474654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.474680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.474788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.474878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.474904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.475020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.475110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.475136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.475238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.475328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.475353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.475449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.475538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.475563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.475693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.475807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.475833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.475925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.476018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.476043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.476172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.476267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.476294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.476390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.476492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.476519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.476643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.476737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.476762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.476850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.476942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.476968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.477119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.477206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.477232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.477351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.477453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.477481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.477577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.477671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.477697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.477790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.477910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.477938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.825 qpair failed and we were unable to recover it. 00:27:48.825 [2024-11-29 09:51:11.478028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.478120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.825 [2024-11-29 09:51:11.478146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.478237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.478323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.478349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.478460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.478554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.478581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.478707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.478795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.478821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.478914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.479003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.479029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.479150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.479301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.479327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.479422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.479547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.479573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.479663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.479748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.479773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.479866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.479986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.480012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.480136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.480225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.480252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.480378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.480505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.480532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.480626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.480722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.480747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.480841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.480965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.480990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.481108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.481200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.481226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.481314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.481409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.481436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.481552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.481642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.481668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.481770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.481859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.481885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.481976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.482065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.482090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.482182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.482306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.482332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.482427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.482525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.482550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.482649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.482739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.482765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.482896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.483020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.483046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.483138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.483289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.483315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.483444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.483564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.483590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.483677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.483783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.483809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.483906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.484029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.484054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.484141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.484235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.484263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.484383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.484479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.484504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.826 qpair failed and we were unable to recover it. 00:27:48.826 [2024-11-29 09:51:11.484604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.484726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.826 [2024-11-29 09:51:11.484751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.484877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.484964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.484990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.485084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.485178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.485204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.485302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.485403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.485429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.485523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.485640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.485666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.485765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.485855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.485881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.485977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.486065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.486091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.486188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.486274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.486300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.486413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.486509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.486535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.486627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.486725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.486750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.486872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.486959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.486985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.487118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.487235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.487260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.487350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.487447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.487474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.487565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.487688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.487713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.487804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.487917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.487943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.488068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.488159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.488186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.488280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.488408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.488434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.488528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.488625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.488651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.488744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.488831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.488857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.488974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.489067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.489092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.489189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.489304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.489330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.489424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.489518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.827 [2024-11-29 09:51:11.489543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.827 qpair failed and we were unable to recover it. 00:27:48.827 [2024-11-29 09:51:11.489663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.489756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.489781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.489905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.490002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.490028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.490125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.490217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.490243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.490346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.490451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.490478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.490571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.490684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.490710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.490806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.490924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.490950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.491046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.491169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.491195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.491319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.491406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.491432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.491528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.491645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.491670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.491796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.491913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.491939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.492060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.492148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.492174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.492274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.492391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.492425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.492513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.492639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.492664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.492768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.492857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.492882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.492986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.493080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.493106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.493219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.493318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.493344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.493478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.493566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.493592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.493714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.493801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.493827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.493946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.494041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.494067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.494183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.494274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.494299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.494408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.494501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.494528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.494652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.494742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.494767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.494895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.494984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.495011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.495112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.495201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.495226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.495316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.495410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.495437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.495527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.495652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.495678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.495770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.495857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.495883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.496009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.496091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.496117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.828 qpair failed and we were unable to recover it. 00:27:48.828 [2024-11-29 09:51:11.496213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.828 [2024-11-29 09:51:11.496333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.496359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.496452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.496574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.496600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.496696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.496784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.496809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.496900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.497019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.497044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.497142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.497237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.497262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.497356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.497454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.497481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.497583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.497669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.497694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.497790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.497878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.497904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.497996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.498119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.498145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.498247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.498386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.498429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.498562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.498663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.498689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.498786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.498872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.498900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.498995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.499117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.499143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.499236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.499319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.499344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.499445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.499539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.499564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.499688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.499785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.499812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.499931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.500046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.500071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.500194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.500276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.500302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.500399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.500517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.500543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.500629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.500751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.500777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.500866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.500980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.501005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.501129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.501216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.501242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.501335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.501451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.501477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.501571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.501687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.501713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.829 qpair failed and we were unable to recover it. 00:27:48.829 [2024-11-29 09:51:11.501805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.501924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.829 [2024-11-29 09:51:11.501949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.502046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.502141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.502167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.502300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.502391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.502422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.502559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.502680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.502705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.502799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.502895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.502920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.503019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.503136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.503162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.503284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.503403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.503429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.503527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.503643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.503669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.503787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.503908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.503934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.504062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.504151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.504176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.504298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.504422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.504449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.504541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.504630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.504661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.504759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.504850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.504877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.504969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.505053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.505078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.505178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.505270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.505297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.505421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.505517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.505543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.505639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.505730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.505755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.505837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.505956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.505982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.506076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.506168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.506195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.506283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.506432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.506458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.506582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.506702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.506727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.506837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.506959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.506989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.507099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.507251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.507277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.507369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.507490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.507516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.507610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.507702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.507729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.507818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.507906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.507932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.508028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.508143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.508169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.508265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.508357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.508382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.508481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.508601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.508627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.830 qpair failed and we were unable to recover it. 00:27:48.830 [2024-11-29 09:51:11.508756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.830 [2024-11-29 09:51:11.508840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.508865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.508963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.509043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.509068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.509165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.509249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.509291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.509379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.509471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.509498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.509581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.509696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.509722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.509848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.509941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.509967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.510067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.510162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.510187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.510303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.510399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.510425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.510515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.510596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.510622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.510750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.510844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.510870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.510971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.511061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.511086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.511209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.511294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.511320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.511419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.511520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.511552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.511675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.511768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.511796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.511901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.511990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.512016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.512109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.512197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.512222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.512315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.512411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.512438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.512562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.512683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.512709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.512803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.512931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.512956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.513082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.513198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.513224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.513349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.513445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.513472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.513615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.513705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.513731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.513826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.513915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.513941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.514039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.514167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.514193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.514280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.514379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.514420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.514551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.514649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.514674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.514794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.514890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.514917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.515057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.515181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.515209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.515301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.515389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.515423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.831 qpair failed and we were unable to recover it. 00:27:48.831 [2024-11-29 09:51:11.515518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.831 [2024-11-29 09:51:11.515617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.515642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.515727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.515827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.515852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.515979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.516068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.516095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.516189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.516272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.516298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.516436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.516530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.516556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.516672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.516756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.516782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.516902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.516993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.517019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.517112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.517232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.517258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.517357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.517478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.517504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.517627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.517777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.517802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.517901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.518017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.518042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.518137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.518227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.518252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.518380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.518478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.518504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.518628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.518719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.518745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.518880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.518999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.519025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.519121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.519207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.519232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.519331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.519481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.519508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.519601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.519718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.519744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.519892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.519982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.520007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.520096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.520220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.520246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.520406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.520493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.520518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.520638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.520732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.520758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.520876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.520962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.520987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.521104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.521192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.521218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.521321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.521444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.521470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.521558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.521680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.521706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.521807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.521899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.521925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.522020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.522112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.522138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.522226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.522314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.832 [2024-11-29 09:51:11.522340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.832 qpair failed and we were unable to recover it. 00:27:48.832 [2024-11-29 09:51:11.522436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.522585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.522610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.522699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.522790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.522815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.522933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.523023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.523049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.523151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.523241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.523266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.523385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.523510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.523536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.523659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.523752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.523778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.523903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.524021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.524047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.524148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.524265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.524290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.524385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.524509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.524535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.524664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.524782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.524808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.524930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.525050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.525075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.525169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.525263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.525289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.525410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.525505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.525531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.525621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.525708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.525734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.525825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.525956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.525982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.526078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.526175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.526200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.526307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.526404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.526430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.526554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.526642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.526668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.526758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.526848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.526875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.526974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.527073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.527099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.527218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.527312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.527338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.527460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.527551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.527577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.527673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.527766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.527793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.527890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.528011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.528038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.528138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.528287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.833 [2024-11-29 09:51:11.528313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e88000b90 with addr=10.0.0.2, port=4420 00:27:48.833 qpair failed and we were unable to recover it. 00:27:48.833 [2024-11-29 09:51:11.528433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.528568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.528597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.528713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.528806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.528832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.528934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.529022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.529047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.529169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.529297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.529323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.529420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.529508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.529533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.529654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.529774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.529805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.529928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.530016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.530047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.530132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.530260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.530286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.530379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.530478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.530504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.530626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.530713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.530738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.530830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.530923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.530947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.531037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.531154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.531180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.531299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.531379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.531410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.531511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.531605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.531630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.531727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.531810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.531835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.531928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.532016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.532041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.532134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.532222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.532247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.532340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.532466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.532492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.532585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.532679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.532704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.532803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.532888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.532912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.533008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.533126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.533157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.533253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.533351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.533378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.533522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.533609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.533635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.533740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.533862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.533887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.533978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.534068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.534092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.534180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.534303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.534329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.534421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.534516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.534550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.534646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.534794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.534831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.834 qpair failed and we were unable to recover it. 00:27:48.834 [2024-11-29 09:51:11.534933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.535016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.834 [2024-11-29 09:51:11.535041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.535133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.535233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.535259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.535347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.535446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.535478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.535600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.535690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.535716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.535874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.535991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.536017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.536112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.536208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.536234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.536338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.536430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.536456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.536542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.536714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.536740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.536829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.536945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.536971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.537069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.537193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.537218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.537312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.537429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.537456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.537546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.537636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.537661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.537748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.537841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.537867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.537963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.538120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.538155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.538285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.538369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.538401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.538489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.538579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.538605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.538692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.538787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.538813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.538938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.539056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.539081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.539175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.539295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.539320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.539408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.539491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.539516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.539623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.539716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.539742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.539836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.539927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.539953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.540080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.540193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.540218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.540346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.540438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.540464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.540560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.540682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.540707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.540797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.540921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.540947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.541036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.541126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.541151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.541236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.541323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.541349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.541451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.541566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.541591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.835 qpair failed and we were unable to recover it. 00:27:48.835 [2024-11-29 09:51:11.541681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.541772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.835 [2024-11-29 09:51:11.541798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.541897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.542011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.542037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.542133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.542227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.542252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.542349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.542441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.542466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.542557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.542655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.542680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.542807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.542925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.542950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.543043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.543142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.543167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.543252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.543340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.543365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.543479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.543593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.543619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.543716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.543805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.543831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.543931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.544053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.544078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.544184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.544274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.544301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.544406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.544530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.544556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.544685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.544803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.544829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.544925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.545017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.545044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.545139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.545252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.545277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.545373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.545466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.545491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.545617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.545734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.545759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.545850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.545964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.545989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.546083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.546209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.546235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.546323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.546472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.546498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.546600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.546688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.546713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.546805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.546885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.546910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.547009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.547090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.547115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.547244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.547332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.547361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.547507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.547602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.547628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.547745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.547844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.547871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.547959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.548053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.548079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.548168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.548258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.548283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.836 qpair failed and we were unable to recover it. 00:27:48.836 [2024-11-29 09:51:11.548381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.836 [2024-11-29 09:51:11.548479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.548504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.548592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.548718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.548744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.548829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.548917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.548942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.549031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.549119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.549145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.549268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.549398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.549424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.549511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.549602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.549628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.549750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.549840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.549865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.550015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.550104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.550130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.550217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.550300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.550325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.550444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.550534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.550559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.550681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.550761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.550786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.550882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.550982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.551008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.551103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.551194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.551219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.551325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.551446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.551472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.551574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.551661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.551688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.551784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.551864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.551889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.552018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.552110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.552136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.552260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.552387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.552422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.552514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.552608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.552633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.552753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.552842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.552868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.552991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.553106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.553130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.553223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.553337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.553364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.553465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.553560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.553586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.553709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.553829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.553855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.553950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.554039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.554064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.554198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.554283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.554308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.554409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.554524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.554550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.554640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.554731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.554759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.554849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.554940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.554966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.837 qpair failed and we were unable to recover it. 00:27:48.837 [2024-11-29 09:51:11.555050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.837 [2024-11-29 09:51:11.555141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.555166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.555289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.555409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.555434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.555572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.555665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.555690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.555814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.555928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.555953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.556042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.556162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.556188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.556274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.556427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.556455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.556581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.556703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.556728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.556819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.556916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.556942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.557034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.557121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.557145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.557242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.557356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.557381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.557478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.557596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.557621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.557719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.557800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.557824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.557916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.558009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.558033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.558126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.558219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.558244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.558353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.558450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.558475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.558599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.558685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.558712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.558864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.558951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.558975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.559091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.559185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.559214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.559310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.559399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.559427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.559522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.559633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.559659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.559776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.559860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.559885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.560011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.560101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.560126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.560219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.560315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.560340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.560458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.560549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.560573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.560659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.560809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.560834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.560922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.561009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.838 [2024-11-29 09:51:11.561034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.838 qpair failed and we were unable to recover it. 00:27:48.838 [2024-11-29 09:51:11.561148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.561243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.561268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.561366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.561457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.561482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.561607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.561736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.561762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.561849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.561939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.561965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.562085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.562176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.562202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.562293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.562413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.562438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.562565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.562656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.562681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.562780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.562894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.562918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.563011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.563101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.563128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.563252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.563414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.563441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.563563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.563681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.563706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.563791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.563880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.563905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.564000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.564082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.564107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.564199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.564287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.564313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.564403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.564493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.564518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.564632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.564728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.564753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.564852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.564939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.564965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.565090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.565179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.565204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.565296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.565386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.565417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.565509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.565625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.565651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.565802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.565888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.565914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.566045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.566166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.566193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.566295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.566385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.566417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.566508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.566601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.566627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.566746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.566840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.566864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.566953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.567074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.567099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.567217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.567331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.567356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.567482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.567574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.567601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.567694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.567784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.567809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.839 qpair failed and we were unable to recover it. 00:27:48.839 [2024-11-29 09:51:11.567899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.839 [2024-11-29 09:51:11.568015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.568040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.568165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.568256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.568281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.568399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.568494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.568519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.568612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.568695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.568721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.568815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.568931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.568956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.569061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.569184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.569209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.569296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.569388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.569420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.569508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.569597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.569624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.569728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.569843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.569869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.569958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.570050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.570076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.570167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.570283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.570308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.570405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.570526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.570552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.570643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.570730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.570755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.570875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.570962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.570992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.571139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.571233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.571260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.571343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.571489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.571516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.571613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.571698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.571723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.571815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.571932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.571958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.572044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.572170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.572195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.572282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.572406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.572432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.572526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.572615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.572640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.572761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.572842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.572866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.572951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.573040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.573066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.573154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.573275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.573299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.573401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.573490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.573516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.573636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.573751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.573777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.573866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.573956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.573981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.574067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.574211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.574236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.574333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.574419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.840 [2024-11-29 09:51:11.574444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.840 qpair failed and we were unable to recover it. 00:27:48.840 [2024-11-29 09:51:11.574536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.574629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.574655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.574746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.574864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.574890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.574995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.575094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.575118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.575216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.575297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.575321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.575438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.575532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.575558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.575649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.575729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.575755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.575840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.575931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.575955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.576080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.576201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.576226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.576351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.576477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.576503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.576595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.576688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.576712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.576795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.576884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.576909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.577001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.577085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.577110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.577202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.577320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.577345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.577463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.577546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.577571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.577662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.577778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.577803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.577904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.577985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.578010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.578105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.578220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.578245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.578338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.578428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.578454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.578577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.578696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.578721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.578817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.578908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.578933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.579020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.579111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.579137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.579228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.579316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.579341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.579448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.579570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.579597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.579696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.579821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.579847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.579966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.580054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.580079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.580202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.580325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.580350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.580482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.580581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.580606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.580696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.580815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.580841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.580932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.581079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.841 [2024-11-29 09:51:11.581104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.841 qpair failed and we were unable to recover it. 00:27:48.841 [2024-11-29 09:51:11.581223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.581310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.581335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.581455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.581540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.581564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.581666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.581754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.581779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.581863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.582022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.582046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.582161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.582256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.582281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.582366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.582477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.582504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.582593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.582713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.582742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.582839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.582931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.582956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.583050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.583144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.583170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.583265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.583347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.583372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.583480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.583567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.583592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.583687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.583811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.583836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.583958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.584053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.584078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.584209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.584289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.584314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.584412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.584537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.584563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.584659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.584773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.584798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.584916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.585032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.585063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.585159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.585242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.585267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.585364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.585492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.585519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.585638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.585730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.585755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.585876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.585966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.585992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.586087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.586172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.586196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.586326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.586443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.586469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.586587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.586678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.586704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.586799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.586883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.842 [2024-11-29 09:51:11.586907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.842 qpair failed and we were unable to recover it. 00:27:48.842 [2024-11-29 09:51:11.586991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.587090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.587117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.587212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.587358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.587384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.587497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.587597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.587622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.587727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.587817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.587843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.587929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.588041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.588066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.588162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.588257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.588283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.588377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.588533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.588559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.588652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.588739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.588764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.588885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.589001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.589025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.589124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.589221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.589247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.589334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.589423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.589450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.589536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.589625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.589649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.589750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.589873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.589898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.590000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.590087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.590113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.590204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.590294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.590319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.590474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.590589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.590614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.590706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.590854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.590879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.590966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.591086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.591110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.591228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.591315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.591340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.591428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.591521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.591548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.843 qpair failed and we were unable to recover it. 00:27:48.843 [2024-11-29 09:51:11.591634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.843 [2024-11-29 09:51:11.591748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.591773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.591872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.591988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.592013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.592107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.592195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.592220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.592320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.592447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.592474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.592565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.592691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.592716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.592814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.592905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.592929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.593020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.593132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.593156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.593250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.593372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.593404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.593520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.593636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.593661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.593761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.593844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.593869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.593957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.594113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.594137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.594260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.594351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.594376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.594484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.594604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.594630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.594765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.594853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.594877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.594968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.595058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.595083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.595233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.595317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.595343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.595443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.595524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.595549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.595644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.595776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.595801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.595887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.596002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.596028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.596125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.596243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.596269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.596364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.596470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.596496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.596587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.596710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.596736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.596822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.596909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.596939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.597085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.597203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.597228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.597318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.597452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.597479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.597604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.597699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.597724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.597848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.597944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.597969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.598056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.598185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.598211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.598298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.598385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.844 [2024-11-29 09:51:11.598415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.844 qpair failed and we were unable to recover it. 00:27:48.844 [2024-11-29 09:51:11.598512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.598601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.598628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.598720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.598838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.598863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.598988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.599080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.599105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.599239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.599328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.599353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.599487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.599578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.599603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.599699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.599822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.599847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.599935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.600048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.600073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.600162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.600255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.600281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.600406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.600489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.600514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.600611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.600693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.600717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.600811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.600932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.600957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.601082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.601173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.601199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.601287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.601378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.601408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.601546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.601637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.601665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.601759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.601857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.601881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.601975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.602064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.602089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.602182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.602275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.602299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.602384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.602519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.602544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.602632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.602750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.602775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.602861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.602950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.602977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.603105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.603220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.603245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.603367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.603491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.603518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.603607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.603702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.603730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.603824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.603922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.603946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.604055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.604159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.604189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.604296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.604383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.604420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.604532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.604625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.604651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.604747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.604891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.604918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.845 [2024-11-29 09:51:11.605015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.605108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.845 [2024-11-29 09:51:11.605133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.845 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.605234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.605358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.605384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.605494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.605583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.605609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.605749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.605842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.605869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.605960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.606047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.606071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.606166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.606262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.606289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.606403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.606496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.606522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.606615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.606709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.606735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.606857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.606976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.607002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.607133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.607224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.607249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.607343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.607448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.607476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.607600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.607696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.607726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.607831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.607921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.607947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.608094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.608193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.608219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.608321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.608409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.608436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.608531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.608651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.608677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.608780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.608905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.608931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.609034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.609121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.609148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.609276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.609374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.609406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.609532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.609618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.609643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.609737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.609826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.609852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.609973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.610058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.610084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.610205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.610327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.610352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.610494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.610610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.610636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.610726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.610819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.610844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.610945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.611029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.611054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.611152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.611280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.846 [2024-11-29 09:51:11.611307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:48.846 qpair failed and we were unable to recover it. 00:27:48.846 [2024-11-29 09:51:11.611413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.611520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.611547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.611670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.611806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.611832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.611960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.612052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.612077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.612177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.612297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.612323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.612417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.612539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.612565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.612665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.612755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.612781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.612912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.613001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.613029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.613122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.613221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.613246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.613363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.613484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.613511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.613629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.613735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.613761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.613915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.614000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.614026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.614148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.614245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.614272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.614360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.614462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.614488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.614585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.614713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.614739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.614835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.614960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.614986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.615107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.615262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.615288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.615376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.615486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.615512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.615602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.615702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.615730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.615826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.615940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.615965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.616062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.616156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.616187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e84000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.616332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.616449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.616480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.616605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.616731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.616762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1069cb0 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.616889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.617017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.617043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.617142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.617224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.617249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.617374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.617479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.617506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.108 qpair failed and we were unable to recover it. 00:27:49.108 [2024-11-29 09:51:11.617633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.108 [2024-11-29 09:51:11.617753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.617777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.617865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.618010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.618035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.618162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.618250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.618275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.618401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.618498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.618523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.618649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.618749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.618783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.618876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.618968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.618992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.619083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.619197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.619221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.619313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.619414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.619439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.619537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.619630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.619654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.619776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.619894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.619919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.620012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.620125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.620149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.620270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.620357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.620382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.620485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.620576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.620601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.620724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.620813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.620837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.620941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.621058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.621087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.621180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.621273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.621297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.621457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.621540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.621565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.621657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.621764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.621788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.621910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.621999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.622024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.622123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.622218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.622242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.622330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.622529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.622555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.622651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.622734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.622758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.622888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.622975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.623000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.623088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.623176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.623201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.623296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.623418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.623459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.623547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.623636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.623660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.623759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.623852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.623877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.623969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.624085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.624110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.109 [2024-11-29 09:51:11.624209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.624299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.109 [2024-11-29 09:51:11.624324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.109 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.624417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.624551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.624575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.624705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.624799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.624825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.624948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.625073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.625099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.625240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.625331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.625355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.625461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.625551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.625576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.625665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.625799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.625824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.625952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.626048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.626072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.626178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.626262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.626287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.626371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.626463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.626488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.626584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.626681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.626705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.626843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.626963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.626988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.627108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.627223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.627247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.627334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.627432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.627460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.627565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.627658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.627684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.627785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.627877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.627901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.627996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.628114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.628141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.628244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.628361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.628386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.628496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.628595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.628621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.628722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.628842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.628866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.628957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.629077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.629102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.629218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.629308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.629332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.629421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.629522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.629548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.629640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.629733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.629759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.629881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.630028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.630053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.630172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.630259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.630284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.630381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.630484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.630508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.630608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.630728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.630754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.630843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.630962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.630987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.110 qpair failed and we were unable to recover it. 00:27:49.110 [2024-11-29 09:51:11.631076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.110 [2024-11-29 09:51:11.631159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.631184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.631308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.631420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.631446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.631551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.631640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.631665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.631766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.631887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.631912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.632001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.632116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.632140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.632229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.632342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.632366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.632476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.632577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.632601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.632720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.632801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.632825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.632920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.633006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.633030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.633223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.633319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.633344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.633438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.633530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.633556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.633676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.633789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.633813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.633937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.634055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.634080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.634181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.634299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.634324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.634446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.634541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.634566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.634711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.634804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.634829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.634929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.635019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.635044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.635169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.635256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.635282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.635386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.635494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.635518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.635611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.635707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.635732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.635827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.635944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.635970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.636093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.636181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.636206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.636295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.636383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.636416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.636507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.636598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.636622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.636746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.636826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.636851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.636942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.637027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.637051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.637144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.637267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.637292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.637384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.637488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.637512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.637617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.637705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.637729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.111 qpair failed and we were unable to recover it. 00:27:49.111 [2024-11-29 09:51:11.637854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.111 [2024-11-29 09:51:11.637940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.637964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.638047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.638134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.638159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.638278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.638368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.638400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.638493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.638614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.638638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.638732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.638829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.638854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.638949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.639035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.639059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.639148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.639266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.639291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.639403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.639503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.639527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.639617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.639734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.639759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.639858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.639946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.639970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.640102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.640184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.640209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.640329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.640453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.640478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.640580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.640671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.640696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.640790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.640876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.640900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.641016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.641134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.641158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.641280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.641372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.641401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.641502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.641594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.641618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.641715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.641808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.641832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.641924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.642046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.642070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f5e90000b90 with addr=10.0.0.2, port=4420 00:27:49.112 qpair failed and we were unable to recover it. 00:27:49.112 [2024-11-29 09:51:11.642228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.642365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.112 [2024-11-29 09:51:11.642401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1077600 with addr=10.0.0.2, port=4420 00:27:49.112 [2024-11-29 09:51:11.642422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1077600 is same with the state(5) to be set 00:27:49.112 [2024-11-29 09:51:11.642466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1077600 (9): Bad file descriptor 00:27:49.112 [2024-11-29 09:51:11.642489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.112 [2024-11-29 09:51:11.642505] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.112 [2024-11-29 09:51:11.642526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.112 Unable to reset the controller. 00:27:49.372 09:51:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:49.372 09:51:12 -- common/autotest_common.sh@862 -- # return 0 00:27:49.372 09:51:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:49.372 09:51:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:49.372 09:51:12 -- common/autotest_common.sh@10 -- # set +x 00:27:49.372 09:51:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:49.372 09:51:12 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:49.372 09:51:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.372 09:51:12 -- common/autotest_common.sh@10 -- # set +x 00:27:49.372 Malloc0 00:27:49.372 09:51:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.372 09:51:12 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:49.372 09:51:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.372 09:51:12 -- common/autotest_common.sh@10 -- # set +x 00:27:49.372 [2024-11-29 09:51:12.145496] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:49.372 09:51:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.372 09:51:12 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:49.372 09:51:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.372 09:51:12 -- common/autotest_common.sh@10 -- # set +x 00:27:49.372 09:51:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.372 09:51:12 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:49.372 09:51:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.372 09:51:12 -- common/autotest_common.sh@10 -- # set +x 00:27:49.372 09:51:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.372 09:51:12 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:49.372 09:51:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.372 09:51:12 -- common/autotest_common.sh@10 -- # set +x 00:27:49.372 [2024-11-29 09:51:12.173781] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:49.372 09:51:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.372 09:51:12 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:49.372 09:51:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.372 09:51:12 -- common/autotest_common.sh@10 -- # set +x 00:27:49.372 09:51:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.372 09:51:12 -- host/target_disconnect.sh@58 -- # wait 148819 00:27:49.938 Controller properly reset. 00:27:55.210 Initializing NVMe Controllers 00:27:55.210 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:55.210 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:55.210 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:27:55.210 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:27:55.210 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:27:55.210 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:27:55.210 Initialization complete. Launching workers. 00:27:55.210 Starting thread on core 1 00:27:55.210 Starting thread on core 2 00:27:55.210 Starting thread on core 3 00:27:55.210 Starting thread on core 0 00:27:55.210 09:51:17 -- host/target_disconnect.sh@59 -- # sync 00:27:55.210 00:27:55.210 real 0m11.351s 00:27:55.210 user 0m35.487s 00:27:55.210 sys 0m7.272s 00:27:55.210 09:51:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:55.210 09:51:17 -- common/autotest_common.sh@10 -- # set +x 00:27:55.210 ************************************ 00:27:55.210 END TEST nvmf_target_disconnect_tc2 00:27:55.210 ************************************ 00:27:55.210 09:51:17 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:27:55.210 09:51:17 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:27:55.210 09:51:17 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:27:55.210 09:51:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:55.210 09:51:17 -- nvmf/common.sh@116 -- # sync 00:27:55.210 09:51:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:55.210 09:51:17 -- nvmf/common.sh@119 -- # set +e 00:27:55.210 09:51:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:55.210 09:51:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:55.210 rmmod nvme_tcp 00:27:55.210 rmmod nvme_fabrics 00:27:55.210 rmmod nvme_keyring 00:27:55.210 09:51:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:55.210 09:51:17 -- nvmf/common.sh@123 -- # set -e 00:27:55.210 09:51:17 -- nvmf/common.sh@124 -- # return 0 00:27:55.210 09:51:17 -- nvmf/common.sh@477 -- # '[' -n 149781 ']' 00:27:55.210 09:51:17 -- nvmf/common.sh@478 -- # killprocess 149781 00:27:55.210 09:51:17 -- common/autotest_common.sh@936 -- # '[' -z 149781 ']' 00:27:55.210 09:51:17 -- common/autotest_common.sh@940 -- # kill -0 149781 00:27:55.210 09:51:17 -- common/autotest_common.sh@941 -- # uname 00:27:55.210 09:51:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:55.210 09:51:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 149781 00:27:55.210 09:51:17 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:27:55.210 09:51:17 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:27:55.210 09:51:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 149781' 00:27:55.210 killing process with pid 149781 00:27:55.210 09:51:17 -- common/autotest_common.sh@955 -- # kill 149781 00:27:55.210 09:51:17 -- common/autotest_common.sh@960 -- # wait 149781 00:27:55.210 09:51:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:55.210 09:51:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:55.210 09:51:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:55.210 09:51:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:55.210 09:51:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:55.210 09:51:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:55.210 09:51:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:55.210 09:51:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:57.116 09:51:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:57.116 00:27:57.116 real 0m16.183s 00:27:57.116 user 1m0.904s 00:27:57.116 sys 0m9.548s 00:27:57.116 09:51:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:57.116 09:51:19 -- common/autotest_common.sh@10 -- # set +x 00:27:57.116 ************************************ 00:27:57.116 END TEST nvmf_target_disconnect 00:27:57.116 ************************************ 00:27:57.116 09:51:19 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:27:57.116 09:51:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:57.116 09:51:19 -- common/autotest_common.sh@10 -- # set +x 00:27:57.116 09:51:19 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:27:57.116 00:27:57.116 real 21m25.066s 00:27:57.116 user 62m32.537s 00:27:57.116 sys 4m58.415s 00:27:57.116 09:51:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:57.116 09:51:19 -- common/autotest_common.sh@10 -- # set +x 00:27:57.116 ************************************ 00:27:57.116 END TEST nvmf_tcp 00:27:57.116 ************************************ 00:27:57.116 09:51:19 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:27:57.116 09:51:19 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:57.116 09:51:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:57.116 09:51:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:57.116 09:51:19 -- common/autotest_common.sh@10 -- # set +x 00:27:57.116 ************************************ 00:27:57.116 START TEST spdkcli_nvmf_tcp 00:27:57.116 ************************************ 00:27:57.116 09:51:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:57.116 * Looking for test storage... 00:27:57.116 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:27:57.116 09:51:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:57.116 09:51:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:57.116 09:51:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:57.116 09:51:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:57.116 09:51:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:57.116 09:51:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:57.116 09:51:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:57.116 09:51:19 -- scripts/common.sh@335 -- # IFS=.-: 00:27:57.116 09:51:19 -- scripts/common.sh@335 -- # read -ra ver1 00:27:57.116 09:51:19 -- scripts/common.sh@336 -- # IFS=.-: 00:27:57.116 09:51:19 -- scripts/common.sh@336 -- # read -ra ver2 00:27:57.116 09:51:19 -- scripts/common.sh@337 -- # local 'op=<' 00:27:57.116 09:51:19 -- scripts/common.sh@339 -- # ver1_l=2 00:27:57.116 09:51:19 -- scripts/common.sh@340 -- # ver2_l=1 00:27:57.116 09:51:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:57.116 09:51:19 -- scripts/common.sh@343 -- # case "$op" in 00:27:57.116 09:51:19 -- scripts/common.sh@344 -- # : 1 00:27:57.116 09:51:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:57.116 09:51:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:57.116 09:51:19 -- scripts/common.sh@364 -- # decimal 1 00:27:57.116 09:51:19 -- scripts/common.sh@352 -- # local d=1 00:27:57.116 09:51:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:57.116 09:51:19 -- scripts/common.sh@354 -- # echo 1 00:27:57.116 09:51:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:57.116 09:51:19 -- scripts/common.sh@365 -- # decimal 2 00:27:57.116 09:51:19 -- scripts/common.sh@352 -- # local d=2 00:27:57.116 09:51:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:57.116 09:51:19 -- scripts/common.sh@354 -- # echo 2 00:27:57.116 09:51:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:57.116 09:51:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:57.116 09:51:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:57.116 09:51:19 -- scripts/common.sh@367 -- # return 0 00:27:57.116 09:51:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:57.116 09:51:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:57.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:57.116 --rc genhtml_branch_coverage=1 00:27:57.116 --rc genhtml_function_coverage=1 00:27:57.116 --rc genhtml_legend=1 00:27:57.116 --rc geninfo_all_blocks=1 00:27:57.116 --rc geninfo_unexecuted_blocks=1 00:27:57.116 00:27:57.116 ' 00:27:57.116 09:51:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:57.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:57.116 --rc genhtml_branch_coverage=1 00:27:57.116 --rc genhtml_function_coverage=1 00:27:57.116 --rc genhtml_legend=1 00:27:57.116 --rc geninfo_all_blocks=1 00:27:57.116 --rc geninfo_unexecuted_blocks=1 00:27:57.116 00:27:57.116 ' 00:27:57.116 09:51:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:57.116 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:57.116 --rc genhtml_branch_coverage=1 00:27:57.116 --rc genhtml_function_coverage=1 00:27:57.117 --rc genhtml_legend=1 00:27:57.117 --rc geninfo_all_blocks=1 00:27:57.117 --rc geninfo_unexecuted_blocks=1 00:27:57.117 00:27:57.117 ' 00:27:57.117 09:51:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:57.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:57.117 --rc genhtml_branch_coverage=1 00:27:57.117 --rc genhtml_function_coverage=1 00:27:57.117 --rc genhtml_legend=1 00:27:57.117 --rc geninfo_all_blocks=1 00:27:57.117 --rc geninfo_unexecuted_blocks=1 00:27:57.117 00:27:57.117 ' 00:27:57.117 09:51:19 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:27:57.117 09:51:19 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:27:57.117 09:51:19 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:27:57.117 09:51:19 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:57.117 09:51:19 -- nvmf/common.sh@7 -- # uname -s 00:27:57.117 09:51:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:57.117 09:51:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:57.117 09:51:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:57.117 09:51:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:57.117 09:51:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:57.117 09:51:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:57.117 09:51:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:57.117 09:51:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:57.117 09:51:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:57.117 09:51:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:57.117 09:51:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:57.117 09:51:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:57.117 09:51:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:57.117 09:51:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:57.117 09:51:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:57.117 09:51:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:57.117 09:51:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:57.117 09:51:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:57.117 09:51:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:57.117 09:51:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.117 09:51:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.117 09:51:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.117 09:51:19 -- paths/export.sh@5 -- # export PATH 00:27:57.117 09:51:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.117 09:51:19 -- nvmf/common.sh@46 -- # : 0 00:27:57.117 09:51:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:57.117 09:51:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:57.117 09:51:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:57.117 09:51:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:57.117 09:51:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:57.117 09:51:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:57.117 09:51:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:57.117 09:51:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:57.117 09:51:19 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:27:57.117 09:51:19 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:27:57.117 09:51:19 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:27:57.117 09:51:19 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:27:57.117 09:51:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:57.117 09:51:19 -- common/autotest_common.sh@10 -- # set +x 00:27:57.117 09:51:19 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:27:57.117 09:51:19 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=151013 00:27:57.117 09:51:19 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:27:57.117 09:51:19 -- spdkcli/common.sh@34 -- # waitforlisten 151013 00:27:57.117 09:51:19 -- common/autotest_common.sh@829 -- # '[' -z 151013 ']' 00:27:57.117 09:51:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:57.117 09:51:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:57.117 09:51:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:57.117 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:57.117 09:51:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:57.117 09:51:19 -- common/autotest_common.sh@10 -- # set +x 00:27:57.117 [2024-11-29 09:51:19.934270] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:57.117 [2024-11-29 09:51:19.934347] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid151013 ] 00:27:57.374 EAL: No free 2048 kB hugepages reported on node 1 00:27:57.374 [2024-11-29 09:51:19.991990] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:57.374 [2024-11-29 09:51:20.106148] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:57.374 [2024-11-29 09:51:20.106371] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:57.374 [2024-11-29 09:51:20.106376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:58.304 09:51:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:58.304 09:51:20 -- common/autotest_common.sh@862 -- # return 0 00:27:58.304 09:51:20 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:27:58.304 09:51:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:58.304 09:51:20 -- common/autotest_common.sh@10 -- # set +x 00:27:58.304 09:51:20 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:27:58.304 09:51:20 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:27:58.304 09:51:20 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:27:58.304 09:51:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:58.304 09:51:20 -- common/autotest_common.sh@10 -- # set +x 00:27:58.304 09:51:20 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:27:58.304 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:27:58.304 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:27:58.304 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:27:58.304 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:27:58.304 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:27:58.304 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:27:58.304 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:58.304 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:58.304 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:27:58.304 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:27:58.304 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:27:58.304 ' 00:27:58.598 [2024-11-29 09:51:21.320858] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:01.128 [2024-11-29 09:51:23.497357] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:02.067 [2024-11-29 09:51:24.749893] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:04.601 [2024-11-29 09:51:27.065113] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:06.508 [2024-11-29 09:51:29.063764] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:07.885 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:07.885 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:07.885 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:07.885 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:07.885 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:07.885 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:07.885 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:07.885 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:07.886 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:07.886 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:07.886 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:07.886 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:07.886 09:51:30 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:07.886 09:51:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:07.886 09:51:30 -- common/autotest_common.sh@10 -- # set +x 00:28:07.886 09:51:30 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:07.886 09:51:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:07.886 09:51:30 -- common/autotest_common.sh@10 -- # set +x 00:28:07.886 09:51:30 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:07.886 09:51:30 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:08.453 09:51:31 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:08.453 09:51:31 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:08.453 09:51:31 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:08.453 09:51:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:08.453 09:51:31 -- common/autotest_common.sh@10 -- # set +x 00:28:08.453 09:51:31 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:08.453 09:51:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:08.453 09:51:31 -- common/autotest_common.sh@10 -- # set +x 00:28:08.453 09:51:31 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:08.453 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:08.453 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:08.453 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:08.453 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:08.453 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:08.453 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:08.453 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:08.453 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:08.453 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:08.453 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:08.453 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:08.453 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:08.453 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:08.453 ' 00:28:13.729 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:13.730 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:13.730 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:13.730 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:13.730 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:13.730 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:13.730 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:13.730 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:13.730 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:13.730 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:13.730 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:13.730 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:13.730 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:13.730 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:13.730 09:51:36 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:13.730 09:51:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:13.730 09:51:36 -- common/autotest_common.sh@10 -- # set +x 00:28:13.730 09:51:36 -- spdkcli/nvmf.sh@90 -- # killprocess 151013 00:28:13.730 09:51:36 -- common/autotest_common.sh@936 -- # '[' -z 151013 ']' 00:28:13.730 09:51:36 -- common/autotest_common.sh@940 -- # kill -0 151013 00:28:13.730 09:51:36 -- common/autotest_common.sh@941 -- # uname 00:28:13.730 09:51:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:13.730 09:51:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 151013 00:28:13.730 09:51:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:13.730 09:51:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:13.730 09:51:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 151013' 00:28:13.730 killing process with pid 151013 00:28:13.730 09:51:36 -- common/autotest_common.sh@955 -- # kill 151013 00:28:13.730 [2024-11-29 09:51:36.533009] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:13.730 09:51:36 -- common/autotest_common.sh@960 -- # wait 151013 00:28:13.988 09:51:36 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:13.988 09:51:36 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:13.988 09:51:36 -- spdkcli/common.sh@13 -- # '[' -n 151013 ']' 00:28:13.988 09:51:36 -- spdkcli/common.sh@14 -- # killprocess 151013 00:28:13.988 09:51:36 -- common/autotest_common.sh@936 -- # '[' -z 151013 ']' 00:28:13.988 09:51:36 -- common/autotest_common.sh@940 -- # kill -0 151013 00:28:13.988 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (151013) - No such process 00:28:13.988 09:51:36 -- common/autotest_common.sh@963 -- # echo 'Process with pid 151013 is not found' 00:28:13.988 Process with pid 151013 is not found 00:28:13.988 09:51:36 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:13.988 09:51:36 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:13.988 09:51:36 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:13.988 00:28:13.988 real 0m17.055s 00:28:13.988 user 0m36.329s 00:28:13.988 sys 0m0.816s 00:28:13.988 09:51:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:13.988 09:51:36 -- common/autotest_common.sh@10 -- # set +x 00:28:13.988 ************************************ 00:28:13.988 END TEST spdkcli_nvmf_tcp 00:28:13.988 ************************************ 00:28:13.988 09:51:36 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:13.988 09:51:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:13.988 09:51:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:13.988 09:51:36 -- common/autotest_common.sh@10 -- # set +x 00:28:13.988 ************************************ 00:28:13.988 START TEST nvmf_identify_passthru 00:28:13.988 ************************************ 00:28:13.988 09:51:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:14.247 * Looking for test storage... 00:28:14.247 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:14.247 09:51:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:14.247 09:51:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:14.247 09:51:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:14.247 09:51:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:14.247 09:51:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:14.247 09:51:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:14.247 09:51:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:14.247 09:51:36 -- scripts/common.sh@335 -- # IFS=.-: 00:28:14.247 09:51:36 -- scripts/common.sh@335 -- # read -ra ver1 00:28:14.247 09:51:36 -- scripts/common.sh@336 -- # IFS=.-: 00:28:14.247 09:51:36 -- scripts/common.sh@336 -- # read -ra ver2 00:28:14.247 09:51:36 -- scripts/common.sh@337 -- # local 'op=<' 00:28:14.247 09:51:36 -- scripts/common.sh@339 -- # ver1_l=2 00:28:14.247 09:51:36 -- scripts/common.sh@340 -- # ver2_l=1 00:28:14.247 09:51:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:14.247 09:51:36 -- scripts/common.sh@343 -- # case "$op" in 00:28:14.247 09:51:36 -- scripts/common.sh@344 -- # : 1 00:28:14.247 09:51:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:14.247 09:51:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:14.247 09:51:36 -- scripts/common.sh@364 -- # decimal 1 00:28:14.247 09:51:36 -- scripts/common.sh@352 -- # local d=1 00:28:14.247 09:51:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:14.247 09:51:36 -- scripts/common.sh@354 -- # echo 1 00:28:14.247 09:51:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:14.247 09:51:36 -- scripts/common.sh@365 -- # decimal 2 00:28:14.247 09:51:36 -- scripts/common.sh@352 -- # local d=2 00:28:14.247 09:51:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:14.247 09:51:36 -- scripts/common.sh@354 -- # echo 2 00:28:14.247 09:51:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:14.247 09:51:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:14.247 09:51:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:14.247 09:51:36 -- scripts/common.sh@367 -- # return 0 00:28:14.247 09:51:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:14.247 09:51:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:14.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:14.247 --rc genhtml_branch_coverage=1 00:28:14.247 --rc genhtml_function_coverage=1 00:28:14.247 --rc genhtml_legend=1 00:28:14.247 --rc geninfo_all_blocks=1 00:28:14.247 --rc geninfo_unexecuted_blocks=1 00:28:14.247 00:28:14.247 ' 00:28:14.247 09:51:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:14.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:14.247 --rc genhtml_branch_coverage=1 00:28:14.247 --rc genhtml_function_coverage=1 00:28:14.247 --rc genhtml_legend=1 00:28:14.247 --rc geninfo_all_blocks=1 00:28:14.247 --rc geninfo_unexecuted_blocks=1 00:28:14.247 00:28:14.247 ' 00:28:14.247 09:51:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:14.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:14.247 --rc genhtml_branch_coverage=1 00:28:14.247 --rc genhtml_function_coverage=1 00:28:14.247 --rc genhtml_legend=1 00:28:14.247 --rc geninfo_all_blocks=1 00:28:14.247 --rc geninfo_unexecuted_blocks=1 00:28:14.247 00:28:14.247 ' 00:28:14.247 09:51:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:14.247 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:14.247 --rc genhtml_branch_coverage=1 00:28:14.247 --rc genhtml_function_coverage=1 00:28:14.247 --rc genhtml_legend=1 00:28:14.247 --rc geninfo_all_blocks=1 00:28:14.247 --rc geninfo_unexecuted_blocks=1 00:28:14.247 00:28:14.247 ' 00:28:14.247 09:51:36 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:14.247 09:51:36 -- nvmf/common.sh@7 -- # uname -s 00:28:14.247 09:51:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:14.247 09:51:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:14.247 09:51:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:14.247 09:51:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:14.247 09:51:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:14.247 09:51:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:14.247 09:51:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:14.247 09:51:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:14.247 09:51:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:14.247 09:51:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:14.247 09:51:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:14.247 09:51:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:14.247 09:51:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:14.247 09:51:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:14.247 09:51:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:14.247 09:51:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:14.247 09:51:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:14.247 09:51:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:14.247 09:51:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:14.247 09:51:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.247 09:51:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.247 09:51:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.247 09:51:36 -- paths/export.sh@5 -- # export PATH 00:28:14.247 09:51:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.248 09:51:36 -- nvmf/common.sh@46 -- # : 0 00:28:14.248 09:51:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:14.248 09:51:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:14.248 09:51:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:14.248 09:51:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:14.248 09:51:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:14.248 09:51:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:14.248 09:51:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:14.248 09:51:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:14.248 09:51:36 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:14.248 09:51:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:14.248 09:51:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:14.248 09:51:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:14.248 09:51:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.248 09:51:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.248 09:51:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.248 09:51:36 -- paths/export.sh@5 -- # export PATH 00:28:14.248 09:51:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.248 09:51:36 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:14.248 09:51:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:14.248 09:51:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:14.248 09:51:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:14.248 09:51:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:14.248 09:51:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:14.248 09:51:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:14.248 09:51:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:14.248 09:51:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:14.248 09:51:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:14.248 09:51:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:14.248 09:51:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:14.248 09:51:36 -- common/autotest_common.sh@10 -- # set +x 00:28:16.782 09:51:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:16.782 09:51:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:16.782 09:51:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:16.782 09:51:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:16.782 09:51:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:16.782 09:51:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:16.782 09:51:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:16.782 09:51:39 -- nvmf/common.sh@294 -- # net_devs=() 00:28:16.782 09:51:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:16.782 09:51:39 -- nvmf/common.sh@295 -- # e810=() 00:28:16.782 09:51:39 -- nvmf/common.sh@295 -- # local -ga e810 00:28:16.782 09:51:39 -- nvmf/common.sh@296 -- # x722=() 00:28:16.782 09:51:39 -- nvmf/common.sh@296 -- # local -ga x722 00:28:16.782 09:51:39 -- nvmf/common.sh@297 -- # mlx=() 00:28:16.782 09:51:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:16.782 09:51:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:16.782 09:51:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:16.782 09:51:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:16.782 09:51:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:16.782 09:51:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:16.782 09:51:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:16.782 09:51:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:16.782 09:51:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:16.782 09:51:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:16.782 09:51:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:16.783 09:51:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:16.783 09:51:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:16.783 09:51:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:16.783 09:51:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:16.783 09:51:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:16.783 09:51:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:16.783 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:16.783 09:51:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:16.783 09:51:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:16.783 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:16.783 09:51:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:16.783 09:51:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:16.783 09:51:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:16.783 09:51:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:16.783 09:51:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:16.783 09:51:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:16.783 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:16.783 09:51:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:16.783 09:51:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:16.783 09:51:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:16.783 09:51:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:16.783 09:51:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:16.783 09:51:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:16.783 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:16.783 09:51:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:16.783 09:51:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:16.783 09:51:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:16.783 09:51:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:16.783 09:51:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:16.783 09:51:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:16.783 09:51:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:16.783 09:51:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:16.783 09:51:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:16.783 09:51:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:16.783 09:51:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:16.783 09:51:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:16.783 09:51:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:16.783 09:51:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:16.783 09:51:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:16.783 09:51:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:16.783 09:51:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:16.783 09:51:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:16.783 09:51:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:16.783 09:51:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:16.783 09:51:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:16.783 09:51:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:16.783 09:51:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:16.783 09:51:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:16.783 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:16.783 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.260 ms 00:28:16.783 00:28:16.783 --- 10.0.0.2 ping statistics --- 00:28:16.783 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:16.783 rtt min/avg/max/mdev = 0.260/0.260/0.260/0.000 ms 00:28:16.783 09:51:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:16.783 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:16.783 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.068 ms 00:28:16.783 00:28:16.783 --- 10.0.0.1 ping statistics --- 00:28:16.783 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:16.783 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:28:16.783 09:51:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:16.783 09:51:39 -- nvmf/common.sh@410 -- # return 0 00:28:16.783 09:51:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:16.783 09:51:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:16.783 09:51:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:16.783 09:51:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:16.783 09:51:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:16.783 09:51:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:16.783 09:51:39 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:16.783 09:51:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:16.783 09:51:39 -- common/autotest_common.sh@10 -- # set +x 00:28:16.783 09:51:39 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:16.783 09:51:39 -- common/autotest_common.sh@1519 -- # bdfs=() 00:28:16.783 09:51:39 -- common/autotest_common.sh@1519 -- # local bdfs 00:28:16.783 09:51:39 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:28:16.783 09:51:39 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:28:16.783 09:51:39 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:16.783 09:51:39 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:16.783 09:51:39 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:16.783 09:51:39 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:16.783 09:51:39 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:16.783 09:51:39 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:16.783 09:51:39 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:16.783 09:51:39 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:28:16.783 09:51:39 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:16.783 09:51:39 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:16.783 09:51:39 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:16.783 09:51:39 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:16.783 09:51:39 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:16.783 EAL: No free 2048 kB hugepages reported on node 1 00:28:20.980 09:51:43 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:20.980 09:51:43 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:20.980 09:51:43 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:20.980 09:51:43 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:20.980 EAL: No free 2048 kB hugepages reported on node 1 00:28:25.175 09:51:47 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:25.175 09:51:47 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:25.175 09:51:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:25.175 09:51:47 -- common/autotest_common.sh@10 -- # set +x 00:28:25.175 09:51:47 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:25.175 09:51:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:25.175 09:51:47 -- common/autotest_common.sh@10 -- # set +x 00:28:25.175 09:51:47 -- target/identify_passthru.sh@31 -- # nvmfpid=155753 00:28:25.175 09:51:47 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:25.175 09:51:47 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:25.175 09:51:47 -- target/identify_passthru.sh@35 -- # waitforlisten 155753 00:28:25.175 09:51:47 -- common/autotest_common.sh@829 -- # '[' -z 155753 ']' 00:28:25.175 09:51:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:25.175 09:51:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:25.175 09:51:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:25.175 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:25.175 09:51:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:25.175 09:51:47 -- common/autotest_common.sh@10 -- # set +x 00:28:25.175 [2024-11-29 09:51:47.751715] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:25.175 [2024-11-29 09:51:47.751798] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:25.175 EAL: No free 2048 kB hugepages reported on node 1 00:28:25.175 [2024-11-29 09:51:47.816550] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:25.175 [2024-11-29 09:51:47.925461] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:25.175 [2024-11-29 09:51:47.925601] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:25.175 [2024-11-29 09:51:47.925618] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:25.175 [2024-11-29 09:51:47.925630] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:25.175 [2024-11-29 09:51:47.925688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:25.176 [2024-11-29 09:51:47.925750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:25.176 [2024-11-29 09:51:47.925813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:25.176 [2024-11-29 09:51:47.925818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:25.176 09:51:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:25.176 09:51:47 -- common/autotest_common.sh@862 -- # return 0 00:28:25.176 09:51:47 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:25.176 09:51:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.176 09:51:47 -- common/autotest_common.sh@10 -- # set +x 00:28:25.176 INFO: Log level set to 20 00:28:25.176 INFO: Requests: 00:28:25.176 { 00:28:25.176 "jsonrpc": "2.0", 00:28:25.176 "method": "nvmf_set_config", 00:28:25.176 "id": 1, 00:28:25.176 "params": { 00:28:25.176 "admin_cmd_passthru": { 00:28:25.176 "identify_ctrlr": true 00:28:25.176 } 00:28:25.176 } 00:28:25.176 } 00:28:25.176 00:28:25.176 INFO: response: 00:28:25.176 { 00:28:25.176 "jsonrpc": "2.0", 00:28:25.176 "id": 1, 00:28:25.176 "result": true 00:28:25.176 } 00:28:25.176 00:28:25.176 09:51:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.176 09:51:47 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:25.176 09:51:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.176 09:51:47 -- common/autotest_common.sh@10 -- # set +x 00:28:25.176 INFO: Setting log level to 20 00:28:25.176 INFO: Setting log level to 20 00:28:25.176 INFO: Log level set to 20 00:28:25.176 INFO: Log level set to 20 00:28:25.176 INFO: Requests: 00:28:25.176 { 00:28:25.176 "jsonrpc": "2.0", 00:28:25.176 "method": "framework_start_init", 00:28:25.176 "id": 1 00:28:25.176 } 00:28:25.176 00:28:25.176 INFO: Requests: 00:28:25.176 { 00:28:25.176 "jsonrpc": "2.0", 00:28:25.176 "method": "framework_start_init", 00:28:25.176 "id": 1 00:28:25.176 } 00:28:25.176 00:28:25.434 [2024-11-29 09:51:48.086623] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:25.434 INFO: response: 00:28:25.434 { 00:28:25.434 "jsonrpc": "2.0", 00:28:25.434 "id": 1, 00:28:25.434 "result": true 00:28:25.434 } 00:28:25.434 00:28:25.434 INFO: response: 00:28:25.434 { 00:28:25.434 "jsonrpc": "2.0", 00:28:25.434 "id": 1, 00:28:25.434 "result": true 00:28:25.434 } 00:28:25.434 00:28:25.434 09:51:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.434 09:51:48 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:25.434 09:51:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.434 09:51:48 -- common/autotest_common.sh@10 -- # set +x 00:28:25.434 INFO: Setting log level to 40 00:28:25.434 INFO: Setting log level to 40 00:28:25.434 INFO: Setting log level to 40 00:28:25.434 [2024-11-29 09:51:48.096625] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:25.434 09:51:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.434 09:51:48 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:25.434 09:51:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:25.434 09:51:48 -- common/autotest_common.sh@10 -- # set +x 00:28:25.434 09:51:48 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:25.434 09:51:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.434 09:51:48 -- common/autotest_common.sh@10 -- # set +x 00:28:28.725 Nvme0n1 00:28:28.725 09:51:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.725 09:51:50 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:28.725 09:51:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.725 09:51:50 -- common/autotest_common.sh@10 -- # set +x 00:28:28.725 09:51:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.725 09:51:50 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:28.725 09:51:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.725 09:51:50 -- common/autotest_common.sh@10 -- # set +x 00:28:28.725 09:51:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.725 09:51:50 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:28.725 09:51:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.725 09:51:50 -- common/autotest_common.sh@10 -- # set +x 00:28:28.725 [2024-11-29 09:51:50.989030] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:28.725 09:51:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.725 09:51:50 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:28.725 09:51:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.725 09:51:50 -- common/autotest_common.sh@10 -- # set +x 00:28:28.725 [2024-11-29 09:51:50.996733] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:28.725 [ 00:28:28.725 { 00:28:28.725 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:28.725 "subtype": "Discovery", 00:28:28.725 "listen_addresses": [], 00:28:28.725 "allow_any_host": true, 00:28:28.725 "hosts": [] 00:28:28.725 }, 00:28:28.725 { 00:28:28.725 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:28.725 "subtype": "NVMe", 00:28:28.725 "listen_addresses": [ 00:28:28.725 { 00:28:28.725 "transport": "TCP", 00:28:28.725 "trtype": "TCP", 00:28:28.725 "adrfam": "IPv4", 00:28:28.725 "traddr": "10.0.0.2", 00:28:28.725 "trsvcid": "4420" 00:28:28.725 } 00:28:28.725 ], 00:28:28.725 "allow_any_host": true, 00:28:28.725 "hosts": [], 00:28:28.725 "serial_number": "SPDK00000000000001", 00:28:28.725 "model_number": "SPDK bdev Controller", 00:28:28.725 "max_namespaces": 1, 00:28:28.725 "min_cntlid": 1, 00:28:28.725 "max_cntlid": 65519, 00:28:28.725 "namespaces": [ 00:28:28.725 { 00:28:28.725 "nsid": 1, 00:28:28.725 "bdev_name": "Nvme0n1", 00:28:28.725 "name": "Nvme0n1", 00:28:28.725 "nguid": "7037B81092024160B7B326B56A2F87D2", 00:28:28.725 "uuid": "7037b810-9202-4160-b7b3-26b56a2f87d2" 00:28:28.725 } 00:28:28.725 ] 00:28:28.725 } 00:28:28.725 ] 00:28:28.725 09:51:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.725 09:51:51 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:28.725 09:51:51 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:28.725 09:51:51 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:28.725 EAL: No free 2048 kB hugepages reported on node 1 00:28:28.725 09:51:51 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:28.725 09:51:51 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:28.725 09:51:51 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:28.725 09:51:51 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:28.725 EAL: No free 2048 kB hugepages reported on node 1 00:28:28.725 09:51:51 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:28.725 09:51:51 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:28.725 09:51:51 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:28.725 09:51:51 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:28.725 09:51:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:28.725 09:51:51 -- common/autotest_common.sh@10 -- # set +x 00:28:28.725 09:51:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:28.725 09:51:51 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:28.725 09:51:51 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:28.725 09:51:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:28.726 09:51:51 -- nvmf/common.sh@116 -- # sync 00:28:28.726 09:51:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:28.726 09:51:51 -- nvmf/common.sh@119 -- # set +e 00:28:28.726 09:51:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:28.726 09:51:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:28.726 rmmod nvme_tcp 00:28:28.726 rmmod nvme_fabrics 00:28:28.726 rmmod nvme_keyring 00:28:28.726 09:51:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:28.726 09:51:51 -- nvmf/common.sh@123 -- # set -e 00:28:28.726 09:51:51 -- nvmf/common.sh@124 -- # return 0 00:28:28.726 09:51:51 -- nvmf/common.sh@477 -- # '[' -n 155753 ']' 00:28:28.726 09:51:51 -- nvmf/common.sh@478 -- # killprocess 155753 00:28:28.726 09:51:51 -- common/autotest_common.sh@936 -- # '[' -z 155753 ']' 00:28:28.726 09:51:51 -- common/autotest_common.sh@940 -- # kill -0 155753 00:28:28.726 09:51:51 -- common/autotest_common.sh@941 -- # uname 00:28:28.726 09:51:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:28.726 09:51:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 155753 00:28:28.726 09:51:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:28.726 09:51:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:28.726 09:51:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 155753' 00:28:28.726 killing process with pid 155753 00:28:28.726 09:51:51 -- common/autotest_common.sh@955 -- # kill 155753 00:28:28.726 [2024-11-29 09:51:51.544122] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:28.726 09:51:51 -- common/autotest_common.sh@960 -- # wait 155753 00:28:30.691 09:51:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:30.691 09:51:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:30.691 09:51:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:30.691 09:51:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:30.691 09:51:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:30.691 09:51:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:30.691 09:51:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:30.691 09:51:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:32.596 09:51:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:32.596 00:28:32.596 real 0m18.365s 00:28:32.596 user 0m27.249s 00:28:32.596 sys 0m2.461s 00:28:32.596 09:51:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:32.596 09:51:55 -- common/autotest_common.sh@10 -- # set +x 00:28:32.596 ************************************ 00:28:32.596 END TEST nvmf_identify_passthru 00:28:32.596 ************************************ 00:28:32.596 09:51:55 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:32.596 09:51:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:32.596 09:51:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:32.596 09:51:55 -- common/autotest_common.sh@10 -- # set +x 00:28:32.596 ************************************ 00:28:32.596 START TEST nvmf_dif 00:28:32.596 ************************************ 00:28:32.596 09:51:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:32.596 * Looking for test storage... 00:28:32.596 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:32.596 09:51:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:32.596 09:51:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:32.596 09:51:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:32.596 09:51:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:32.596 09:51:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:32.597 09:51:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:32.597 09:51:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:32.597 09:51:55 -- scripts/common.sh@335 -- # IFS=.-: 00:28:32.597 09:51:55 -- scripts/common.sh@335 -- # read -ra ver1 00:28:32.597 09:51:55 -- scripts/common.sh@336 -- # IFS=.-: 00:28:32.597 09:51:55 -- scripts/common.sh@336 -- # read -ra ver2 00:28:32.597 09:51:55 -- scripts/common.sh@337 -- # local 'op=<' 00:28:32.597 09:51:55 -- scripts/common.sh@339 -- # ver1_l=2 00:28:32.597 09:51:55 -- scripts/common.sh@340 -- # ver2_l=1 00:28:32.597 09:51:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:32.597 09:51:55 -- scripts/common.sh@343 -- # case "$op" in 00:28:32.597 09:51:55 -- scripts/common.sh@344 -- # : 1 00:28:32.597 09:51:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:32.597 09:51:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:32.597 09:51:55 -- scripts/common.sh@364 -- # decimal 1 00:28:32.597 09:51:55 -- scripts/common.sh@352 -- # local d=1 00:28:32.597 09:51:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:32.597 09:51:55 -- scripts/common.sh@354 -- # echo 1 00:28:32.597 09:51:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:32.597 09:51:55 -- scripts/common.sh@365 -- # decimal 2 00:28:32.597 09:51:55 -- scripts/common.sh@352 -- # local d=2 00:28:32.597 09:51:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:32.597 09:51:55 -- scripts/common.sh@354 -- # echo 2 00:28:32.597 09:51:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:32.597 09:51:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:32.597 09:51:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:32.597 09:51:55 -- scripts/common.sh@367 -- # return 0 00:28:32.597 09:51:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:32.597 09:51:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:32.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:32.597 --rc genhtml_branch_coverage=1 00:28:32.597 --rc genhtml_function_coverage=1 00:28:32.597 --rc genhtml_legend=1 00:28:32.597 --rc geninfo_all_blocks=1 00:28:32.597 --rc geninfo_unexecuted_blocks=1 00:28:32.597 00:28:32.597 ' 00:28:32.597 09:51:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:32.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:32.597 --rc genhtml_branch_coverage=1 00:28:32.597 --rc genhtml_function_coverage=1 00:28:32.597 --rc genhtml_legend=1 00:28:32.597 --rc geninfo_all_blocks=1 00:28:32.597 --rc geninfo_unexecuted_blocks=1 00:28:32.597 00:28:32.597 ' 00:28:32.597 09:51:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:32.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:32.597 --rc genhtml_branch_coverage=1 00:28:32.597 --rc genhtml_function_coverage=1 00:28:32.597 --rc genhtml_legend=1 00:28:32.597 --rc geninfo_all_blocks=1 00:28:32.597 --rc geninfo_unexecuted_blocks=1 00:28:32.597 00:28:32.597 ' 00:28:32.597 09:51:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:32.597 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:32.597 --rc genhtml_branch_coverage=1 00:28:32.597 --rc genhtml_function_coverage=1 00:28:32.597 --rc genhtml_legend=1 00:28:32.597 --rc geninfo_all_blocks=1 00:28:32.597 --rc geninfo_unexecuted_blocks=1 00:28:32.597 00:28:32.597 ' 00:28:32.597 09:51:55 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:32.597 09:51:55 -- nvmf/common.sh@7 -- # uname -s 00:28:32.597 09:51:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:32.597 09:51:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:32.597 09:51:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:32.597 09:51:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:32.597 09:51:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:32.597 09:51:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:32.597 09:51:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:32.597 09:51:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:32.597 09:51:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:32.597 09:51:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:32.597 09:51:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:32.597 09:51:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:32.597 09:51:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:32.597 09:51:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:32.597 09:51:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:32.597 09:51:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:32.597 09:51:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:32.597 09:51:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:32.597 09:51:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:32.597 09:51:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:32.597 09:51:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:32.597 09:51:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:32.597 09:51:55 -- paths/export.sh@5 -- # export PATH 00:28:32.597 09:51:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:32.597 09:51:55 -- nvmf/common.sh@46 -- # : 0 00:28:32.597 09:51:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:32.597 09:51:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:32.597 09:51:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:32.597 09:51:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:32.597 09:51:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:32.597 09:51:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:32.597 09:51:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:32.597 09:51:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:32.597 09:51:55 -- target/dif.sh@15 -- # NULL_META=16 00:28:32.597 09:51:55 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:32.598 09:51:55 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:32.598 09:51:55 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:32.598 09:51:55 -- target/dif.sh@135 -- # nvmftestinit 00:28:32.598 09:51:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:32.598 09:51:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:32.598 09:51:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:32.598 09:51:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:32.598 09:51:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:32.598 09:51:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:32.598 09:51:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:32.598 09:51:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:32.598 09:51:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:32.598 09:51:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:32.598 09:51:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:32.598 09:51:55 -- common/autotest_common.sh@10 -- # set +x 00:28:35.133 09:51:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:35.133 09:51:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:35.133 09:51:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:35.133 09:51:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:35.133 09:51:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:35.133 09:51:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:35.133 09:51:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:35.133 09:51:57 -- nvmf/common.sh@294 -- # net_devs=() 00:28:35.133 09:51:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:35.133 09:51:57 -- nvmf/common.sh@295 -- # e810=() 00:28:35.133 09:51:57 -- nvmf/common.sh@295 -- # local -ga e810 00:28:35.133 09:51:57 -- nvmf/common.sh@296 -- # x722=() 00:28:35.133 09:51:57 -- nvmf/common.sh@296 -- # local -ga x722 00:28:35.133 09:51:57 -- nvmf/common.sh@297 -- # mlx=() 00:28:35.133 09:51:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:35.133 09:51:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:35.133 09:51:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:35.133 09:51:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:35.133 09:51:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:35.133 09:51:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:35.133 09:51:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:35.133 09:51:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:35.133 09:51:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:35.133 09:51:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:35.133 09:51:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:35.133 09:51:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:35.133 09:51:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:35.133 09:51:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:35.133 09:51:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:35.133 09:51:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:35.133 09:51:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:35.133 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:35.133 09:51:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:35.133 09:51:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:35.133 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:35.133 09:51:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:35.133 09:51:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:35.133 09:51:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:35.133 09:51:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:35.133 09:51:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:35.133 09:51:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:35.133 09:51:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:35.133 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:35.133 09:51:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:35.134 09:51:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:35.134 09:51:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:35.134 09:51:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:35.134 09:51:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:35.134 09:51:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:35.134 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:35.134 09:51:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:35.134 09:51:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:35.134 09:51:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:35.134 09:51:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:35.134 09:51:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:35.134 09:51:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:35.134 09:51:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:35.134 09:51:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:35.134 09:51:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:35.134 09:51:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:35.134 09:51:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:35.134 09:51:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:35.134 09:51:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:35.134 09:51:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:35.134 09:51:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:35.134 09:51:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:35.134 09:51:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:35.134 09:51:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:35.134 09:51:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:35.134 09:51:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:35.134 09:51:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:35.134 09:51:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:35.134 09:51:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:35.134 09:51:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:35.134 09:51:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:35.134 09:51:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:35.134 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:35.134 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:28:35.134 00:28:35.134 --- 10.0.0.2 ping statistics --- 00:28:35.134 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:35.134 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:28:35.134 09:51:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:35.134 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:35.134 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:28:35.134 00:28:35.134 --- 10.0.0.1 ping statistics --- 00:28:35.134 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:35.134 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:28:35.134 09:51:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:35.134 09:51:57 -- nvmf/common.sh@410 -- # return 0 00:28:35.134 09:51:57 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:35.134 09:51:57 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:36.073 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:36.073 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:36.073 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:36.073 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:36.073 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:36.073 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:36.073 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:36.073 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:36.073 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:36.073 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:36.073 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:36.073 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:36.073 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:36.073 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:36.073 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:36.073 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:36.073 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:36.073 09:51:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:36.073 09:51:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:36.073 09:51:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:36.073 09:51:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:36.073 09:51:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:36.073 09:51:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:36.073 09:51:58 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:36.073 09:51:58 -- target/dif.sh@137 -- # nvmfappstart 00:28:36.073 09:51:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:36.073 09:51:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:36.073 09:51:58 -- common/autotest_common.sh@10 -- # set +x 00:28:36.073 09:51:58 -- nvmf/common.sh@469 -- # nvmfpid=159079 00:28:36.073 09:51:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:36.073 09:51:58 -- nvmf/common.sh@470 -- # waitforlisten 159079 00:28:36.073 09:51:58 -- common/autotest_common.sh@829 -- # '[' -z 159079 ']' 00:28:36.073 09:51:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:36.073 09:51:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:36.073 09:51:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:36.073 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:36.073 09:51:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:36.073 09:51:58 -- common/autotest_common.sh@10 -- # set +x 00:28:36.073 [2024-11-29 09:51:58.902010] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:36.073 [2024-11-29 09:51:58.902091] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:36.333 EAL: No free 2048 kB hugepages reported on node 1 00:28:36.333 [2024-11-29 09:51:58.966974] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:36.333 [2024-11-29 09:51:59.074119] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:36.333 [2024-11-29 09:51:59.074269] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:36.333 [2024-11-29 09:51:59.074284] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:36.333 [2024-11-29 09:51:59.074296] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:36.333 [2024-11-29 09:51:59.074330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:37.269 09:51:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:37.269 09:51:59 -- common/autotest_common.sh@862 -- # return 0 00:28:37.269 09:51:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:37.269 09:51:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:37.269 09:51:59 -- common/autotest_common.sh@10 -- # set +x 00:28:37.269 09:51:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:37.269 09:51:59 -- target/dif.sh@139 -- # create_transport 00:28:37.269 09:51:59 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:37.269 09:51:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.269 09:51:59 -- common/autotest_common.sh@10 -- # set +x 00:28:37.269 [2024-11-29 09:51:59.892809] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:37.269 09:51:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.269 09:51:59 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:37.269 09:51:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:37.269 09:51:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:37.269 09:51:59 -- common/autotest_common.sh@10 -- # set +x 00:28:37.269 ************************************ 00:28:37.269 START TEST fio_dif_1_default 00:28:37.269 ************************************ 00:28:37.269 09:51:59 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:37.269 09:51:59 -- target/dif.sh@86 -- # create_subsystems 0 00:28:37.269 09:51:59 -- target/dif.sh@28 -- # local sub 00:28:37.269 09:51:59 -- target/dif.sh@30 -- # for sub in "$@" 00:28:37.269 09:51:59 -- target/dif.sh@31 -- # create_subsystem 0 00:28:37.269 09:51:59 -- target/dif.sh@18 -- # local sub_id=0 00:28:37.269 09:51:59 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:37.269 09:51:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.269 09:51:59 -- common/autotest_common.sh@10 -- # set +x 00:28:37.269 bdev_null0 00:28:37.269 09:51:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.269 09:51:59 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:37.269 09:51:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.269 09:51:59 -- common/autotest_common.sh@10 -- # set +x 00:28:37.269 09:51:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.270 09:51:59 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:37.270 09:51:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.270 09:51:59 -- common/autotest_common.sh@10 -- # set +x 00:28:37.270 09:51:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.270 09:51:59 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:37.270 09:51:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.270 09:51:59 -- common/autotest_common.sh@10 -- # set +x 00:28:37.270 [2024-11-29 09:51:59.929063] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:37.270 09:51:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.270 09:51:59 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:37.270 09:51:59 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:37.270 09:51:59 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:37.270 09:51:59 -- nvmf/common.sh@520 -- # config=() 00:28:37.270 09:51:59 -- nvmf/common.sh@520 -- # local subsystem config 00:28:37.270 09:51:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:37.270 09:51:59 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:37.270 09:51:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:37.270 { 00:28:37.270 "params": { 00:28:37.270 "name": "Nvme$subsystem", 00:28:37.270 "trtype": "$TEST_TRANSPORT", 00:28:37.270 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:37.270 "adrfam": "ipv4", 00:28:37.270 "trsvcid": "$NVMF_PORT", 00:28:37.270 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:37.270 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:37.270 "hdgst": ${hdgst:-false}, 00:28:37.270 "ddgst": ${ddgst:-false} 00:28:37.270 }, 00:28:37.270 "method": "bdev_nvme_attach_controller" 00:28:37.270 } 00:28:37.270 EOF 00:28:37.270 )") 00:28:37.270 09:51:59 -- target/dif.sh@82 -- # gen_fio_conf 00:28:37.270 09:51:59 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:37.270 09:51:59 -- target/dif.sh@54 -- # local file 00:28:37.270 09:51:59 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:37.270 09:51:59 -- target/dif.sh@56 -- # cat 00:28:37.270 09:51:59 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:37.270 09:51:59 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:37.270 09:51:59 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:37.270 09:51:59 -- common/autotest_common.sh@1330 -- # shift 00:28:37.270 09:51:59 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:37.270 09:51:59 -- nvmf/common.sh@542 -- # cat 00:28:37.270 09:51:59 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:37.270 09:51:59 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:37.270 09:51:59 -- target/dif.sh@72 -- # (( file <= files )) 00:28:37.270 09:51:59 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:37.270 09:51:59 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:37.270 09:51:59 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:37.270 09:51:59 -- nvmf/common.sh@544 -- # jq . 00:28:37.270 09:51:59 -- nvmf/common.sh@545 -- # IFS=, 00:28:37.270 09:51:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:37.270 "params": { 00:28:37.270 "name": "Nvme0", 00:28:37.270 "trtype": "tcp", 00:28:37.270 "traddr": "10.0.0.2", 00:28:37.270 "adrfam": "ipv4", 00:28:37.270 "trsvcid": "4420", 00:28:37.270 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:37.270 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:37.270 "hdgst": false, 00:28:37.270 "ddgst": false 00:28:37.270 }, 00:28:37.270 "method": "bdev_nvme_attach_controller" 00:28:37.270 }' 00:28:37.270 09:51:59 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:37.270 09:51:59 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:37.270 09:51:59 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:37.270 09:51:59 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:37.270 09:51:59 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:37.270 09:51:59 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:37.270 09:51:59 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:37.270 09:51:59 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:37.270 09:51:59 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:37.270 09:51:59 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:37.528 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:37.528 fio-3.35 00:28:37.528 Starting 1 thread 00:28:37.528 EAL: No free 2048 kB hugepages reported on node 1 00:28:38.095 [2024-11-29 09:52:00.745077] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:38.095 [2024-11-29 09:52:00.745129] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:48.064 00:28:48.064 filename0: (groupid=0, jobs=1): err= 0: pid=159440: Fri Nov 29 09:52:10 2024 00:28:48.064 read: IOPS=190, BW=761KiB/s (780kB/s)(7632KiB/10023msec) 00:28:48.064 slat (nsec): min=4640, max=53052, avg=8334.58, stdev=2778.16 00:28:48.064 clat (usec): min=555, max=42430, avg=20984.87, stdev=20368.92 00:28:48.064 lat (usec): min=562, max=42441, avg=20993.20, stdev=20368.64 00:28:48.064 clat percentiles (usec): 00:28:48.064 | 1.00th=[ 578], 5.00th=[ 594], 10.00th=[ 611], 20.00th=[ 627], 00:28:48.064 | 30.00th=[ 644], 40.00th=[ 676], 50.00th=[ 6652], 60.00th=[41157], 00:28:48.064 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:48.064 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:28:48.064 | 99.99th=[42206] 00:28:48.064 bw ( KiB/s): min= 704, max= 768, per=99.94%, avg=761.60, stdev=19.70, samples=20 00:28:48.064 iops : min= 176, max= 192, avg=190.40, stdev= 4.92, samples=20 00:28:48.064 lat (usec) : 750=49.21%, 1000=0.68% 00:28:48.064 lat (msec) : 10=0.21%, 50=49.90% 00:28:48.064 cpu : usr=91.84%, sys=7.85%, ctx=25, majf=0, minf=272 00:28:48.064 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:48.064 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:48.064 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:48.064 issued rwts: total=1908,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:48.064 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:48.064 00:28:48.064 Run status group 0 (all jobs): 00:28:48.064 READ: bw=761KiB/s (780kB/s), 761KiB/s-761KiB/s (780kB/s-780kB/s), io=7632KiB (7815kB), run=10023-10023msec 00:28:48.631 09:52:11 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:48.632 09:52:11 -- target/dif.sh@43 -- # local sub 00:28:48.632 09:52:11 -- target/dif.sh@45 -- # for sub in "$@" 00:28:48.632 09:52:11 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:48.632 09:52:11 -- target/dif.sh@36 -- # local sub_id=0 00:28:48.632 09:52:11 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:48.632 09:52:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.632 09:52:11 -- common/autotest_common.sh@10 -- # set +x 00:28:48.632 09:52:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.632 09:52:11 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:48.632 09:52:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.632 09:52:11 -- common/autotest_common.sh@10 -- # set +x 00:28:48.632 09:52:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.632 00:28:48.632 real 0m11.325s 00:28:48.632 user 0m10.487s 00:28:48.632 sys 0m1.090s 00:28:48.632 09:52:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:48.632 09:52:11 -- common/autotest_common.sh@10 -- # set +x 00:28:48.632 ************************************ 00:28:48.632 END TEST fio_dif_1_default 00:28:48.632 ************************************ 00:28:48.632 09:52:11 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:48.632 09:52:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:48.632 09:52:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:48.632 09:52:11 -- common/autotest_common.sh@10 -- # set +x 00:28:48.632 ************************************ 00:28:48.632 START TEST fio_dif_1_multi_subsystems 00:28:48.632 ************************************ 00:28:48.632 09:52:11 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:28:48.632 09:52:11 -- target/dif.sh@92 -- # local files=1 00:28:48.632 09:52:11 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:48.632 09:52:11 -- target/dif.sh@28 -- # local sub 00:28:48.632 09:52:11 -- target/dif.sh@30 -- # for sub in "$@" 00:28:48.632 09:52:11 -- target/dif.sh@31 -- # create_subsystem 0 00:28:48.632 09:52:11 -- target/dif.sh@18 -- # local sub_id=0 00:28:48.632 09:52:11 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:48.632 09:52:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.632 09:52:11 -- common/autotest_common.sh@10 -- # set +x 00:28:48.632 bdev_null0 00:28:48.632 09:52:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.632 09:52:11 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:48.632 09:52:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.632 09:52:11 -- common/autotest_common.sh@10 -- # set +x 00:28:48.632 09:52:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.632 09:52:11 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:48.632 09:52:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.632 09:52:11 -- common/autotest_common.sh@10 -- # set +x 00:28:48.632 09:52:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.632 09:52:11 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:48.632 09:52:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.632 09:52:11 -- common/autotest_common.sh@10 -- # set +x 00:28:48.632 [2024-11-29 09:52:11.278054] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:48.632 09:52:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.632 09:52:11 -- target/dif.sh@30 -- # for sub in "$@" 00:28:48.632 09:52:11 -- target/dif.sh@31 -- # create_subsystem 1 00:28:48.632 09:52:11 -- target/dif.sh@18 -- # local sub_id=1 00:28:48.632 09:52:11 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:48.632 09:52:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.632 09:52:11 -- common/autotest_common.sh@10 -- # set +x 00:28:48.632 bdev_null1 00:28:48.632 09:52:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.632 09:52:11 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:48.632 09:52:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.632 09:52:11 -- common/autotest_common.sh@10 -- # set +x 00:28:48.632 09:52:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.632 09:52:11 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:48.632 09:52:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.632 09:52:11 -- common/autotest_common.sh@10 -- # set +x 00:28:48.632 09:52:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.632 09:52:11 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:48.632 09:52:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.632 09:52:11 -- common/autotest_common.sh@10 -- # set +x 00:28:48.632 09:52:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.632 09:52:11 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:48.632 09:52:11 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:48.632 09:52:11 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:48.632 09:52:11 -- nvmf/common.sh@520 -- # config=() 00:28:48.632 09:52:11 -- nvmf/common.sh@520 -- # local subsystem config 00:28:48.632 09:52:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:48.632 09:52:11 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:48.632 09:52:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:48.632 { 00:28:48.632 "params": { 00:28:48.632 "name": "Nvme$subsystem", 00:28:48.632 "trtype": "$TEST_TRANSPORT", 00:28:48.632 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:48.632 "adrfam": "ipv4", 00:28:48.632 "trsvcid": "$NVMF_PORT", 00:28:48.632 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:48.632 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:48.632 "hdgst": ${hdgst:-false}, 00:28:48.632 "ddgst": ${ddgst:-false} 00:28:48.632 }, 00:28:48.632 "method": "bdev_nvme_attach_controller" 00:28:48.632 } 00:28:48.632 EOF 00:28:48.632 )") 00:28:48.632 09:52:11 -- target/dif.sh@82 -- # gen_fio_conf 00:28:48.632 09:52:11 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:48.632 09:52:11 -- target/dif.sh@54 -- # local file 00:28:48.632 09:52:11 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:48.632 09:52:11 -- target/dif.sh@56 -- # cat 00:28:48.632 09:52:11 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:48.632 09:52:11 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:48.632 09:52:11 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:48.632 09:52:11 -- common/autotest_common.sh@1330 -- # shift 00:28:48.632 09:52:11 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:48.632 09:52:11 -- nvmf/common.sh@542 -- # cat 00:28:48.632 09:52:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:48.632 09:52:11 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:48.632 09:52:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:48.632 09:52:11 -- target/dif.sh@72 -- # (( file <= files )) 00:28:48.632 09:52:11 -- target/dif.sh@73 -- # cat 00:28:48.632 09:52:11 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:48.632 09:52:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:48.632 09:52:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:48.632 09:52:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:48.632 { 00:28:48.633 "params": { 00:28:48.633 "name": "Nvme$subsystem", 00:28:48.633 "trtype": "$TEST_TRANSPORT", 00:28:48.633 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:48.633 "adrfam": "ipv4", 00:28:48.633 "trsvcid": "$NVMF_PORT", 00:28:48.633 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:48.633 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:48.633 "hdgst": ${hdgst:-false}, 00:28:48.633 "ddgst": ${ddgst:-false} 00:28:48.633 }, 00:28:48.633 "method": "bdev_nvme_attach_controller" 00:28:48.633 } 00:28:48.633 EOF 00:28:48.633 )") 00:28:48.633 09:52:11 -- nvmf/common.sh@542 -- # cat 00:28:48.633 09:52:11 -- target/dif.sh@72 -- # (( file++ )) 00:28:48.633 09:52:11 -- target/dif.sh@72 -- # (( file <= files )) 00:28:48.633 09:52:11 -- nvmf/common.sh@544 -- # jq . 00:28:48.633 09:52:11 -- nvmf/common.sh@545 -- # IFS=, 00:28:48.633 09:52:11 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:48.633 "params": { 00:28:48.633 "name": "Nvme0", 00:28:48.633 "trtype": "tcp", 00:28:48.633 "traddr": "10.0.0.2", 00:28:48.633 "adrfam": "ipv4", 00:28:48.633 "trsvcid": "4420", 00:28:48.633 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:48.633 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:48.633 "hdgst": false, 00:28:48.633 "ddgst": false 00:28:48.633 }, 00:28:48.633 "method": "bdev_nvme_attach_controller" 00:28:48.633 },{ 00:28:48.633 "params": { 00:28:48.633 "name": "Nvme1", 00:28:48.633 "trtype": "tcp", 00:28:48.633 "traddr": "10.0.0.2", 00:28:48.633 "adrfam": "ipv4", 00:28:48.633 "trsvcid": "4420", 00:28:48.633 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:48.633 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:48.633 "hdgst": false, 00:28:48.633 "ddgst": false 00:28:48.633 }, 00:28:48.633 "method": "bdev_nvme_attach_controller" 00:28:48.633 }' 00:28:48.633 09:52:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:48.633 09:52:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:48.633 09:52:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:48.633 09:52:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:48.633 09:52:11 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:48.633 09:52:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:48.633 09:52:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:48.633 09:52:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:48.633 09:52:11 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:48.633 09:52:11 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:48.891 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:48.891 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:48.891 fio-3.35 00:28:48.891 Starting 2 threads 00:28:48.891 EAL: No free 2048 kB hugepages reported on node 1 00:28:49.462 [2024-11-29 09:52:12.097306] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:49.462 [2024-11-29 09:52:12.097403] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:59.466 00:28:59.466 filename0: (groupid=0, jobs=1): err= 0: pid=160882: Fri Nov 29 09:52:22 2024 00:28:59.466 read: IOPS=190, BW=763KiB/s (781kB/s)(7632KiB/10004msec) 00:28:59.466 slat (nsec): min=7778, max=28690, avg=9443.31, stdev=2433.57 00:28:59.466 clat (usec): min=580, max=42344, avg=20942.98, stdev=20248.02 00:28:59.466 lat (usec): min=587, max=42356, avg=20952.42, stdev=20248.08 00:28:59.466 clat percentiles (usec): 00:28:59.466 | 1.00th=[ 627], 5.00th=[ 644], 10.00th=[ 693], 20.00th=[ 725], 00:28:59.466 | 30.00th=[ 742], 40.00th=[ 758], 50.00th=[ 3621], 60.00th=[41157], 00:28:59.466 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:59.466 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:28:59.466 | 99.99th=[42206] 00:28:59.466 bw ( KiB/s): min= 736, max= 768, per=66.30%, avg=764.63, stdev=10.09, samples=19 00:28:59.466 iops : min= 184, max= 192, avg=191.16, stdev= 2.52, samples=19 00:28:59.466 lat (usec) : 750=35.27%, 1000=13.78% 00:28:59.466 lat (msec) : 2=0.84%, 4=0.21%, 50=49.90% 00:28:59.466 cpu : usr=95.01%, sys=4.70%, ctx=14, majf=0, minf=158 00:28:59.466 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:59.466 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.466 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.466 issued rwts: total=1908,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.466 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:59.466 filename1: (groupid=0, jobs=1): err= 0: pid=160883: Fri Nov 29 09:52:22 2024 00:28:59.466 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10011msec) 00:28:59.466 slat (nsec): min=7068, max=25775, avg=9377.02, stdev=2322.87 00:28:59.466 clat (usec): min=40845, max=43549, avg=40997.95, stdev=192.44 00:28:59.466 lat (usec): min=40853, max=43565, avg=41007.33, stdev=192.55 00:28:59.466 clat percentiles (usec): 00:28:59.466 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:59.466 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:59.466 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:59.466 | 99.00th=[41681], 99.50th=[42206], 99.90th=[43779], 99.95th=[43779], 00:28:59.466 | 99.99th=[43779] 00:28:59.467 bw ( KiB/s): min= 384, max= 416, per=33.67%, avg=388.80, stdev=11.72, samples=20 00:28:59.467 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:28:59.467 lat (msec) : 50=100.00% 00:28:59.467 cpu : usr=94.90%, sys=4.78%, ctx=24, majf=0, minf=159 00:28:59.467 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:59.467 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.467 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:59.467 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:59.467 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:59.467 00:28:59.467 Run status group 0 (all jobs): 00:28:59.467 READ: bw=1152KiB/s (1180kB/s), 390KiB/s-763KiB/s (399kB/s-781kB/s), io=11.3MiB (11.8MB), run=10004-10011msec 00:28:59.726 09:52:22 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:28:59.726 09:52:22 -- target/dif.sh@43 -- # local sub 00:28:59.726 09:52:22 -- target/dif.sh@45 -- # for sub in "$@" 00:28:59.726 09:52:22 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:59.726 09:52:22 -- target/dif.sh@36 -- # local sub_id=0 00:28:59.726 09:52:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:59.726 09:52:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.726 09:52:22 -- common/autotest_common.sh@10 -- # set +x 00:28:59.726 09:52:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.726 09:52:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:59.726 09:52:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.726 09:52:22 -- common/autotest_common.sh@10 -- # set +x 00:28:59.726 09:52:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.726 09:52:22 -- target/dif.sh@45 -- # for sub in "$@" 00:28:59.726 09:52:22 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:59.726 09:52:22 -- target/dif.sh@36 -- # local sub_id=1 00:28:59.726 09:52:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:59.726 09:52:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.726 09:52:22 -- common/autotest_common.sh@10 -- # set +x 00:28:59.726 09:52:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.726 09:52:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:59.726 09:52:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.726 09:52:22 -- common/autotest_common.sh@10 -- # set +x 00:28:59.726 09:52:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.726 00:28:59.726 real 0m11.231s 00:28:59.726 user 0m20.145s 00:28:59.726 sys 0m1.234s 00:28:59.726 09:52:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:59.726 09:52:22 -- common/autotest_common.sh@10 -- # set +x 00:28:59.726 ************************************ 00:28:59.726 END TEST fio_dif_1_multi_subsystems 00:28:59.726 ************************************ 00:28:59.726 09:52:22 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:28:59.726 09:52:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:59.726 09:52:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:59.726 09:52:22 -- common/autotest_common.sh@10 -- # set +x 00:28:59.726 ************************************ 00:28:59.726 START TEST fio_dif_rand_params 00:28:59.726 ************************************ 00:28:59.726 09:52:22 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:28:59.726 09:52:22 -- target/dif.sh@100 -- # local NULL_DIF 00:28:59.726 09:52:22 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:28:59.726 09:52:22 -- target/dif.sh@103 -- # NULL_DIF=3 00:28:59.726 09:52:22 -- target/dif.sh@103 -- # bs=128k 00:28:59.726 09:52:22 -- target/dif.sh@103 -- # numjobs=3 00:28:59.726 09:52:22 -- target/dif.sh@103 -- # iodepth=3 00:28:59.726 09:52:22 -- target/dif.sh@103 -- # runtime=5 00:28:59.726 09:52:22 -- target/dif.sh@105 -- # create_subsystems 0 00:28:59.726 09:52:22 -- target/dif.sh@28 -- # local sub 00:28:59.726 09:52:22 -- target/dif.sh@30 -- # for sub in "$@" 00:28:59.726 09:52:22 -- target/dif.sh@31 -- # create_subsystem 0 00:28:59.726 09:52:22 -- target/dif.sh@18 -- # local sub_id=0 00:28:59.726 09:52:22 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:28:59.726 09:52:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.726 09:52:22 -- common/autotest_common.sh@10 -- # set +x 00:28:59.726 bdev_null0 00:28:59.726 09:52:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.726 09:52:22 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:59.726 09:52:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.726 09:52:22 -- common/autotest_common.sh@10 -- # set +x 00:28:59.726 09:52:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.727 09:52:22 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:59.727 09:52:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.727 09:52:22 -- common/autotest_common.sh@10 -- # set +x 00:28:59.727 09:52:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.727 09:52:22 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:59.727 09:52:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.727 09:52:22 -- common/autotest_common.sh@10 -- # set +x 00:28:59.727 [2024-11-29 09:52:22.536995] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:59.727 09:52:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.727 09:52:22 -- target/dif.sh@106 -- # fio /dev/fd/62 00:28:59.727 09:52:22 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:28:59.727 09:52:22 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:59.727 09:52:22 -- nvmf/common.sh@520 -- # config=() 00:28:59.727 09:52:22 -- nvmf/common.sh@520 -- # local subsystem config 00:28:59.727 09:52:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:59.727 09:52:22 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:59.727 09:52:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:59.727 { 00:28:59.727 "params": { 00:28:59.727 "name": "Nvme$subsystem", 00:28:59.727 "trtype": "$TEST_TRANSPORT", 00:28:59.727 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:59.727 "adrfam": "ipv4", 00:28:59.727 "trsvcid": "$NVMF_PORT", 00:28:59.727 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:59.727 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:59.727 "hdgst": ${hdgst:-false}, 00:28:59.727 "ddgst": ${ddgst:-false} 00:28:59.727 }, 00:28:59.727 "method": "bdev_nvme_attach_controller" 00:28:59.727 } 00:28:59.727 EOF 00:28:59.727 )") 00:28:59.727 09:52:22 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:59.727 09:52:22 -- target/dif.sh@82 -- # gen_fio_conf 00:28:59.727 09:52:22 -- target/dif.sh@54 -- # local file 00:28:59.727 09:52:22 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:59.727 09:52:22 -- target/dif.sh@56 -- # cat 00:28:59.727 09:52:22 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:59.727 09:52:22 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:59.727 09:52:22 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:59.727 09:52:22 -- common/autotest_common.sh@1330 -- # shift 00:28:59.727 09:52:22 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:59.727 09:52:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:59.727 09:52:22 -- nvmf/common.sh@542 -- # cat 00:28:59.727 09:52:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:59.727 09:52:22 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:59.727 09:52:22 -- target/dif.sh@72 -- # (( file <= files )) 00:28:59.727 09:52:22 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:59.727 09:52:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:59.727 09:52:22 -- nvmf/common.sh@544 -- # jq . 00:28:59.727 09:52:22 -- nvmf/common.sh@545 -- # IFS=, 00:28:59.727 09:52:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:59.727 "params": { 00:28:59.727 "name": "Nvme0", 00:28:59.727 "trtype": "tcp", 00:28:59.727 "traddr": "10.0.0.2", 00:28:59.727 "adrfam": "ipv4", 00:28:59.727 "trsvcid": "4420", 00:28:59.727 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:59.727 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:59.727 "hdgst": false, 00:28:59.727 "ddgst": false 00:28:59.727 }, 00:28:59.727 "method": "bdev_nvme_attach_controller" 00:28:59.727 }' 00:28:59.727 09:52:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:59.727 09:52:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:59.727 09:52:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:59.727 09:52:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:59.727 09:52:22 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:59.727 09:52:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:59.985 09:52:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:59.985 09:52:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:59.985 09:52:22 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:59.985 09:52:22 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:59.985 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:28:59.985 ... 00:28:59.985 fio-3.35 00:28:59.985 Starting 3 threads 00:29:00.244 EAL: No free 2048 kB hugepages reported on node 1 00:29:00.503 [2024-11-29 09:52:23.234532] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:00.503 [2024-11-29 09:52:23.234598] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:05.770 00:29:05.770 filename0: (groupid=0, jobs=1): err= 0: pid=162319: Fri Nov 29 09:52:28 2024 00:29:05.770 read: IOPS=240, BW=30.0MiB/s (31.5MB/s)(150MiB/5003msec) 00:29:05.770 slat (nsec): min=4294, max=68888, avg=17860.52, stdev=4522.83 00:29:05.770 clat (usec): min=5849, max=92715, avg=12472.66, stdev=5736.11 00:29:05.770 lat (usec): min=5861, max=92729, avg=12490.52, stdev=5735.59 00:29:05.770 clat percentiles (usec): 00:29:05.770 | 1.00th=[ 7439], 5.00th=[ 8848], 10.00th=[ 9634], 20.00th=[10290], 00:29:05.770 | 30.00th=[10814], 40.00th=[11207], 50.00th=[11731], 60.00th=[12256], 00:29:05.770 | 70.00th=[12911], 80.00th=[13566], 90.00th=[14222], 95.00th=[15008], 00:29:05.770 | 99.00th=[50594], 99.50th=[51643], 99.90th=[53216], 99.95th=[92799], 00:29:05.770 | 99.99th=[92799] 00:29:05.770 bw ( KiB/s): min=22784, max=33280, per=33.35%, avg=30694.40, stdev=2932.41, samples=10 00:29:05.770 iops : min= 178, max= 260, avg=239.80, stdev=22.91, samples=10 00:29:05.770 lat (msec) : 10=14.57%, 20=83.76%, 50=0.25%, 100=1.42% 00:29:05.770 cpu : usr=93.92%, sys=4.90%, ctx=37, majf=0, minf=240 00:29:05.770 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:05.770 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.770 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.770 issued rwts: total=1201,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:05.770 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:05.770 filename0: (groupid=0, jobs=1): err= 0: pid=162320: Fri Nov 29 09:52:28 2024 00:29:05.770 read: IOPS=234, BW=29.3MiB/s (30.7MB/s)(147MiB/5003msec) 00:29:05.770 slat (nsec): min=4501, max=39719, avg=16139.49, stdev=3869.39 00:29:05.770 clat (usec): min=4409, max=52543, avg=12783.97, stdev=4371.69 00:29:05.770 lat (usec): min=4428, max=52558, avg=12800.11, stdev=4371.66 00:29:05.770 clat percentiles (usec): 00:29:05.770 | 1.00th=[ 5538], 5.00th=[ 8586], 10.00th=[ 9372], 20.00th=[10683], 00:29:05.770 | 30.00th=[11469], 40.00th=[11994], 50.00th=[12649], 60.00th=[13173], 00:29:05.770 | 70.00th=[13829], 80.00th=[14353], 90.00th=[15008], 95.00th=[15533], 00:29:05.770 | 99.00th=[47973], 99.50th=[51119], 99.90th=[51643], 99.95th=[52691], 00:29:05.770 | 99.99th=[52691] 00:29:05.770 bw ( KiB/s): min=27648, max=32768, per=32.55%, avg=29957.70, stdev=1825.85, samples=10 00:29:05.770 iops : min= 216, max= 256, avg=234.00, stdev=14.30, samples=10 00:29:05.770 lat (msec) : 10=13.74%, 20=85.24%, 50=0.51%, 100=0.51% 00:29:05.770 cpu : usr=95.36%, sys=4.12%, ctx=14, majf=0, minf=155 00:29:05.770 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:05.770 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.770 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.770 issued rwts: total=1172,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:05.770 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:05.770 filename0: (groupid=0, jobs=1): err= 0: pid=162321: Fri Nov 29 09:52:28 2024 00:29:05.770 read: IOPS=248, BW=31.1MiB/s (32.6MB/s)(157MiB/5043msec) 00:29:05.770 slat (nsec): min=4149, max=39560, avg=16181.51, stdev=3862.59 00:29:05.771 clat (usec): min=4199, max=54825, avg=12021.37, stdev=4736.10 00:29:05.771 lat (usec): min=4212, max=54837, avg=12037.55, stdev=4736.25 00:29:05.771 clat percentiles (usec): 00:29:05.771 | 1.00th=[ 5080], 5.00th=[ 7767], 10.00th=[ 9110], 20.00th=[10159], 00:29:05.771 | 30.00th=[10683], 40.00th=[11076], 50.00th=[11600], 60.00th=[12256], 00:29:05.771 | 70.00th=[12780], 80.00th=[13435], 90.00th=[14353], 95.00th=[15008], 00:29:05.771 | 99.00th=[49546], 99.50th=[51643], 99.90th=[54264], 99.95th=[54789], 00:29:05.771 | 99.99th=[54789] 00:29:05.771 bw ( KiB/s): min=27904, max=36352, per=34.80%, avg=32025.60, stdev=2471.58, samples=10 00:29:05.771 iops : min= 218, max= 284, avg=250.20, stdev=19.31, samples=10 00:29:05.771 lat (msec) : 10=18.52%, 20=80.37%, 50=0.16%, 100=0.96% 00:29:05.771 cpu : usr=94.72%, sys=4.82%, ctx=13, majf=0, minf=118 00:29:05.771 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:05.771 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.771 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.771 issued rwts: total=1253,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:05.771 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:05.771 00:29:05.771 Run status group 0 (all jobs): 00:29:05.771 READ: bw=89.9MiB/s (94.2MB/s), 29.3MiB/s-31.1MiB/s (30.7MB/s-32.6MB/s), io=453MiB (475MB), run=5003-5043msec 00:29:05.771 09:52:28 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:05.771 09:52:28 -- target/dif.sh@43 -- # local sub 00:29:05.771 09:52:28 -- target/dif.sh@45 -- # for sub in "$@" 00:29:05.771 09:52:28 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:05.771 09:52:28 -- target/dif.sh@36 -- # local sub_id=0 00:29:05.771 09:52:28 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:05.771 09:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.771 09:52:28 -- common/autotest_common.sh@10 -- # set +x 00:29:05.771 09:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.771 09:52:28 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:05.771 09:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.771 09:52:28 -- common/autotest_common.sh@10 -- # set +x 00:29:06.030 09:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.030 09:52:28 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:06.030 09:52:28 -- target/dif.sh@109 -- # bs=4k 00:29:06.030 09:52:28 -- target/dif.sh@109 -- # numjobs=8 00:29:06.030 09:52:28 -- target/dif.sh@109 -- # iodepth=16 00:29:06.030 09:52:28 -- target/dif.sh@109 -- # runtime= 00:29:06.030 09:52:28 -- target/dif.sh@109 -- # files=2 00:29:06.030 09:52:28 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:06.030 09:52:28 -- target/dif.sh@28 -- # local sub 00:29:06.030 09:52:28 -- target/dif.sh@30 -- # for sub in "$@" 00:29:06.030 09:52:28 -- target/dif.sh@31 -- # create_subsystem 0 00:29:06.030 09:52:28 -- target/dif.sh@18 -- # local sub_id=0 00:29:06.030 09:52:28 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:06.030 09:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.030 09:52:28 -- common/autotest_common.sh@10 -- # set +x 00:29:06.030 bdev_null0 00:29:06.030 09:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.030 09:52:28 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:06.030 09:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.030 09:52:28 -- common/autotest_common.sh@10 -- # set +x 00:29:06.030 09:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.030 09:52:28 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:06.030 09:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.030 09:52:28 -- common/autotest_common.sh@10 -- # set +x 00:29:06.030 09:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.030 09:52:28 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:06.030 09:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.030 09:52:28 -- common/autotest_common.sh@10 -- # set +x 00:29:06.030 [2024-11-29 09:52:28.642127] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:06.030 09:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.030 09:52:28 -- target/dif.sh@30 -- # for sub in "$@" 00:29:06.030 09:52:28 -- target/dif.sh@31 -- # create_subsystem 1 00:29:06.030 09:52:28 -- target/dif.sh@18 -- # local sub_id=1 00:29:06.030 09:52:28 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:06.030 09:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.030 09:52:28 -- common/autotest_common.sh@10 -- # set +x 00:29:06.030 bdev_null1 00:29:06.030 09:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.030 09:52:28 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:06.030 09:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.030 09:52:28 -- common/autotest_common.sh@10 -- # set +x 00:29:06.030 09:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.030 09:52:28 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:06.030 09:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.030 09:52:28 -- common/autotest_common.sh@10 -- # set +x 00:29:06.030 09:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.030 09:52:28 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:06.030 09:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.030 09:52:28 -- common/autotest_common.sh@10 -- # set +x 00:29:06.030 09:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.030 09:52:28 -- target/dif.sh@30 -- # for sub in "$@" 00:29:06.030 09:52:28 -- target/dif.sh@31 -- # create_subsystem 2 00:29:06.030 09:52:28 -- target/dif.sh@18 -- # local sub_id=2 00:29:06.030 09:52:28 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:06.030 09:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.030 09:52:28 -- common/autotest_common.sh@10 -- # set +x 00:29:06.030 bdev_null2 00:29:06.030 09:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.030 09:52:28 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:06.030 09:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.030 09:52:28 -- common/autotest_common.sh@10 -- # set +x 00:29:06.030 09:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.030 09:52:28 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:06.030 09:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.030 09:52:28 -- common/autotest_common.sh@10 -- # set +x 00:29:06.030 09:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.030 09:52:28 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:06.030 09:52:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.030 09:52:28 -- common/autotest_common.sh@10 -- # set +x 00:29:06.030 09:52:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.030 09:52:28 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:06.030 09:52:28 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:06.030 09:52:28 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:06.030 09:52:28 -- nvmf/common.sh@520 -- # config=() 00:29:06.030 09:52:28 -- nvmf/common.sh@520 -- # local subsystem config 00:29:06.030 09:52:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:06.030 09:52:28 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:06.030 09:52:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:06.030 { 00:29:06.030 "params": { 00:29:06.030 "name": "Nvme$subsystem", 00:29:06.030 "trtype": "$TEST_TRANSPORT", 00:29:06.030 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:06.030 "adrfam": "ipv4", 00:29:06.030 "trsvcid": "$NVMF_PORT", 00:29:06.030 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:06.030 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:06.030 "hdgst": ${hdgst:-false}, 00:29:06.030 "ddgst": ${ddgst:-false} 00:29:06.030 }, 00:29:06.030 "method": "bdev_nvme_attach_controller" 00:29:06.030 } 00:29:06.030 EOF 00:29:06.030 )") 00:29:06.030 09:52:28 -- target/dif.sh@82 -- # gen_fio_conf 00:29:06.030 09:52:28 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:06.030 09:52:28 -- target/dif.sh@54 -- # local file 00:29:06.030 09:52:28 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:06.030 09:52:28 -- target/dif.sh@56 -- # cat 00:29:06.030 09:52:28 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:06.030 09:52:28 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:06.030 09:52:28 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:06.030 09:52:28 -- common/autotest_common.sh@1330 -- # shift 00:29:06.030 09:52:28 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:06.030 09:52:28 -- nvmf/common.sh@542 -- # cat 00:29:06.030 09:52:28 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:06.030 09:52:28 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:06.030 09:52:28 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:06.030 09:52:28 -- target/dif.sh@72 -- # (( file <= files )) 00:29:06.030 09:52:28 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:06.030 09:52:28 -- target/dif.sh@73 -- # cat 00:29:06.030 09:52:28 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:06.030 09:52:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:06.030 09:52:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:06.030 { 00:29:06.030 "params": { 00:29:06.030 "name": "Nvme$subsystem", 00:29:06.030 "trtype": "$TEST_TRANSPORT", 00:29:06.030 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:06.030 "adrfam": "ipv4", 00:29:06.030 "trsvcid": "$NVMF_PORT", 00:29:06.030 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:06.030 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:06.030 "hdgst": ${hdgst:-false}, 00:29:06.030 "ddgst": ${ddgst:-false} 00:29:06.030 }, 00:29:06.030 "method": "bdev_nvme_attach_controller" 00:29:06.030 } 00:29:06.030 EOF 00:29:06.030 )") 00:29:06.030 09:52:28 -- nvmf/common.sh@542 -- # cat 00:29:06.030 09:52:28 -- target/dif.sh@72 -- # (( file++ )) 00:29:06.030 09:52:28 -- target/dif.sh@72 -- # (( file <= files )) 00:29:06.030 09:52:28 -- target/dif.sh@73 -- # cat 00:29:06.030 09:52:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:06.030 09:52:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:06.030 { 00:29:06.030 "params": { 00:29:06.030 "name": "Nvme$subsystem", 00:29:06.030 "trtype": "$TEST_TRANSPORT", 00:29:06.030 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:06.030 "adrfam": "ipv4", 00:29:06.030 "trsvcid": "$NVMF_PORT", 00:29:06.030 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:06.030 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:06.030 "hdgst": ${hdgst:-false}, 00:29:06.030 "ddgst": ${ddgst:-false} 00:29:06.030 }, 00:29:06.030 "method": "bdev_nvme_attach_controller" 00:29:06.030 } 00:29:06.030 EOF 00:29:06.030 )") 00:29:06.030 09:52:28 -- target/dif.sh@72 -- # (( file++ )) 00:29:06.031 09:52:28 -- target/dif.sh@72 -- # (( file <= files )) 00:29:06.031 09:52:28 -- nvmf/common.sh@542 -- # cat 00:29:06.031 09:52:28 -- nvmf/common.sh@544 -- # jq . 00:29:06.031 09:52:28 -- nvmf/common.sh@545 -- # IFS=, 00:29:06.031 09:52:28 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:06.031 "params": { 00:29:06.031 "name": "Nvme0", 00:29:06.031 "trtype": "tcp", 00:29:06.031 "traddr": "10.0.0.2", 00:29:06.031 "adrfam": "ipv4", 00:29:06.031 "trsvcid": "4420", 00:29:06.031 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:06.031 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:06.031 "hdgst": false, 00:29:06.031 "ddgst": false 00:29:06.031 }, 00:29:06.031 "method": "bdev_nvme_attach_controller" 00:29:06.031 },{ 00:29:06.031 "params": { 00:29:06.031 "name": "Nvme1", 00:29:06.031 "trtype": "tcp", 00:29:06.031 "traddr": "10.0.0.2", 00:29:06.031 "adrfam": "ipv4", 00:29:06.031 "trsvcid": "4420", 00:29:06.031 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:06.031 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:06.031 "hdgst": false, 00:29:06.031 "ddgst": false 00:29:06.031 }, 00:29:06.031 "method": "bdev_nvme_attach_controller" 00:29:06.031 },{ 00:29:06.031 "params": { 00:29:06.031 "name": "Nvme2", 00:29:06.031 "trtype": "tcp", 00:29:06.031 "traddr": "10.0.0.2", 00:29:06.031 "adrfam": "ipv4", 00:29:06.031 "trsvcid": "4420", 00:29:06.031 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:06.031 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:06.031 "hdgst": false, 00:29:06.031 "ddgst": false 00:29:06.031 }, 00:29:06.031 "method": "bdev_nvme_attach_controller" 00:29:06.031 }' 00:29:06.031 09:52:28 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:06.031 09:52:28 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:06.031 09:52:28 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:06.031 09:52:28 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:06.031 09:52:28 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:06.031 09:52:28 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:06.031 09:52:28 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:06.031 09:52:28 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:06.031 09:52:28 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:06.031 09:52:28 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:06.291 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:06.291 ... 00:29:06.291 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:06.291 ... 00:29:06.291 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:06.291 ... 00:29:06.291 fio-3.35 00:29:06.291 Starting 24 threads 00:29:06.291 EAL: No free 2048 kB hugepages reported on node 1 00:29:07.234 [2024-11-29 09:52:29.856552] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:07.234 [2024-11-29 09:52:29.856620] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:19.436 00:29:19.436 filename0: (groupid=0, jobs=1): err= 0: pid=163135: Fri Nov 29 09:52:40 2024 00:29:19.436 read: IOPS=478, BW=1912KiB/s (1958kB/s)(18.9MiB/10141msec) 00:29:19.436 slat (usec): min=8, max=119, avg=18.47, stdev=13.92 00:29:19.436 clat (msec): min=14, max=182, avg=33.31, stdev=11.50 00:29:19.436 lat (msec): min=14, max=182, avg=33.33, stdev=11.50 00:29:19.436 clat percentiles (msec): 00:29:19.436 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:19.436 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.436 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.436 | 99.00th=[ 43], 99.50th=[ 155], 99.90th=[ 184], 99.95th=[ 184], 00:29:19.437 | 99.99th=[ 184] 00:29:19.437 bw ( KiB/s): min= 1408, max= 2176, per=4.24%, avg=1932.80, stdev=207.23, samples=20 00:29:19.437 iops : min= 352, max= 544, avg=483.20, stdev=51.81, samples=20 00:29:19.437 lat (msec) : 20=0.33%, 50=99.01%, 250=0.66% 00:29:19.437 cpu : usr=95.95%, sys=2.43%, ctx=185, majf=0, minf=44 00:29:19.437 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:19.437 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 issued rwts: total=4848,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.437 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.437 filename0: (groupid=0, jobs=1): err= 0: pid=163136: Fri Nov 29 09:52:40 2024 00:29:19.437 read: IOPS=474, BW=1899KiB/s (1944kB/s)(18.8MiB/10112msec) 00:29:19.437 slat (usec): min=11, max=113, avg=37.35, stdev=14.54 00:29:19.437 clat (msec): min=21, max=184, avg=33.34, stdev=11.82 00:29:19.437 lat (msec): min=21, max=184, avg=33.37, stdev=11.82 00:29:19.437 clat percentiles (msec): 00:29:19.437 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.437 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.437 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.437 | 99.00th=[ 44], 99.50th=[ 155], 99.90th=[ 186], 99.95th=[ 186], 00:29:19.437 | 99.99th=[ 186] 00:29:19.437 bw ( KiB/s): min= 1280, max= 2176, per=4.20%, avg=1913.60, stdev=226.48, samples=20 00:29:19.437 iops : min= 320, max= 544, avg=478.40, stdev=56.62, samples=20 00:29:19.437 lat (msec) : 50=99.00%, 100=0.33%, 250=0.67% 00:29:19.437 cpu : usr=98.62%, sys=0.95%, ctx=13, majf=0, minf=37 00:29:19.437 IO depths : 1=6.1%, 2=12.3%, 4=24.9%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:19.437 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 issued rwts: total=4800,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.437 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.437 filename0: (groupid=0, jobs=1): err= 0: pid=163137: Fri Nov 29 09:52:40 2024 00:29:19.437 read: IOPS=478, BW=1913KiB/s (1959kB/s)(18.8MiB/10037msec) 00:29:19.437 slat (usec): min=5, max=127, avg=37.17, stdev=14.11 00:29:19.437 clat (msec): min=29, max=226, avg=33.11, stdev=11.74 00:29:19.437 lat (msec): min=29, max=226, avg=33.14, stdev=11.74 00:29:19.437 clat percentiles (msec): 00:29:19.437 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.437 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.437 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.437 | 99.00th=[ 43], 99.50th=[ 67], 99.90th=[ 226], 99.95th=[ 226], 00:29:19.437 | 99.99th=[ 226] 00:29:19.437 bw ( KiB/s): min= 1280, max= 2048, per=4.20%, avg=1913.60, stdev=221.61, samples=20 00:29:19.437 iops : min= 320, max= 512, avg=478.40, stdev=55.40, samples=20 00:29:19.437 lat (msec) : 50=99.33%, 100=0.33%, 250=0.33% 00:29:19.437 cpu : usr=97.59%, sys=1.44%, ctx=183, majf=0, minf=37 00:29:19.437 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:19.437 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 issued rwts: total=4800,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.437 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.437 filename0: (groupid=0, jobs=1): err= 0: pid=163138: Fri Nov 29 09:52:40 2024 00:29:19.437 read: IOPS=475, BW=1904KiB/s (1949kB/s)(18.8MiB/10120msec) 00:29:19.437 slat (usec): min=8, max=318, avg=37.44, stdev=14.46 00:29:19.437 clat (msec): min=29, max=293, avg=33.09, stdev=12.16 00:29:19.437 lat (msec): min=29, max=293, avg=33.13, stdev=12.16 00:29:19.437 clat percentiles (msec): 00:29:19.437 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.437 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.437 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.437 | 99.00th=[ 43], 99.50th=[ 51], 99.90th=[ 228], 99.95th=[ 228], 00:29:19.437 | 99.99th=[ 296] 00:29:19.437 bw ( KiB/s): min= 1280, max= 2048, per=4.21%, avg=1920.00, stdev=219.75, samples=20 00:29:19.437 iops : min= 320, max= 512, avg=480.00, stdev=54.94, samples=20 00:29:19.437 lat (msec) : 50=99.34%, 100=0.33%, 250=0.29%, 500=0.04% 00:29:19.437 cpu : usr=95.96%, sys=2.40%, ctx=160, majf=0, minf=27 00:29:19.437 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:19.437 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 issued rwts: total=4816,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.437 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.437 filename0: (groupid=0, jobs=1): err= 0: pid=163139: Fri Nov 29 09:52:40 2024 00:29:19.437 read: IOPS=475, BW=1904KiB/s (1949kB/s)(18.8MiB/10120msec) 00:29:19.437 slat (usec): min=5, max=129, avg=37.04, stdev=13.46 00:29:19.437 clat (msec): min=15, max=182, avg=33.29, stdev=11.56 00:29:19.437 lat (msec): min=15, max=182, avg=33.33, stdev=11.56 00:29:19.437 clat percentiles (msec): 00:29:19.437 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.437 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.437 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.437 | 99.00th=[ 49], 99.50th=[ 155], 99.90th=[ 184], 99.95th=[ 184], 00:29:19.437 | 99.99th=[ 184] 00:29:19.437 bw ( KiB/s): min= 1280, max= 2048, per=4.21%, avg=1920.00, stdev=219.75, samples=20 00:29:19.437 iops : min= 320, max= 512, avg=480.00, stdev=54.94, samples=20 00:29:19.437 lat (msec) : 20=0.08%, 50=98.92%, 100=0.33%, 250=0.66% 00:29:19.437 cpu : usr=98.61%, sys=0.95%, ctx=17, majf=0, minf=37 00:29:19.437 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:19.437 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 issued rwts: total=4816,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.437 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.437 filename0: (groupid=0, jobs=1): err= 0: pid=163141: Fri Nov 29 09:52:40 2024 00:29:19.437 read: IOPS=475, BW=1901KiB/s (1946kB/s)(18.8MiB/10102msec) 00:29:19.437 slat (usec): min=10, max=106, avg=35.24, stdev=10.82 00:29:19.437 clat (msec): min=30, max=293, avg=33.34, stdev=15.45 00:29:19.437 lat (msec): min=30, max=293, avg=33.38, stdev=15.45 00:29:19.437 clat percentiles (msec): 00:29:19.437 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.437 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.437 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.437 | 99.00th=[ 43], 99.50th=[ 65], 99.90th=[ 292], 99.95th=[ 292], 00:29:19.437 | 99.99th=[ 292] 00:29:19.437 bw ( KiB/s): min= 1280, max= 2176, per=4.20%, avg=1913.75, stdev=225.38, samples=20 00:29:19.437 iops : min= 320, max= 544, avg=478.40, stdev=56.37, samples=20 00:29:19.437 lat (msec) : 50=99.33%, 100=0.33%, 500=0.33% 00:29:19.437 cpu : usr=96.26%, sys=2.06%, ctx=83, majf=0, minf=60 00:29:19.437 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:19.437 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 issued rwts: total=4800,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.437 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.437 filename0: (groupid=0, jobs=1): err= 0: pid=163142: Fri Nov 29 09:52:40 2024 00:29:19.437 read: IOPS=474, BW=1900KiB/s (1945kB/s)(18.8MiB/10106msec) 00:29:19.437 slat (nsec): min=9192, max=93104, avg=36503.02, stdev=11785.40 00:29:19.437 clat (msec): min=30, max=184, avg=33.35, stdev=11.78 00:29:19.437 lat (msec): min=30, max=184, avg=33.39, stdev=11.77 00:29:19.437 clat percentiles (msec): 00:29:19.437 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.437 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.437 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.437 | 99.00th=[ 44], 99.50th=[ 155], 99.90th=[ 186], 99.95th=[ 186], 00:29:19.437 | 99.99th=[ 186] 00:29:19.437 bw ( KiB/s): min= 1280, max= 2048, per=4.20%, avg=1913.75, stdev=221.52, samples=20 00:29:19.437 iops : min= 320, max= 512, avg=478.40, stdev=55.40, samples=20 00:29:19.437 lat (msec) : 50=99.00%, 100=0.33%, 250=0.67% 00:29:19.437 cpu : usr=98.64%, sys=0.95%, ctx=16, majf=0, minf=43 00:29:19.437 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:19.437 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 issued rwts: total=4800,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.437 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.437 filename0: (groupid=0, jobs=1): err= 0: pid=163143: Fri Nov 29 09:52:40 2024 00:29:19.437 read: IOPS=478, BW=1912KiB/s (1958kB/s)(18.9MiB/10140msec) 00:29:19.437 slat (usec): min=5, max=118, avg=31.36, stdev=15.91 00:29:19.437 clat (msec): min=9, max=294, avg=33.02, stdev=12.14 00:29:19.437 lat (msec): min=9, max=294, avg=33.05, stdev=12.14 00:29:19.437 clat percentiles (msec): 00:29:19.437 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.437 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.437 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.437 | 99.00th=[ 43], 99.50th=[ 45], 99.90th=[ 226], 99.95th=[ 226], 00:29:19.437 | 99.99th=[ 296] 00:29:19.437 bw ( KiB/s): min= 1408, max= 2048, per=4.24%, avg=1932.80, stdev=203.02, samples=20 00:29:19.437 iops : min= 352, max= 512, avg=483.20, stdev=50.76, samples=20 00:29:19.437 lat (msec) : 10=0.04%, 20=0.29%, 50=99.34%, 250=0.29%, 500=0.04% 00:29:19.437 cpu : usr=98.61%, sys=0.99%, ctx=13, majf=0, minf=53 00:29:19.437 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:19.437 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.437 issued rwts: total=4848,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.437 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.437 filename1: (groupid=0, jobs=1): err= 0: pid=163144: Fri Nov 29 09:52:40 2024 00:29:19.438 read: IOPS=474, BW=1899KiB/s (1945kB/s)(18.8MiB/10110msec) 00:29:19.438 slat (usec): min=11, max=166, avg=38.51, stdev=14.42 00:29:19.438 clat (msec): min=29, max=184, avg=33.34, stdev=11.78 00:29:19.438 lat (msec): min=29, max=184, avg=33.38, stdev=11.78 00:29:19.438 clat percentiles (msec): 00:29:19.438 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.438 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.438 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.438 | 99.00th=[ 43], 99.50th=[ 155], 99.90th=[ 186], 99.95th=[ 186], 00:29:19.438 | 99.99th=[ 186] 00:29:19.438 bw ( KiB/s): min= 1280, max= 2048, per=4.20%, avg=1913.60, stdev=221.61, samples=20 00:29:19.438 iops : min= 320, max= 512, avg=478.40, stdev=55.40, samples=20 00:29:19.438 lat (msec) : 50=99.00%, 100=0.33%, 250=0.67% 00:29:19.438 cpu : usr=98.62%, sys=0.96%, ctx=13, majf=0, minf=40 00:29:19.438 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:19.438 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.438 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.438 issued rwts: total=4800,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.438 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.438 filename1: (groupid=0, jobs=1): err= 0: pid=163145: Fri Nov 29 09:52:40 2024 00:29:19.438 read: IOPS=481, BW=1925KiB/s (1972kB/s)(18.9MiB/10072msec) 00:29:19.438 slat (nsec): min=4904, max=88908, avg=26293.04, stdev=13714.68 00:29:19.438 clat (msec): min=12, max=226, avg=33.04, stdev=11.59 00:29:19.438 lat (msec): min=12, max=226, avg=33.06, stdev=11.59 00:29:19.438 clat percentiles (msec): 00:29:19.438 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.438 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.438 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.438 | 99.00th=[ 43], 99.50th=[ 45], 99.90th=[ 226], 99.95th=[ 226], 00:29:19.438 | 99.99th=[ 226] 00:29:19.438 bw ( KiB/s): min= 1408, max= 2048, per=4.24%, avg=1932.80, stdev=203.02, samples=20 00:29:19.438 iops : min= 352, max= 512, avg=483.20, stdev=50.76, samples=20 00:29:19.438 lat (msec) : 20=0.33%, 50=99.34%, 250=0.33% 00:29:19.438 cpu : usr=98.60%, sys=1.00%, ctx=14, majf=0, minf=40 00:29:19.438 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:19.438 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.438 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.438 issued rwts: total=4848,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.438 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.438 filename1: (groupid=0, jobs=1): err= 0: pid=163146: Fri Nov 29 09:52:40 2024 00:29:19.438 read: IOPS=474, BW=1900KiB/s (1945kB/s)(18.7MiB/10103msec) 00:29:19.438 slat (usec): min=7, max=615, avg=33.97, stdev=13.83 00:29:19.438 clat (msec): min=28, max=293, avg=33.36, stdev=15.11 00:29:19.438 lat (msec): min=28, max=293, avg=33.39, stdev=15.11 00:29:19.438 clat percentiles (msec): 00:29:19.438 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.438 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.438 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.438 | 99.00th=[ 43], 99.50th=[ 65], 99.90th=[ 292], 99.95th=[ 292], 00:29:19.438 | 99.99th=[ 292] 00:29:19.438 bw ( KiB/s): min= 1264, max= 2160, per=4.19%, avg=1912.80, stdev=226.54, samples=20 00:29:19.438 iops : min= 316, max= 540, avg=478.20, stdev=56.64, samples=20 00:29:19.438 lat (msec) : 50=99.33%, 100=0.33%, 250=0.04%, 500=0.29% 00:29:19.438 cpu : usr=96.62%, sys=1.86%, ctx=201, majf=0, minf=35 00:29:19.438 IO depths : 1=3.3%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.2%, 32=0.0%, >=64=0.0% 00:29:19.438 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.438 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.438 issued rwts: total=4798,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.438 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.438 filename1: (groupid=0, jobs=1): err= 0: pid=163147: Fri Nov 29 09:52:40 2024 00:29:19.438 read: IOPS=478, BW=1912KiB/s (1958kB/s)(18.9MiB/10142msec) 00:29:19.438 slat (usec): min=8, max=127, avg=32.65, stdev=14.26 00:29:19.438 clat (msec): min=14, max=182, avg=33.21, stdev=11.51 00:29:19.438 lat (msec): min=14, max=182, avg=33.24, stdev=11.51 00:29:19.438 clat percentiles (msec): 00:29:19.438 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.438 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.438 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.438 | 99.00th=[ 43], 99.50th=[ 155], 99.90th=[ 184], 99.95th=[ 184], 00:29:19.438 | 99.99th=[ 184] 00:29:19.438 bw ( KiB/s): min= 1408, max= 2176, per=4.24%, avg=1932.80, stdev=207.23, samples=20 00:29:19.438 iops : min= 352, max= 544, avg=483.20, stdev=51.81, samples=20 00:29:19.438 lat (msec) : 20=0.33%, 50=99.01%, 250=0.66% 00:29:19.438 cpu : usr=97.21%, sys=1.66%, ctx=79, majf=0, minf=71 00:29:19.438 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:19.438 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.438 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.438 issued rwts: total=4848,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.438 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.438 filename1: (groupid=0, jobs=1): err= 0: pid=163149: Fri Nov 29 09:52:40 2024 00:29:19.438 read: IOPS=475, BW=1904KiB/s (1949kB/s)(18.8MiB/10120msec) 00:29:19.438 slat (usec): min=8, max=166, avg=36.94, stdev=14.70 00:29:19.438 clat (msec): min=13, max=182, avg=33.29, stdev=11.55 00:29:19.438 lat (msec): min=13, max=182, avg=33.33, stdev=11.55 00:29:19.438 clat percentiles (msec): 00:29:19.438 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.438 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.438 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.438 | 99.00th=[ 51], 99.50th=[ 155], 99.90th=[ 184], 99.95th=[ 184], 00:29:19.438 | 99.99th=[ 184] 00:29:19.438 bw ( KiB/s): min= 1280, max= 2048, per=4.21%, avg=1920.00, stdev=219.75, samples=20 00:29:19.438 iops : min= 320, max= 512, avg=480.00, stdev=54.94, samples=20 00:29:19.438 lat (msec) : 20=0.08%, 50=98.88%, 100=0.37%, 250=0.66% 00:29:19.438 cpu : usr=98.57%, sys=1.02%, ctx=25, majf=0, minf=28 00:29:19.438 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:19.438 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.438 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.438 issued rwts: total=4816,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.438 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.438 filename1: (groupid=0, jobs=1): err= 0: pid=163150: Fri Nov 29 09:52:40 2024 00:29:19.438 read: IOPS=475, BW=1904KiB/s (1949kB/s)(18.8MiB/10120msec) 00:29:19.438 slat (nsec): min=5230, max=77065, avg=34679.27, stdev=8393.95 00:29:19.438 clat (msec): min=30, max=184, avg=33.31, stdev=11.57 00:29:19.438 lat (msec): min=30, max=184, avg=33.34, stdev=11.57 00:29:19.438 clat percentiles (msec): 00:29:19.438 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.438 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.438 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.438 | 99.00th=[ 44], 99.50th=[ 155], 99.90th=[ 184], 99.95th=[ 184], 00:29:19.438 | 99.99th=[ 184] 00:29:19.438 bw ( KiB/s): min= 1280, max= 2048, per=4.21%, avg=1920.00, stdev=219.75, samples=20 00:29:19.438 iops : min= 320, max= 512, avg=480.00, stdev=54.94, samples=20 00:29:19.438 lat (msec) : 50=99.00%, 100=0.33%, 250=0.66% 00:29:19.438 cpu : usr=97.46%, sys=1.42%, ctx=113, majf=0, minf=47 00:29:19.438 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:19.438 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.438 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.438 issued rwts: total=4816,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.438 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.438 filename1: (groupid=0, jobs=1): err= 0: pid=163151: Fri Nov 29 09:52:40 2024 00:29:19.438 read: IOPS=475, BW=1900KiB/s (1946kB/s)(18.8MiB/10104msec) 00:29:19.438 slat (usec): min=8, max=147, avg=37.02, stdev=14.30 00:29:19.438 clat (msec): min=28, max=295, avg=33.32, stdev=15.47 00:29:19.438 lat (msec): min=28, max=295, avg=33.35, stdev=15.47 00:29:19.438 clat percentiles (msec): 00:29:19.438 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.438 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.438 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.438 | 99.00th=[ 43], 99.50th=[ 65], 99.90th=[ 292], 99.95th=[ 292], 00:29:19.438 | 99.99th=[ 296] 00:29:19.438 bw ( KiB/s): min= 1280, max= 2176, per=4.20%, avg=1913.75, stdev=225.38, samples=20 00:29:19.438 iops : min= 320, max= 544, avg=478.40, stdev=56.37, samples=20 00:29:19.438 lat (msec) : 50=99.33%, 100=0.33%, 500=0.33% 00:29:19.438 cpu : usr=96.53%, sys=2.12%, ctx=155, majf=0, minf=56 00:29:19.438 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:19.438 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.438 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.438 issued rwts: total=4800,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.438 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.438 filename1: (groupid=0, jobs=1): err= 0: pid=163152: Fri Nov 29 09:52:40 2024 00:29:19.438 read: IOPS=479, BW=1916KiB/s (1962kB/s)(18.8MiB/10053msec) 00:29:19.438 slat (nsec): min=8752, max=98727, avg=35018.45, stdev=11827.50 00:29:19.438 clat (msec): min=27, max=226, avg=33.11, stdev=11.61 00:29:19.438 lat (msec): min=27, max=226, avg=33.15, stdev=11.61 00:29:19.438 clat percentiles (msec): 00:29:19.438 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.438 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.438 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.438 | 99.00th=[ 44], 99.50th=[ 51], 99.90th=[ 226], 99.95th=[ 226], 00:29:19.438 | 99.99th=[ 226] 00:29:19.438 bw ( KiB/s): min= 1280, max= 2048, per=4.21%, avg=1920.00, stdev=219.75, samples=20 00:29:19.438 iops : min= 320, max= 512, avg=480.00, stdev=54.94, samples=20 00:29:19.438 lat (msec) : 50=99.34%, 100=0.33%, 250=0.33% 00:29:19.438 cpu : usr=97.99%, sys=1.27%, ctx=61, majf=0, minf=34 00:29:19.438 IO depths : 1=5.2%, 2=11.5%, 4=25.0%, 8=51.0%, 16=7.3%, 32=0.0%, >=64=0.0% 00:29:19.439 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 issued rwts: total=4816,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.439 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.439 filename2: (groupid=0, jobs=1): err= 0: pid=163153: Fri Nov 29 09:52:40 2024 00:29:19.439 read: IOPS=479, BW=1919KiB/s (1965kB/s)(18.9MiB/10071msec) 00:29:19.439 slat (usec): min=7, max=116, avg=19.56, stdev=22.54 00:29:19.439 clat (msec): min=16, max=254, avg=33.17, stdev=13.16 00:29:19.439 lat (msec): min=16, max=254, avg=33.18, stdev=13.16 00:29:19.439 clat percentiles (msec): 00:29:19.439 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:19.439 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.439 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.439 | 99.00th=[ 43], 99.50th=[ 44], 99.90th=[ 255], 99.95th=[ 255], 00:29:19.439 | 99.99th=[ 255] 00:29:19.439 bw ( KiB/s): min= 1280, max= 2048, per=4.22%, avg=1926.55, stdev=217.68, samples=20 00:29:19.439 iops : min= 320, max= 512, avg=481.60, stdev=54.42, samples=20 00:29:19.439 lat (msec) : 20=0.12%, 50=99.50%, 100=0.04%, 500=0.33% 00:29:19.439 cpu : usr=97.35%, sys=1.61%, ctx=52, majf=0, minf=53 00:29:19.439 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:19.439 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 issued rwts: total=4832,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.439 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.439 filename2: (groupid=0, jobs=1): err= 0: pid=163154: Fri Nov 29 09:52:40 2024 00:29:19.439 read: IOPS=475, BW=1904KiB/s (1949kB/s)(18.8MiB/10120msec) 00:29:19.439 slat (usec): min=6, max=104, avg=32.38, stdev=14.02 00:29:19.439 clat (msec): min=30, max=236, avg=33.17, stdev=11.76 00:29:19.439 lat (msec): min=30, max=236, avg=33.20, stdev=11.76 00:29:19.439 clat percentiles (msec): 00:29:19.439 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.439 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.439 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.439 | 99.00th=[ 43], 99.50th=[ 51], 99.90th=[ 226], 99.95th=[ 226], 00:29:19.439 | 99.99th=[ 236] 00:29:19.439 bw ( KiB/s): min= 1280, max= 2048, per=4.21%, avg=1920.00, stdev=219.75, samples=20 00:29:19.439 iops : min= 320, max= 512, avg=480.00, stdev=54.94, samples=20 00:29:19.439 lat (msec) : 50=99.29%, 100=0.33%, 250=0.37% 00:29:19.439 cpu : usr=98.54%, sys=1.05%, ctx=20, majf=0, minf=57 00:29:19.439 IO depths : 1=3.3%, 2=9.6%, 4=25.0%, 8=52.9%, 16=9.2%, 32=0.0%, >=64=0.0% 00:29:19.439 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 issued rwts: total=4816,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.439 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.439 filename2: (groupid=0, jobs=1): err= 0: pid=163155: Fri Nov 29 09:52:40 2024 00:29:19.439 read: IOPS=481, BW=1925KiB/s (1971kB/s)(18.9MiB/10074msec) 00:29:19.439 slat (usec): min=5, max=111, avg=28.94, stdev=15.33 00:29:19.439 clat (msec): min=14, max=226, avg=32.99, stdev=11.59 00:29:19.439 lat (msec): min=14, max=226, avg=33.02, stdev=11.59 00:29:19.439 clat percentiles (msec): 00:29:19.439 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.439 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.439 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.439 | 99.00th=[ 43], 99.50th=[ 44], 99.90th=[ 226], 99.95th=[ 226], 00:29:19.439 | 99.99th=[ 226] 00:29:19.439 bw ( KiB/s): min= 1408, max= 2176, per=4.24%, avg=1932.80, stdev=207.23, samples=20 00:29:19.439 iops : min= 352, max= 544, avg=483.20, stdev=51.81, samples=20 00:29:19.439 lat (msec) : 20=0.33%, 50=99.34%, 250=0.33% 00:29:19.439 cpu : usr=98.61%, sys=0.96%, ctx=15, majf=0, minf=60 00:29:19.439 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:19.439 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 issued rwts: total=4848,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.439 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.439 filename2: (groupid=0, jobs=1): err= 0: pid=163156: Fri Nov 29 09:52:40 2024 00:29:19.439 read: IOPS=475, BW=1902KiB/s (1948kB/s)(18.8MiB/10106msec) 00:29:19.439 slat (usec): min=7, max=105, avg=35.89, stdev=13.17 00:29:19.439 clat (msec): min=18, max=293, avg=33.31, stdev=15.52 00:29:19.439 lat (msec): min=18, max=293, avg=33.35, stdev=15.52 00:29:19.439 clat percentiles (msec): 00:29:19.439 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.439 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.439 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.439 | 99.00th=[ 43], 99.50th=[ 68], 99.90th=[ 292], 99.95th=[ 292], 00:29:19.439 | 99.99th=[ 292] 00:29:19.439 bw ( KiB/s): min= 1280, max= 2096, per=4.20%, avg=1916.15, stdev=224.32, samples=20 00:29:19.439 iops : min= 320, max= 524, avg=479.00, stdev=56.10, samples=20 00:29:19.439 lat (msec) : 20=0.12%, 50=99.21%, 100=0.33%, 500=0.33% 00:29:19.439 cpu : usr=97.47%, sys=1.57%, ctx=119, majf=0, minf=49 00:29:19.439 IO depths : 1=5.5%, 2=11.7%, 4=24.8%, 8=51.0%, 16=7.0%, 32=0.0%, >=64=0.0% 00:29:19.439 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 issued rwts: total=4806,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.439 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.439 filename2: (groupid=0, jobs=1): err= 0: pid=163158: Fri Nov 29 09:52:40 2024 00:29:19.439 read: IOPS=477, BW=1911KiB/s (1957kB/s)(18.9MiB/10145msec) 00:29:19.439 slat (usec): min=5, max=102, avg=37.80, stdev=14.35 00:29:19.439 clat (msec): min=11, max=185, avg=33.10, stdev=11.63 00:29:19.439 lat (msec): min=11, max=185, avg=33.14, stdev=11.63 00:29:19.439 clat percentiles (msec): 00:29:19.439 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.439 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.439 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.439 | 99.00th=[ 43], 99.50th=[ 155], 99.90th=[ 186], 99.95th=[ 186], 00:29:19.439 | 99.99th=[ 186] 00:29:19.439 bw ( KiB/s): min= 1408, max= 2176, per=4.24%, avg=1932.80, stdev=207.23, samples=20 00:29:19.439 iops : min= 352, max= 544, avg=483.20, stdev=51.81, samples=20 00:29:19.439 lat (msec) : 20=0.33%, 50=99.01%, 250=0.66% 00:29:19.439 cpu : usr=98.63%, sys=0.92%, ctx=23, majf=0, minf=38 00:29:19.439 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:19.439 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 issued rwts: total=4848,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.439 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.439 filename2: (groupid=0, jobs=1): err= 0: pid=163159: Fri Nov 29 09:52:40 2024 00:29:19.439 read: IOPS=479, BW=1916KiB/s (1962kB/s)(18.8MiB/10053msec) 00:29:19.439 slat (nsec): min=5299, max=92523, avg=32487.19, stdev=11933.75 00:29:19.439 clat (msec): min=29, max=226, avg=33.12, stdev=11.61 00:29:19.439 lat (msec): min=29, max=226, avg=33.15, stdev=11.61 00:29:19.439 clat percentiles (msec): 00:29:19.439 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.439 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.439 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.439 | 99.00th=[ 44], 99.50th=[ 51], 99.90th=[ 226], 99.95th=[ 226], 00:29:19.439 | 99.99th=[ 226] 00:29:19.439 bw ( KiB/s): min= 1280, max= 2048, per=4.21%, avg=1920.00, stdev=219.75, samples=20 00:29:19.439 iops : min= 320, max= 512, avg=480.00, stdev=54.94, samples=20 00:29:19.439 lat (msec) : 50=99.34%, 100=0.33%, 250=0.33% 00:29:19.439 cpu : usr=98.78%, sys=0.82%, ctx=14, majf=0, minf=51 00:29:19.439 IO depths : 1=5.8%, 2=12.0%, 4=24.9%, 8=50.6%, 16=6.7%, 32=0.0%, >=64=0.0% 00:29:19.439 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 issued rwts: total=4816,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.439 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.439 filename2: (groupid=0, jobs=1): err= 0: pid=163160: Fri Nov 29 09:52:40 2024 00:29:19.439 read: IOPS=475, BW=1901KiB/s (1947kB/s)(18.8MiB/10111msec) 00:29:19.439 slat (usec): min=8, max=106, avg=35.40, stdev=10.80 00:29:19.439 clat (msec): min=17, max=184, avg=33.35, stdev=11.82 00:29:19.439 lat (msec): min=17, max=184, avg=33.39, stdev=11.82 00:29:19.439 clat percentiles (msec): 00:29:19.439 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.439 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.439 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.439 | 99.00th=[ 44], 99.50th=[ 155], 99.90th=[ 186], 99.95th=[ 186], 00:29:19.439 | 99.99th=[ 186] 00:29:19.439 bw ( KiB/s): min= 1280, max= 2176, per=4.20%, avg=1916.15, stdev=224.30, samples=20 00:29:19.439 iops : min= 320, max= 544, avg=479.00, stdev=56.09, samples=20 00:29:19.439 lat (msec) : 20=0.25%, 50=98.75%, 100=0.33%, 250=0.67% 00:29:19.439 cpu : usr=98.41%, sys=1.20%, ctx=14, majf=0, minf=38 00:29:19.439 IO depths : 1=6.1%, 2=12.3%, 4=24.8%, 8=50.4%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:19.439 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.439 issued rwts: total=4806,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.439 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.439 filename2: (groupid=0, jobs=1): err= 0: pid=163161: Fri Nov 29 09:52:40 2024 00:29:19.439 read: IOPS=475, BW=1900KiB/s (1946kB/s)(18.8MiB/10105msec) 00:29:19.439 slat (usec): min=9, max=142, avg=35.79, stdev=12.93 00:29:19.439 clat (msec): min=30, max=185, avg=33.35, stdev=11.76 00:29:19.439 lat (msec): min=30, max=185, avg=33.38, stdev=11.76 00:29:19.439 clat percentiles (msec): 00:29:19.439 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:29:19.439 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:19.439 | 70.00th=[ 32], 80.00th=[ 33], 90.00th=[ 40], 95.00th=[ 40], 00:29:19.439 | 99.00th=[ 43], 99.50th=[ 155], 99.90th=[ 184], 99.95th=[ 186], 00:29:19.439 | 99.99th=[ 186] 00:29:19.439 bw ( KiB/s): min= 1280, max= 2048, per=4.20%, avg=1913.75, stdev=221.52, samples=20 00:29:19.440 iops : min= 320, max= 512, avg=478.40, stdev=55.40, samples=20 00:29:19.440 lat (msec) : 50=99.00%, 100=0.33%, 250=0.67% 00:29:19.440 cpu : usr=96.13%, sys=2.11%, ctx=319, majf=0, minf=35 00:29:19.440 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:19.440 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.440 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:19.440 issued rwts: total=4800,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:19.440 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:19.440 00:29:19.440 Run status group 0 (all jobs): 00:29:19.440 READ: bw=44.5MiB/s (46.7MB/s), 1899KiB/s-1925KiB/s (1944kB/s-1972kB/s), io=452MiB (474MB), run=10037-10145msec 00:29:19.440 09:52:40 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:19.440 09:52:40 -- target/dif.sh@43 -- # local sub 00:29:19.440 09:52:40 -- target/dif.sh@45 -- # for sub in "$@" 00:29:19.440 09:52:40 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:19.440 09:52:40 -- target/dif.sh@36 -- # local sub_id=0 00:29:19.440 09:52:40 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:19.440 09:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.440 09:52:40 -- common/autotest_common.sh@10 -- # set +x 00:29:19.440 09:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.440 09:52:40 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:19.440 09:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.440 09:52:40 -- common/autotest_common.sh@10 -- # set +x 00:29:19.440 09:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.440 09:52:40 -- target/dif.sh@45 -- # for sub in "$@" 00:29:19.440 09:52:40 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:19.440 09:52:40 -- target/dif.sh@36 -- # local sub_id=1 00:29:19.440 09:52:40 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:19.440 09:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.440 09:52:40 -- common/autotest_common.sh@10 -- # set +x 00:29:19.440 09:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.440 09:52:40 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:19.440 09:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.440 09:52:40 -- common/autotest_common.sh@10 -- # set +x 00:29:19.440 09:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.440 09:52:40 -- target/dif.sh@45 -- # for sub in "$@" 00:29:19.440 09:52:40 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:19.440 09:52:40 -- target/dif.sh@36 -- # local sub_id=2 00:29:19.440 09:52:40 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:19.440 09:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.440 09:52:40 -- common/autotest_common.sh@10 -- # set +x 00:29:19.440 09:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.440 09:52:40 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:19.440 09:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.440 09:52:40 -- common/autotest_common.sh@10 -- # set +x 00:29:19.440 09:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.440 09:52:40 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:19.440 09:52:40 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:19.440 09:52:40 -- target/dif.sh@115 -- # numjobs=2 00:29:19.440 09:52:40 -- target/dif.sh@115 -- # iodepth=8 00:29:19.440 09:52:40 -- target/dif.sh@115 -- # runtime=5 00:29:19.440 09:52:40 -- target/dif.sh@115 -- # files=1 00:29:19.440 09:52:40 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:19.440 09:52:40 -- target/dif.sh@28 -- # local sub 00:29:19.440 09:52:40 -- target/dif.sh@30 -- # for sub in "$@" 00:29:19.440 09:52:40 -- target/dif.sh@31 -- # create_subsystem 0 00:29:19.440 09:52:40 -- target/dif.sh@18 -- # local sub_id=0 00:29:19.440 09:52:40 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:19.440 09:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.440 09:52:40 -- common/autotest_common.sh@10 -- # set +x 00:29:19.440 bdev_null0 00:29:19.440 09:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.440 09:52:40 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:19.440 09:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.440 09:52:40 -- common/autotest_common.sh@10 -- # set +x 00:29:19.440 09:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.440 09:52:40 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:19.440 09:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.440 09:52:40 -- common/autotest_common.sh@10 -- # set +x 00:29:19.440 09:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.440 09:52:40 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:19.440 09:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.440 09:52:40 -- common/autotest_common.sh@10 -- # set +x 00:29:19.440 [2024-11-29 09:52:40.538523] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:19.440 09:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.440 09:52:40 -- target/dif.sh@30 -- # for sub in "$@" 00:29:19.440 09:52:40 -- target/dif.sh@31 -- # create_subsystem 1 00:29:19.440 09:52:40 -- target/dif.sh@18 -- # local sub_id=1 00:29:19.440 09:52:40 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:19.440 09:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.440 09:52:40 -- common/autotest_common.sh@10 -- # set +x 00:29:19.440 bdev_null1 00:29:19.440 09:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.440 09:52:40 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:19.440 09:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.440 09:52:40 -- common/autotest_common.sh@10 -- # set +x 00:29:19.440 09:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.440 09:52:40 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:19.440 09:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.440 09:52:40 -- common/autotest_common.sh@10 -- # set +x 00:29:19.440 09:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.440 09:52:40 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:19.440 09:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.440 09:52:40 -- common/autotest_common.sh@10 -- # set +x 00:29:19.440 09:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.440 09:52:40 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:19.440 09:52:40 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:19.440 09:52:40 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:19.440 09:52:40 -- nvmf/common.sh@520 -- # config=() 00:29:19.440 09:52:40 -- nvmf/common.sh@520 -- # local subsystem config 00:29:19.440 09:52:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:19.440 09:52:40 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:19.440 09:52:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:19.440 { 00:29:19.440 "params": { 00:29:19.440 "name": "Nvme$subsystem", 00:29:19.440 "trtype": "$TEST_TRANSPORT", 00:29:19.440 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:19.440 "adrfam": "ipv4", 00:29:19.440 "trsvcid": "$NVMF_PORT", 00:29:19.440 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:19.440 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:19.440 "hdgst": ${hdgst:-false}, 00:29:19.440 "ddgst": ${ddgst:-false} 00:29:19.440 }, 00:29:19.440 "method": "bdev_nvme_attach_controller" 00:29:19.440 } 00:29:19.440 EOF 00:29:19.440 )") 00:29:19.440 09:52:40 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:19.440 09:52:40 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:19.440 09:52:40 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:19.440 09:52:40 -- target/dif.sh@82 -- # gen_fio_conf 00:29:19.440 09:52:40 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:19.440 09:52:40 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:19.440 09:52:40 -- target/dif.sh@54 -- # local file 00:29:19.440 09:52:40 -- common/autotest_common.sh@1330 -- # shift 00:29:19.440 09:52:40 -- target/dif.sh@56 -- # cat 00:29:19.440 09:52:40 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:19.440 09:52:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:19.440 09:52:40 -- nvmf/common.sh@542 -- # cat 00:29:19.440 09:52:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:19.440 09:52:40 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:19.440 09:52:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:19.440 09:52:40 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:19.440 09:52:40 -- target/dif.sh@72 -- # (( file <= files )) 00:29:19.440 09:52:40 -- target/dif.sh@73 -- # cat 00:29:19.440 09:52:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:19.440 09:52:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:19.440 { 00:29:19.440 "params": { 00:29:19.440 "name": "Nvme$subsystem", 00:29:19.440 "trtype": "$TEST_TRANSPORT", 00:29:19.440 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:19.440 "adrfam": "ipv4", 00:29:19.440 "trsvcid": "$NVMF_PORT", 00:29:19.440 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:19.440 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:19.440 "hdgst": ${hdgst:-false}, 00:29:19.440 "ddgst": ${ddgst:-false} 00:29:19.440 }, 00:29:19.440 "method": "bdev_nvme_attach_controller" 00:29:19.440 } 00:29:19.440 EOF 00:29:19.440 )") 00:29:19.440 09:52:40 -- nvmf/common.sh@542 -- # cat 00:29:19.440 09:52:40 -- target/dif.sh@72 -- # (( file++ )) 00:29:19.440 09:52:40 -- target/dif.sh@72 -- # (( file <= files )) 00:29:19.440 09:52:40 -- nvmf/common.sh@544 -- # jq . 00:29:19.440 09:52:40 -- nvmf/common.sh@545 -- # IFS=, 00:29:19.440 09:52:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:19.440 "params": { 00:29:19.440 "name": "Nvme0", 00:29:19.440 "trtype": "tcp", 00:29:19.440 "traddr": "10.0.0.2", 00:29:19.440 "adrfam": "ipv4", 00:29:19.440 "trsvcid": "4420", 00:29:19.440 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:19.440 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:19.440 "hdgst": false, 00:29:19.440 "ddgst": false 00:29:19.440 }, 00:29:19.440 "method": "bdev_nvme_attach_controller" 00:29:19.440 },{ 00:29:19.440 "params": { 00:29:19.441 "name": "Nvme1", 00:29:19.441 "trtype": "tcp", 00:29:19.441 "traddr": "10.0.0.2", 00:29:19.441 "adrfam": "ipv4", 00:29:19.441 "trsvcid": "4420", 00:29:19.441 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:19.441 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:19.441 "hdgst": false, 00:29:19.441 "ddgst": false 00:29:19.441 }, 00:29:19.441 "method": "bdev_nvme_attach_controller" 00:29:19.441 }' 00:29:19.441 09:52:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:19.441 09:52:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:19.441 09:52:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:19.441 09:52:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:19.441 09:52:40 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:19.441 09:52:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:19.441 09:52:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:19.441 09:52:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:19.441 09:52:40 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:19.441 09:52:40 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:19.441 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:19.441 ... 00:29:19.441 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:19.441 ... 00:29:19.441 fio-3.35 00:29:19.441 Starting 4 threads 00:29:19.441 EAL: No free 2048 kB hugepages reported on node 1 00:29:19.441 [2024-11-29 09:52:41.582959] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:19.441 [2024-11-29 09:52:41.583025] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:24.705 00:29:24.705 filename0: (groupid=0, jobs=1): err= 0: pid=164657: Fri Nov 29 09:52:46 2024 00:29:24.705 read: IOPS=1963, BW=15.3MiB/s (16.1MB/s)(76.7MiB/5002msec) 00:29:24.705 slat (usec): min=4, max=133, avg=17.45, stdev= 9.69 00:29:24.705 clat (usec): min=695, max=7096, avg=4013.45, stdev=569.84 00:29:24.705 lat (usec): min=708, max=7104, avg=4030.90, stdev=569.87 00:29:24.705 clat percentiles (usec): 00:29:24.705 | 1.00th=[ 2278], 5.00th=[ 3261], 10.00th=[ 3556], 20.00th=[ 3785], 00:29:24.705 | 30.00th=[ 3851], 40.00th=[ 3916], 50.00th=[ 3982], 60.00th=[ 4015], 00:29:24.705 | 70.00th=[ 4080], 80.00th=[ 4228], 90.00th=[ 4490], 95.00th=[ 4948], 00:29:24.705 | 99.00th=[ 6194], 99.50th=[ 6390], 99.90th=[ 6783], 99.95th=[ 6980], 00:29:24.705 | 99.99th=[ 7111] 00:29:24.705 bw ( KiB/s): min=15200, max=16256, per=24.72%, avg=15702.30, stdev=312.94, samples=10 00:29:24.705 iops : min= 1900, max= 2032, avg=1962.70, stdev=39.06, samples=10 00:29:24.705 lat (usec) : 750=0.03%, 1000=0.09% 00:29:24.705 lat (msec) : 2=0.69%, 4=54.90%, 10=44.29% 00:29:24.705 cpu : usr=82.86%, sys=9.64%, ctx=203, majf=0, minf=0 00:29:24.705 IO depths : 1=0.1%, 2=12.5%, 4=59.7%, 8=27.6%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:24.705 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.705 complete : 0=0.0%, 4=92.2%, 8=7.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.705 issued rwts: total=9820,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:24.705 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:24.705 filename0: (groupid=0, jobs=1): err= 0: pid=164658: Fri Nov 29 09:52:46 2024 00:29:24.705 read: IOPS=1981, BW=15.5MiB/s (16.2MB/s)(77.5MiB/5003msec) 00:29:24.705 slat (nsec): min=4634, max=74828, avg=16641.33, stdev=8524.48 00:29:24.705 clat (usec): min=711, max=7228, avg=3980.48, stdev=543.58 00:29:24.705 lat (usec): min=726, max=7237, avg=3997.12, stdev=543.70 00:29:24.705 clat percentiles (usec): 00:29:24.705 | 1.00th=[ 2376], 5.00th=[ 3228], 10.00th=[ 3490], 20.00th=[ 3720], 00:29:24.705 | 30.00th=[ 3851], 40.00th=[ 3916], 50.00th=[ 3982], 60.00th=[ 4015], 00:29:24.705 | 70.00th=[ 4080], 80.00th=[ 4178], 90.00th=[ 4424], 95.00th=[ 4817], 00:29:24.705 | 99.00th=[ 5997], 99.50th=[ 6456], 99.90th=[ 6783], 99.95th=[ 6980], 00:29:24.705 | 99.99th=[ 7242] 00:29:24.705 bw ( KiB/s): min=15424, max=16112, per=24.96%, avg=15852.80, stdev=198.53, samples=10 00:29:24.705 iops : min= 1928, max= 2014, avg=1981.60, stdev=24.82, samples=10 00:29:24.705 lat (usec) : 750=0.01%, 1000=0.05% 00:29:24.705 lat (msec) : 2=0.62%, 4=55.75%, 10=43.57% 00:29:24.705 cpu : usr=95.92%, sys=3.36%, ctx=33, majf=0, minf=0 00:29:24.705 IO depths : 1=0.1%, 2=11.6%, 4=59.9%, 8=28.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:24.705 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.705 complete : 0=0.0%, 4=92.9%, 8=7.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.705 issued rwts: total=9914,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:24.705 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:24.705 filename1: (groupid=0, jobs=1): err= 0: pid=164659: Fri Nov 29 09:52:46 2024 00:29:24.705 read: IOPS=1963, BW=15.3MiB/s (16.1MB/s)(76.7MiB/5001msec) 00:29:24.705 slat (nsec): min=4219, max=60602, avg=17636.85, stdev=8666.69 00:29:24.705 clat (usec): min=690, max=7725, avg=4011.85, stdev=588.18 00:29:24.705 lat (usec): min=703, max=7740, avg=4029.49, stdev=588.13 00:29:24.705 clat percentiles (usec): 00:29:24.705 | 1.00th=[ 2442], 5.00th=[ 3228], 10.00th=[ 3556], 20.00th=[ 3785], 00:29:24.705 | 30.00th=[ 3851], 40.00th=[ 3916], 50.00th=[ 3949], 60.00th=[ 4015], 00:29:24.705 | 70.00th=[ 4080], 80.00th=[ 4228], 90.00th=[ 4555], 95.00th=[ 5014], 00:29:24.705 | 99.00th=[ 6259], 99.50th=[ 6521], 99.90th=[ 6915], 99.95th=[ 7111], 00:29:24.705 | 99.99th=[ 7701] 00:29:24.705 bw ( KiB/s): min=15456, max=15824, per=24.71%, avg=15696.00, stdev=121.06, samples=9 00:29:24.705 iops : min= 1932, max= 1978, avg=1962.00, stdev=15.13, samples=9 00:29:24.705 lat (usec) : 750=0.04%, 1000=0.05% 00:29:24.705 lat (msec) : 2=0.60%, 4=56.11%, 10=43.19% 00:29:24.705 cpu : usr=95.58%, sys=3.80%, ctx=10, majf=0, minf=9 00:29:24.705 IO depths : 1=0.1%, 2=12.8%, 4=58.9%, 8=28.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:24.705 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.705 complete : 0=0.0%, 4=92.7%, 8=7.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.705 issued rwts: total=9821,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:24.705 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:24.705 filename1: (groupid=0, jobs=1): err= 0: pid=164660: Fri Nov 29 09:52:46 2024 00:29:24.705 read: IOPS=2031, BW=15.9MiB/s (16.6MB/s)(79.4MiB/5002msec) 00:29:24.705 slat (nsec): min=3543, max=60361, avg=16527.79, stdev=8010.69 00:29:24.705 clat (usec): min=824, max=7339, avg=3884.12, stdev=520.51 00:29:24.705 lat (usec): min=833, max=7358, avg=3900.65, stdev=520.96 00:29:24.705 clat percentiles (usec): 00:29:24.705 | 1.00th=[ 2409], 5.00th=[ 3032], 10.00th=[ 3294], 20.00th=[ 3589], 00:29:24.705 | 30.00th=[ 3752], 40.00th=[ 3884], 50.00th=[ 3949], 60.00th=[ 3982], 00:29:24.705 | 70.00th=[ 4047], 80.00th=[ 4146], 90.00th=[ 4293], 95.00th=[ 4490], 00:29:24.705 | 99.00th=[ 5669], 99.50th=[ 6128], 99.90th=[ 7046], 99.95th=[ 7046], 00:29:24.705 | 99.99th=[ 7111] 00:29:24.705 bw ( KiB/s): min=15680, max=17248, per=25.58%, avg=16248.00, stdev=546.05, samples=10 00:29:24.705 iops : min= 1960, max= 2156, avg=2031.00, stdev=68.26, samples=10 00:29:24.705 lat (usec) : 1000=0.05% 00:29:24.705 lat (msec) : 2=0.50%, 4=60.39%, 10=39.06% 00:29:24.705 cpu : usr=94.96%, sys=4.50%, ctx=10, majf=0, minf=9 00:29:24.705 IO depths : 1=0.2%, 2=10.7%, 4=60.4%, 8=28.6%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:24.705 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.705 complete : 0=0.0%, 4=93.1%, 8=6.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:24.705 issued rwts: total=10163,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:24.705 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:24.705 00:29:24.705 Run status group 0 (all jobs): 00:29:24.705 READ: bw=62.0MiB/s (65.0MB/s), 15.3MiB/s-15.9MiB/s (16.1MB/s-16.6MB/s), io=310MiB (325MB), run=5001-5003msec 00:29:24.705 09:52:46 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:24.705 09:52:46 -- target/dif.sh@43 -- # local sub 00:29:24.705 09:52:46 -- target/dif.sh@45 -- # for sub in "$@" 00:29:24.705 09:52:46 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:24.705 09:52:46 -- target/dif.sh@36 -- # local sub_id=0 00:29:24.705 09:52:46 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:24.705 09:52:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.705 09:52:46 -- common/autotest_common.sh@10 -- # set +x 00:29:24.705 09:52:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.705 09:52:46 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:24.705 09:52:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.705 09:52:46 -- common/autotest_common.sh@10 -- # set +x 00:29:24.705 09:52:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.705 09:52:46 -- target/dif.sh@45 -- # for sub in "$@" 00:29:24.705 09:52:46 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:24.705 09:52:46 -- target/dif.sh@36 -- # local sub_id=1 00:29:24.705 09:52:46 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:24.705 09:52:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.705 09:52:46 -- common/autotest_common.sh@10 -- # set +x 00:29:24.705 09:52:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.705 09:52:46 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:24.705 09:52:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.705 09:52:46 -- common/autotest_common.sh@10 -- # set +x 00:29:24.705 09:52:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.705 00:29:24.706 real 0m24.498s 00:29:24.706 user 4m34.389s 00:29:24.706 sys 0m6.148s 00:29:24.706 09:52:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:24.706 09:52:47 -- common/autotest_common.sh@10 -- # set +x 00:29:24.706 ************************************ 00:29:24.706 END TEST fio_dif_rand_params 00:29:24.706 ************************************ 00:29:24.706 09:52:47 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:24.706 09:52:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:24.706 09:52:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:24.706 09:52:47 -- common/autotest_common.sh@10 -- # set +x 00:29:24.706 ************************************ 00:29:24.706 START TEST fio_dif_digest 00:29:24.706 ************************************ 00:29:24.706 09:52:47 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:24.706 09:52:47 -- target/dif.sh@123 -- # local NULL_DIF 00:29:24.706 09:52:47 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:24.706 09:52:47 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:24.706 09:52:47 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:24.706 09:52:47 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:24.706 09:52:47 -- target/dif.sh@127 -- # numjobs=3 00:29:24.706 09:52:47 -- target/dif.sh@127 -- # iodepth=3 00:29:24.706 09:52:47 -- target/dif.sh@127 -- # runtime=10 00:29:24.706 09:52:47 -- target/dif.sh@128 -- # hdgst=true 00:29:24.706 09:52:47 -- target/dif.sh@128 -- # ddgst=true 00:29:24.706 09:52:47 -- target/dif.sh@130 -- # create_subsystems 0 00:29:24.706 09:52:47 -- target/dif.sh@28 -- # local sub 00:29:24.706 09:52:47 -- target/dif.sh@30 -- # for sub in "$@" 00:29:24.706 09:52:47 -- target/dif.sh@31 -- # create_subsystem 0 00:29:24.706 09:52:47 -- target/dif.sh@18 -- # local sub_id=0 00:29:24.706 09:52:47 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:24.706 09:52:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.706 09:52:47 -- common/autotest_common.sh@10 -- # set +x 00:29:24.706 bdev_null0 00:29:24.706 09:52:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.706 09:52:47 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:24.706 09:52:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.706 09:52:47 -- common/autotest_common.sh@10 -- # set +x 00:29:24.706 09:52:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.706 09:52:47 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:24.706 09:52:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.706 09:52:47 -- common/autotest_common.sh@10 -- # set +x 00:29:24.706 09:52:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.706 09:52:47 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:24.706 09:52:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.706 09:52:47 -- common/autotest_common.sh@10 -- # set +x 00:29:24.706 [2024-11-29 09:52:47.063282] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:24.706 09:52:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.706 09:52:47 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:24.706 09:52:47 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:24.706 09:52:47 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:24.706 09:52:47 -- nvmf/common.sh@520 -- # config=() 00:29:24.706 09:52:47 -- nvmf/common.sh@520 -- # local subsystem config 00:29:24.706 09:52:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:24.706 09:52:47 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:24.706 09:52:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:24.706 { 00:29:24.706 "params": { 00:29:24.706 "name": "Nvme$subsystem", 00:29:24.706 "trtype": "$TEST_TRANSPORT", 00:29:24.706 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:24.706 "adrfam": "ipv4", 00:29:24.706 "trsvcid": "$NVMF_PORT", 00:29:24.706 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:24.706 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:24.706 "hdgst": ${hdgst:-false}, 00:29:24.706 "ddgst": ${ddgst:-false} 00:29:24.706 }, 00:29:24.706 "method": "bdev_nvme_attach_controller" 00:29:24.706 } 00:29:24.706 EOF 00:29:24.706 )") 00:29:24.706 09:52:47 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:24.706 09:52:47 -- target/dif.sh@82 -- # gen_fio_conf 00:29:24.706 09:52:47 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:24.706 09:52:47 -- target/dif.sh@54 -- # local file 00:29:24.706 09:52:47 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:24.706 09:52:47 -- target/dif.sh@56 -- # cat 00:29:24.706 09:52:47 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:24.706 09:52:47 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:24.706 09:52:47 -- common/autotest_common.sh@1330 -- # shift 00:29:24.706 09:52:47 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:24.706 09:52:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:24.706 09:52:47 -- nvmf/common.sh@542 -- # cat 00:29:24.706 09:52:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:24.706 09:52:47 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:24.706 09:52:47 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:24.706 09:52:47 -- target/dif.sh@72 -- # (( file <= files )) 00:29:24.706 09:52:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:24.706 09:52:47 -- nvmf/common.sh@544 -- # jq . 00:29:24.706 09:52:47 -- nvmf/common.sh@545 -- # IFS=, 00:29:24.706 09:52:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:24.706 "params": { 00:29:24.706 "name": "Nvme0", 00:29:24.706 "trtype": "tcp", 00:29:24.706 "traddr": "10.0.0.2", 00:29:24.706 "adrfam": "ipv4", 00:29:24.706 "trsvcid": "4420", 00:29:24.706 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:24.706 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:24.706 "hdgst": true, 00:29:24.706 "ddgst": true 00:29:24.706 }, 00:29:24.706 "method": "bdev_nvme_attach_controller" 00:29:24.706 }' 00:29:24.706 09:52:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:24.706 09:52:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:24.706 09:52:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:24.706 09:52:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:24.706 09:52:47 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:24.706 09:52:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:24.706 09:52:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:24.706 09:52:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:24.706 09:52:47 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:24.706 09:52:47 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:24.706 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:24.706 ... 00:29:24.706 fio-3.35 00:29:24.706 Starting 3 threads 00:29:24.706 EAL: No free 2048 kB hugepages reported on node 1 00:29:24.963 [2024-11-29 09:52:47.788677] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:24.963 [2024-11-29 09:52:47.788776] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:37.164 00:29:37.164 filename0: (groupid=0, jobs=1): err= 0: pid=165428: Fri Nov 29 09:52:57 2024 00:29:37.164 read: IOPS=200, BW=25.0MiB/s (26.2MB/s)(251MiB/10046msec) 00:29:37.164 slat (usec): min=4, max=109, avg=16.67, stdev= 5.36 00:29:37.164 clat (usec): min=11528, max=56603, avg=14945.46, stdev=1634.30 00:29:37.164 lat (usec): min=11547, max=56621, avg=14962.13, stdev=1634.04 00:29:37.164 clat percentiles (usec): 00:29:37.164 | 1.00th=[12518], 5.00th=[13042], 10.00th=[13566], 20.00th=[13960], 00:29:37.164 | 30.00th=[14353], 40.00th=[14615], 50.00th=[14877], 60.00th=[15139], 00:29:37.164 | 70.00th=[15401], 80.00th=[15795], 90.00th=[16319], 95.00th=[16712], 00:29:37.164 | 99.00th=[17695], 99.50th=[17957], 99.90th=[20317], 99.95th=[48497], 00:29:37.164 | 99.99th=[56361] 00:29:37.164 bw ( KiB/s): min=24576, max=27392, per=33.19%, avg=25715.20, stdev=904.05, samples=20 00:29:37.164 iops : min= 192, max= 214, avg=200.90, stdev= 7.06, samples=20 00:29:37.164 lat (msec) : 20=99.75%, 50=0.20%, 100=0.05% 00:29:37.164 cpu : usr=94.70%, sys=4.82%, ctx=27, majf=0, minf=208 00:29:37.164 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:37.164 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.164 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.164 issued rwts: total=2011,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:37.164 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:37.164 filename0: (groupid=0, jobs=1): err= 0: pid=165429: Fri Nov 29 09:52:57 2024 00:29:37.164 read: IOPS=199, BW=25.0MiB/s (26.2MB/s)(251MiB/10047msec) 00:29:37.164 slat (nsec): min=4467, max=49165, avg=19576.85, stdev=4705.24 00:29:37.164 clat (usec): min=11413, max=49377, avg=14972.75, stdev=1492.79 00:29:37.164 lat (usec): min=11428, max=49398, avg=14992.32, stdev=1493.29 00:29:37.164 clat percentiles (usec): 00:29:37.164 | 1.00th=[12649], 5.00th=[13173], 10.00th=[13566], 20.00th=[14091], 00:29:37.164 | 30.00th=[14353], 40.00th=[14615], 50.00th=[14877], 60.00th=[15139], 00:29:37.164 | 70.00th=[15401], 80.00th=[15795], 90.00th=[16319], 95.00th=[16909], 00:29:37.164 | 99.00th=[17695], 99.50th=[17957], 99.90th=[19792], 99.95th=[46924], 00:29:37.164 | 99.99th=[49546] 00:29:37.164 bw ( KiB/s): min=24832, max=27136, per=33.11%, avg=25653.75, stdev=682.79, samples=20 00:29:37.164 iops : min= 194, max= 212, avg=200.40, stdev= 5.34, samples=20 00:29:37.164 lat (msec) : 20=99.90%, 50=0.10% 00:29:37.164 cpu : usr=95.04%, sys=4.46%, ctx=26, majf=0, minf=138 00:29:37.164 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:37.164 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.164 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.164 issued rwts: total=2007,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:37.164 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:37.164 filename0: (groupid=0, jobs=1): err= 0: pid=165430: Fri Nov 29 09:52:57 2024 00:29:37.164 read: IOPS=205, BW=25.7MiB/s (26.9MB/s)(258MiB/10047msec) 00:29:37.164 slat (nsec): min=4113, max=90870, avg=17124.75, stdev=5275.42 00:29:37.164 clat (usec): min=10739, max=54430, avg=14561.35, stdev=1568.78 00:29:37.164 lat (usec): min=10753, max=54443, avg=14578.47, stdev=1568.35 00:29:37.164 clat percentiles (usec): 00:29:37.164 | 1.00th=[12125], 5.00th=[12911], 10.00th=[13173], 20.00th=[13698], 00:29:37.164 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14484], 60.00th=[14746], 00:29:37.164 | 70.00th=[15008], 80.00th=[15270], 90.00th=[15795], 95.00th=[16188], 00:29:37.164 | 99.00th=[17171], 99.50th=[17433], 99.90th=[25297], 99.95th=[47973], 00:29:37.164 | 99.99th=[54264] 00:29:37.164 bw ( KiB/s): min=25344, max=27904, per=34.06%, avg=26390.95, stdev=760.97, samples=20 00:29:37.164 iops : min= 198, max= 218, avg=206.15, stdev= 5.95, samples=20 00:29:37.164 lat (msec) : 20=99.76%, 50=0.19%, 100=0.05% 00:29:37.164 cpu : usr=94.16%, sys=5.37%, ctx=19, majf=0, minf=167 00:29:37.164 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:37.164 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.164 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.164 issued rwts: total=2064,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:37.164 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:37.164 00:29:37.164 Run status group 0 (all jobs): 00:29:37.164 READ: bw=75.7MiB/s (79.3MB/s), 25.0MiB/s-25.7MiB/s (26.2MB/s-26.9MB/s), io=760MiB (797MB), run=10046-10047msec 00:29:37.164 09:52:58 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:37.164 09:52:58 -- target/dif.sh@43 -- # local sub 00:29:37.164 09:52:58 -- target/dif.sh@45 -- # for sub in "$@" 00:29:37.164 09:52:58 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:37.164 09:52:58 -- target/dif.sh@36 -- # local sub_id=0 00:29:37.164 09:52:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:37.164 09:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.164 09:52:58 -- common/autotest_common.sh@10 -- # set +x 00:29:37.164 09:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.164 09:52:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:37.164 09:52:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.164 09:52:58 -- common/autotest_common.sh@10 -- # set +x 00:29:37.164 09:52:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.164 00:29:37.164 real 0m11.272s 00:29:37.164 user 0m29.760s 00:29:37.164 sys 0m1.728s 00:29:37.164 09:52:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:37.164 09:52:58 -- common/autotest_common.sh@10 -- # set +x 00:29:37.164 ************************************ 00:29:37.164 END TEST fio_dif_digest 00:29:37.164 ************************************ 00:29:37.164 09:52:58 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:37.164 09:52:58 -- target/dif.sh@147 -- # nvmftestfini 00:29:37.164 09:52:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:37.164 09:52:58 -- nvmf/common.sh@116 -- # sync 00:29:37.164 09:52:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:37.164 09:52:58 -- nvmf/common.sh@119 -- # set +e 00:29:37.164 09:52:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:37.164 09:52:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:37.164 rmmod nvme_tcp 00:29:37.164 rmmod nvme_fabrics 00:29:37.164 rmmod nvme_keyring 00:29:37.164 09:52:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:37.164 09:52:58 -- nvmf/common.sh@123 -- # set -e 00:29:37.164 09:52:58 -- nvmf/common.sh@124 -- # return 0 00:29:37.164 09:52:58 -- nvmf/common.sh@477 -- # '[' -n 159079 ']' 00:29:37.164 09:52:58 -- nvmf/common.sh@478 -- # killprocess 159079 00:29:37.164 09:52:58 -- common/autotest_common.sh@936 -- # '[' -z 159079 ']' 00:29:37.164 09:52:58 -- common/autotest_common.sh@940 -- # kill -0 159079 00:29:37.164 09:52:58 -- common/autotest_common.sh@941 -- # uname 00:29:37.164 09:52:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:37.164 09:52:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 159079 00:29:37.164 09:52:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:37.164 09:52:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:37.164 09:52:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 159079' 00:29:37.164 killing process with pid 159079 00:29:37.164 09:52:58 -- common/autotest_common.sh@955 -- # kill 159079 00:29:37.164 09:52:58 -- common/autotest_common.sh@960 -- # wait 159079 00:29:37.164 09:52:58 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:37.164 09:52:58 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:37.164 Waiting for block devices as requested 00:29:37.164 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:37.164 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:37.474 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:37.474 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:37.474 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:37.753 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:37.753 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:37.753 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:37.753 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:37.753 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:38.013 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:38.013 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:38.013 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:38.013 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:38.272 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:38.272 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:38.272 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:38.533 09:53:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:38.533 09:53:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:38.533 09:53:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:38.533 09:53:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:38.533 09:53:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:38.533 09:53:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:38.533 09:53:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:40.442 09:53:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:40.442 00:29:40.442 real 1m7.974s 00:29:40.442 user 6m32.957s 00:29:40.442 sys 0m17.127s 00:29:40.442 09:53:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:40.442 09:53:03 -- common/autotest_common.sh@10 -- # set +x 00:29:40.442 ************************************ 00:29:40.442 END TEST nvmf_dif 00:29:40.442 ************************************ 00:29:40.442 09:53:03 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:40.442 09:53:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:40.442 09:53:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:40.442 09:53:03 -- common/autotest_common.sh@10 -- # set +x 00:29:40.442 ************************************ 00:29:40.442 START TEST nvmf_abort_qd_sizes 00:29:40.442 ************************************ 00:29:40.442 09:53:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:40.442 * Looking for test storage... 00:29:40.442 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:40.442 09:53:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:40.442 09:53:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:40.442 09:53:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:40.702 09:53:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:40.702 09:53:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:40.702 09:53:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:40.702 09:53:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:40.702 09:53:03 -- scripts/common.sh@335 -- # IFS=.-: 00:29:40.702 09:53:03 -- scripts/common.sh@335 -- # read -ra ver1 00:29:40.702 09:53:03 -- scripts/common.sh@336 -- # IFS=.-: 00:29:40.702 09:53:03 -- scripts/common.sh@336 -- # read -ra ver2 00:29:40.702 09:53:03 -- scripts/common.sh@337 -- # local 'op=<' 00:29:40.702 09:53:03 -- scripts/common.sh@339 -- # ver1_l=2 00:29:40.702 09:53:03 -- scripts/common.sh@340 -- # ver2_l=1 00:29:40.702 09:53:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:40.702 09:53:03 -- scripts/common.sh@343 -- # case "$op" in 00:29:40.702 09:53:03 -- scripts/common.sh@344 -- # : 1 00:29:40.702 09:53:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:40.702 09:53:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:40.702 09:53:03 -- scripts/common.sh@364 -- # decimal 1 00:29:40.702 09:53:03 -- scripts/common.sh@352 -- # local d=1 00:29:40.702 09:53:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:40.702 09:53:03 -- scripts/common.sh@354 -- # echo 1 00:29:40.702 09:53:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:40.702 09:53:03 -- scripts/common.sh@365 -- # decimal 2 00:29:40.702 09:53:03 -- scripts/common.sh@352 -- # local d=2 00:29:40.702 09:53:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:40.702 09:53:03 -- scripts/common.sh@354 -- # echo 2 00:29:40.702 09:53:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:40.702 09:53:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:40.702 09:53:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:40.702 09:53:03 -- scripts/common.sh@367 -- # return 0 00:29:40.702 09:53:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:40.702 09:53:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:40.702 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:40.702 --rc genhtml_branch_coverage=1 00:29:40.702 --rc genhtml_function_coverage=1 00:29:40.702 --rc genhtml_legend=1 00:29:40.702 --rc geninfo_all_blocks=1 00:29:40.702 --rc geninfo_unexecuted_blocks=1 00:29:40.702 00:29:40.702 ' 00:29:40.702 09:53:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:40.702 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:40.702 --rc genhtml_branch_coverage=1 00:29:40.702 --rc genhtml_function_coverage=1 00:29:40.702 --rc genhtml_legend=1 00:29:40.702 --rc geninfo_all_blocks=1 00:29:40.702 --rc geninfo_unexecuted_blocks=1 00:29:40.702 00:29:40.702 ' 00:29:40.702 09:53:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:40.702 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:40.702 --rc genhtml_branch_coverage=1 00:29:40.702 --rc genhtml_function_coverage=1 00:29:40.702 --rc genhtml_legend=1 00:29:40.702 --rc geninfo_all_blocks=1 00:29:40.702 --rc geninfo_unexecuted_blocks=1 00:29:40.702 00:29:40.702 ' 00:29:40.702 09:53:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:40.702 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:40.702 --rc genhtml_branch_coverage=1 00:29:40.702 --rc genhtml_function_coverage=1 00:29:40.702 --rc genhtml_legend=1 00:29:40.702 --rc geninfo_all_blocks=1 00:29:40.702 --rc geninfo_unexecuted_blocks=1 00:29:40.702 00:29:40.702 ' 00:29:40.702 09:53:03 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:40.702 09:53:03 -- nvmf/common.sh@7 -- # uname -s 00:29:40.702 09:53:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:40.702 09:53:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:40.702 09:53:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:40.702 09:53:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:40.702 09:53:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:40.702 09:53:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:40.702 09:53:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:40.702 09:53:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:40.702 09:53:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:40.702 09:53:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:40.702 09:53:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:40.702 09:53:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:40.702 09:53:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:40.702 09:53:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:40.702 09:53:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:40.702 09:53:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:40.702 09:53:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:40.702 09:53:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:40.702 09:53:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:40.702 09:53:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:40.702 09:53:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:40.702 09:53:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:40.702 09:53:03 -- paths/export.sh@5 -- # export PATH 00:29:40.702 09:53:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:40.702 09:53:03 -- nvmf/common.sh@46 -- # : 0 00:29:40.702 09:53:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:40.702 09:53:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:40.702 09:53:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:40.702 09:53:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:40.702 09:53:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:40.702 09:53:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:40.702 09:53:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:40.702 09:53:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:40.702 09:53:03 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:40.702 09:53:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:40.702 09:53:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:40.702 09:53:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:40.702 09:53:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:40.702 09:53:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:40.702 09:53:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:40.702 09:53:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:40.702 09:53:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:40.702 09:53:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:40.703 09:53:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:40.703 09:53:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:40.703 09:53:03 -- common/autotest_common.sh@10 -- # set +x 00:29:42.611 09:53:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:42.611 09:53:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:42.611 09:53:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:42.611 09:53:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:42.611 09:53:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:42.611 09:53:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:42.611 09:53:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:42.611 09:53:05 -- nvmf/common.sh@294 -- # net_devs=() 00:29:42.611 09:53:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:42.611 09:53:05 -- nvmf/common.sh@295 -- # e810=() 00:29:42.611 09:53:05 -- nvmf/common.sh@295 -- # local -ga e810 00:29:42.611 09:53:05 -- nvmf/common.sh@296 -- # x722=() 00:29:42.611 09:53:05 -- nvmf/common.sh@296 -- # local -ga x722 00:29:42.611 09:53:05 -- nvmf/common.sh@297 -- # mlx=() 00:29:42.611 09:53:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:42.611 09:53:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:42.611 09:53:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:42.611 09:53:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:42.611 09:53:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:42.611 09:53:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:42.611 09:53:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:42.611 09:53:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:42.611 09:53:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:42.611 09:53:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:42.611 09:53:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:42.611 09:53:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:42.611 09:53:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:42.611 09:53:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:42.611 09:53:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:42.611 09:53:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:42.611 09:53:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:42.611 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:42.611 09:53:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:42.611 09:53:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:42.611 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:42.611 09:53:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:42.611 09:53:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:42.611 09:53:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:42.611 09:53:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:42.611 09:53:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:42.611 09:53:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:42.611 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:42.611 09:53:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:42.611 09:53:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:42.611 09:53:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:42.611 09:53:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:42.611 09:53:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:42.611 09:53:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:42.611 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:42.611 09:53:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:42.611 09:53:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:42.611 09:53:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:42.611 09:53:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:42.611 09:53:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:42.611 09:53:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:42.611 09:53:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:42.611 09:53:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:42.611 09:53:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:42.611 09:53:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:42.611 09:53:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:42.611 09:53:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:42.611 09:53:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:42.611 09:53:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:42.611 09:53:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:42.611 09:53:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:42.611 09:53:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:42.611 09:53:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:42.611 09:53:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:42.611 09:53:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:42.611 09:53:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:42.611 09:53:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:42.611 09:53:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:42.611 09:53:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:42.611 09:53:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:42.612 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:42.612 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.166 ms 00:29:42.612 00:29:42.612 --- 10.0.0.2 ping statistics --- 00:29:42.612 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:42.612 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:29:42.612 09:53:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:42.612 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:42.612 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:29:42.612 00:29:42.612 --- 10.0.0.1 ping statistics --- 00:29:42.612 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:42.612 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:29:42.612 09:53:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:42.612 09:53:05 -- nvmf/common.sh@410 -- # return 0 00:29:42.612 09:53:05 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:42.612 09:53:05 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:43.995 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:43.995 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:43.995 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:43.995 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:43.995 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:43.995 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:43.995 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:43.995 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:43.995 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:43.995 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:43.995 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:43.995 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:43.995 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:43.995 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:43.995 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:43.995 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:44.936 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:44.936 09:53:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:44.936 09:53:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:44.936 09:53:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:44.936 09:53:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:44.936 09:53:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:44.936 09:53:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:44.936 09:53:07 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:44.936 09:53:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:44.936 09:53:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:44.936 09:53:07 -- common/autotest_common.sh@10 -- # set +x 00:29:44.936 09:53:07 -- nvmf/common.sh@469 -- # nvmfpid=170458 00:29:44.936 09:53:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:44.936 09:53:07 -- nvmf/common.sh@470 -- # waitforlisten 170458 00:29:44.936 09:53:07 -- common/autotest_common.sh@829 -- # '[' -z 170458 ']' 00:29:44.936 09:53:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:44.936 09:53:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:44.936 09:53:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:44.936 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:44.936 09:53:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:44.936 09:53:07 -- common/autotest_common.sh@10 -- # set +x 00:29:44.936 [2024-11-29 09:53:07.720013] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:44.936 [2024-11-29 09:53:07.720082] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:44.936 EAL: No free 2048 kB hugepages reported on node 1 00:29:45.197 [2024-11-29 09:53:07.783289] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:45.197 [2024-11-29 09:53:07.892439] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:45.197 [2024-11-29 09:53:07.892588] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:45.197 [2024-11-29 09:53:07.892605] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:45.197 [2024-11-29 09:53:07.892617] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:45.197 [2024-11-29 09:53:07.892666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:45.197 [2024-11-29 09:53:07.892733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:45.197 [2024-11-29 09:53:07.892800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:45.197 [2024-11-29 09:53:07.892803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:46.136 09:53:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:46.136 09:53:08 -- common/autotest_common.sh@862 -- # return 0 00:29:46.136 09:53:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:46.136 09:53:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:46.136 09:53:08 -- common/autotest_common.sh@10 -- # set +x 00:29:46.136 09:53:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:46.136 09:53:08 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:46.136 09:53:08 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:46.136 09:53:08 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:46.136 09:53:08 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:46.136 09:53:08 -- scripts/common.sh@312 -- # local nvmes 00:29:46.136 09:53:08 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:46.136 09:53:08 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:46.136 09:53:08 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:46.136 09:53:08 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:46.136 09:53:08 -- scripts/common.sh@322 -- # uname -s 00:29:46.136 09:53:08 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:46.136 09:53:08 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:46.136 09:53:08 -- scripts/common.sh@327 -- # (( 1 )) 00:29:46.136 09:53:08 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:46.136 09:53:08 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:46.136 09:53:08 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:46.136 09:53:08 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:46.136 09:53:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:46.136 09:53:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:46.136 09:53:08 -- common/autotest_common.sh@10 -- # set +x 00:29:46.136 ************************************ 00:29:46.136 START TEST spdk_target_abort 00:29:46.136 ************************************ 00:29:46.136 09:53:08 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:46.136 09:53:08 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:46.136 09:53:08 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:46.136 09:53:08 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:46.136 09:53:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.136 09:53:08 -- common/autotest_common.sh@10 -- # set +x 00:29:49.424 spdk_targetn1 00:29:49.424 09:53:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:49.424 09:53:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.424 09:53:11 -- common/autotest_common.sh@10 -- # set +x 00:29:49.424 [2024-11-29 09:53:11.551829] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:49.424 09:53:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:49.424 09:53:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.424 09:53:11 -- common/autotest_common.sh@10 -- # set +x 00:29:49.424 09:53:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:49.424 09:53:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.424 09:53:11 -- common/autotest_common.sh@10 -- # set +x 00:29:49.424 09:53:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:49.424 09:53:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.424 09:53:11 -- common/autotest_common.sh@10 -- # set +x 00:29:49.424 [2024-11-29 09:53:11.584071] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:49.424 09:53:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:49.424 09:53:11 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:49.425 EAL: No free 2048 kB hugepages reported on node 1 00:29:51.959 Initializing NVMe Controllers 00:29:51.959 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:51.959 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:51.959 Initialization complete. Launching workers. 00:29:51.959 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12907, failed: 0 00:29:51.959 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1176, failed to submit 11731 00:29:51.959 success 758, unsuccess 418, failed 0 00:29:51.959 09:53:14 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:51.959 09:53:14 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:51.959 EAL: No free 2048 kB hugepages reported on node 1 00:29:56.148 Initializing NVMe Controllers 00:29:56.148 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:56.148 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:56.148 Initialization complete. Launching workers. 00:29:56.148 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8638, failed: 0 00:29:56.148 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1190, failed to submit 7448 00:29:56.148 success 371, unsuccess 819, failed 0 00:29:56.148 09:53:18 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:56.148 09:53:18 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:56.148 EAL: No free 2048 kB hugepages reported on node 1 00:29:58.683 Initializing NVMe Controllers 00:29:58.683 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:58.683 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:58.683 Initialization complete. Launching workers. 00:29:58.683 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32357, failed: 0 00:29:58.683 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2799, failed to submit 29558 00:29:58.683 success 577, unsuccess 2222, failed 0 00:29:58.683 09:53:21 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:29:58.683 09:53:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:58.683 09:53:21 -- common/autotest_common.sh@10 -- # set +x 00:29:58.683 09:53:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:58.683 09:53:21 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:29:58.683 09:53:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:58.683 09:53:21 -- common/autotest_common.sh@10 -- # set +x 00:30:00.062 09:53:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.062 09:53:22 -- target/abort_qd_sizes.sh@62 -- # killprocess 170458 00:30:00.062 09:53:22 -- common/autotest_common.sh@936 -- # '[' -z 170458 ']' 00:30:00.062 09:53:22 -- common/autotest_common.sh@940 -- # kill -0 170458 00:30:00.062 09:53:22 -- common/autotest_common.sh@941 -- # uname 00:30:00.062 09:53:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:00.062 09:53:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 170458 00:30:00.062 09:53:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:00.062 09:53:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:00.062 09:53:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 170458' 00:30:00.062 killing process with pid 170458 00:30:00.062 09:53:22 -- common/autotest_common.sh@955 -- # kill 170458 00:30:00.062 09:53:22 -- common/autotest_common.sh@960 -- # wait 170458 00:30:00.320 00:30:00.320 real 0m14.319s 00:30:00.320 user 0m56.612s 00:30:00.320 sys 0m2.547s 00:30:00.320 09:53:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:00.320 09:53:23 -- common/autotest_common.sh@10 -- # set +x 00:30:00.320 ************************************ 00:30:00.320 END TEST spdk_target_abort 00:30:00.320 ************************************ 00:30:00.320 09:53:23 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:30:00.320 09:53:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:00.320 09:53:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:00.320 09:53:23 -- common/autotest_common.sh@10 -- # set +x 00:30:00.320 ************************************ 00:30:00.320 START TEST kernel_target_abort 00:30:00.320 ************************************ 00:30:00.320 09:53:23 -- common/autotest_common.sh@1114 -- # kernel_target 00:30:00.320 09:53:23 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:30:00.320 09:53:23 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:30:00.320 09:53:23 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:30:00.320 09:53:23 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:30:00.320 09:53:23 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:30:00.320 09:53:23 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:00.320 09:53:23 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:30:00.320 09:53:23 -- nvmf/common.sh@627 -- # local block nvme 00:30:00.320 09:53:23 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:30:00.320 09:53:23 -- nvmf/common.sh@630 -- # modprobe nvmet 00:30:00.320 09:53:23 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:30:00.320 09:53:23 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:01.697 Waiting for block devices as requested 00:30:01.697 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:30:01.697 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:01.697 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:01.697 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:01.954 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:01.955 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:01.955 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:01.955 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:01.955 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:02.213 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:02.213 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:02.213 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:02.213 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:02.472 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:02.472 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:02.472 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:02.472 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:02.729 09:53:25 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:02.729 09:53:25 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:02.729 09:53:25 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:02.729 09:53:25 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:02.729 09:53:25 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:02.729 No valid GPT data, bailing 00:30:02.729 09:53:25 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:02.729 09:53:25 -- scripts/common.sh@393 -- # pt= 00:30:02.729 09:53:25 -- scripts/common.sh@394 -- # return 1 00:30:02.729 09:53:25 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:02.729 09:53:25 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:02.729 09:53:25 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:02.729 09:53:25 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:02.729 09:53:25 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:02.729 09:53:25 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:02.729 09:53:25 -- nvmf/common.sh@654 -- # echo 1 00:30:02.729 09:53:25 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:02.730 09:53:25 -- nvmf/common.sh@656 -- # echo 1 00:30:02.730 09:53:25 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:02.730 09:53:25 -- nvmf/common.sh@663 -- # echo tcp 00:30:02.730 09:53:25 -- nvmf/common.sh@664 -- # echo 4420 00:30:02.730 09:53:25 -- nvmf/common.sh@665 -- # echo ipv4 00:30:02.730 09:53:25 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:02.730 09:53:25 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:02.730 00:30:02.730 Discovery Log Number of Records 2, Generation counter 2 00:30:02.730 =====Discovery Log Entry 0====== 00:30:02.730 trtype: tcp 00:30:02.730 adrfam: ipv4 00:30:02.730 subtype: current discovery subsystem 00:30:02.730 treq: not specified, sq flow control disable supported 00:30:02.730 portid: 1 00:30:02.730 trsvcid: 4420 00:30:02.730 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:02.730 traddr: 10.0.0.1 00:30:02.730 eflags: none 00:30:02.730 sectype: none 00:30:02.730 =====Discovery Log Entry 1====== 00:30:02.730 trtype: tcp 00:30:02.730 adrfam: ipv4 00:30:02.730 subtype: nvme subsystem 00:30:02.730 treq: not specified, sq flow control disable supported 00:30:02.730 portid: 1 00:30:02.730 trsvcid: 4420 00:30:02.730 subnqn: kernel_target 00:30:02.730 traddr: 10.0.0.1 00:30:02.730 eflags: none 00:30:02.730 sectype: none 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:02.730 09:53:25 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:02.730 EAL: No free 2048 kB hugepages reported on node 1 00:30:06.017 Initializing NVMe Controllers 00:30:06.017 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:06.017 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:06.017 Initialization complete. Launching workers. 00:30:06.017 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 42662, failed: 0 00:30:06.017 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 42662, failed to submit 0 00:30:06.017 success 0, unsuccess 42662, failed 0 00:30:06.017 09:53:28 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:06.017 09:53:28 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:06.017 EAL: No free 2048 kB hugepages reported on node 1 00:30:09.310 Initializing NVMe Controllers 00:30:09.310 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:09.310 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:09.310 Initialization complete. Launching workers. 00:30:09.310 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 79659, failed: 0 00:30:09.310 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20062, failed to submit 59597 00:30:09.310 success 0, unsuccess 20062, failed 0 00:30:09.310 09:53:31 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:09.310 09:53:31 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:09.310 EAL: No free 2048 kB hugepages reported on node 1 00:30:12.601 Initializing NVMe Controllers 00:30:12.601 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:12.601 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:12.601 Initialization complete. Launching workers. 00:30:12.601 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 79545, failed: 0 00:30:12.601 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19846, failed to submit 59699 00:30:12.601 success 0, unsuccess 19846, failed 0 00:30:12.601 09:53:34 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:12.601 09:53:34 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:12.601 09:53:34 -- nvmf/common.sh@677 -- # echo 0 00:30:12.601 09:53:34 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:12.601 09:53:34 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:12.601 09:53:34 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:12.601 09:53:34 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:12.601 09:53:34 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:12.601 09:53:34 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:12.601 00:30:12.601 real 0m11.878s 00:30:12.601 user 0m5.632s 00:30:12.601 sys 0m2.407s 00:30:12.601 09:53:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:12.601 09:53:34 -- common/autotest_common.sh@10 -- # set +x 00:30:12.601 ************************************ 00:30:12.601 END TEST kernel_target_abort 00:30:12.601 ************************************ 00:30:12.602 09:53:34 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:12.602 09:53:34 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:12.602 09:53:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:12.602 09:53:34 -- nvmf/common.sh@116 -- # sync 00:30:12.602 09:53:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:12.602 09:53:34 -- nvmf/common.sh@119 -- # set +e 00:30:12.602 09:53:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:12.602 09:53:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:12.602 rmmod nvme_tcp 00:30:12.602 rmmod nvme_fabrics 00:30:12.602 rmmod nvme_keyring 00:30:12.602 09:53:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:12.602 09:53:35 -- nvmf/common.sh@123 -- # set -e 00:30:12.602 09:53:35 -- nvmf/common.sh@124 -- # return 0 00:30:12.602 09:53:35 -- nvmf/common.sh@477 -- # '[' -n 170458 ']' 00:30:12.602 09:53:35 -- nvmf/common.sh@478 -- # killprocess 170458 00:30:12.602 09:53:35 -- common/autotest_common.sh@936 -- # '[' -z 170458 ']' 00:30:12.602 09:53:35 -- common/autotest_common.sh@940 -- # kill -0 170458 00:30:12.602 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (170458) - No such process 00:30:12.602 09:53:35 -- common/autotest_common.sh@963 -- # echo 'Process with pid 170458 is not found' 00:30:12.602 Process with pid 170458 is not found 00:30:12.602 09:53:35 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:12.602 09:53:35 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:13.539 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:13.539 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:13.539 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:13.539 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:13.539 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:13.539 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:13.539 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:13.539 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:13.539 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:13.539 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:13.539 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:13.539 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:13.539 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:13.539 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:13.539 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:13.539 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:13.539 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:13.798 09:53:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:13.798 09:53:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:13.798 09:53:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:13.798 09:53:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:13.798 09:53:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:13.798 09:53:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:13.798 09:53:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:15.702 09:53:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:15.702 00:30:15.702 real 0m35.207s 00:30:15.702 user 1m4.586s 00:30:15.702 sys 0m8.242s 00:30:15.702 09:53:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:15.702 09:53:38 -- common/autotest_common.sh@10 -- # set +x 00:30:15.702 ************************************ 00:30:15.702 END TEST nvmf_abort_qd_sizes 00:30:15.702 ************************************ 00:30:15.702 09:53:38 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:30:15.702 09:53:38 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:30:15.702 09:53:38 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:15.702 09:53:38 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:15.702 09:53:38 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:30:15.702 09:53:38 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:30:15.702 09:53:38 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:30:15.702 09:53:38 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:15.702 09:53:38 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:15.702 09:53:38 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:15.702 09:53:38 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:15.702 09:53:38 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:30:15.702 09:53:38 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:30:15.702 09:53:38 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:15.702 09:53:38 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:15.702 09:53:38 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:30:15.702 09:53:38 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:30:15.702 09:53:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:15.702 09:53:38 -- common/autotest_common.sh@10 -- # set +x 00:30:15.702 09:53:38 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:30:15.702 09:53:38 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:30:15.702 09:53:38 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:30:15.702 09:53:38 -- common/autotest_common.sh@10 -- # set +x 00:30:17.607 INFO: APP EXITING 00:30:17.607 INFO: killing all VMs 00:30:17.607 INFO: killing vhost app 00:30:17.607 INFO: EXIT DONE 00:30:18.556 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:18.556 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:18.556 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:18.556 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:18.556 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:18.556 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:18.556 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:18.556 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:18.556 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:18.556 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:18.556 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:18.556 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:18.556 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:18.900 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:18.900 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:18.900 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:18.900 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:20.279 Cleaning 00:30:20.279 Removing: /var/run/dpdk/spdk0/config 00:30:20.279 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:20.279 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:20.279 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:20.279 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:20.279 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:20.279 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:20.279 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:20.279 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:20.279 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:20.279 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:20.279 Removing: /var/run/dpdk/spdk1/config 00:30:20.279 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:20.279 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:20.279 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:20.279 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:20.279 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:20.279 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:20.279 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:20.279 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:20.279 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:20.279 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:20.279 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:20.279 Removing: /var/run/dpdk/spdk2/config 00:30:20.279 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:20.279 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:20.279 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:20.279 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:20.279 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:20.279 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:20.279 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:20.279 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:20.279 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:20.279 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:20.279 Removing: /var/run/dpdk/spdk3/config 00:30:20.279 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:20.279 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:20.279 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:20.279 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:20.279 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:20.279 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:20.279 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:20.279 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:20.279 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:20.279 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:20.279 Removing: /var/run/dpdk/spdk4/config 00:30:20.279 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:20.279 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:20.279 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:20.279 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:20.279 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:20.279 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:20.279 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:20.279 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:20.279 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:20.279 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:20.279 Removing: /dev/shm/bdev_svc_trace.1 00:30:20.279 Removing: /dev/shm/nvmf_trace.0 00:30:20.279 Removing: /dev/shm/spdk_tgt_trace.pid4095431 00:30:20.279 Removing: /var/run/dpdk/spdk0 00:30:20.279 Removing: /var/run/dpdk/spdk1 00:30:20.279 Removing: /var/run/dpdk/spdk2 00:30:20.279 Removing: /var/run/dpdk/spdk3 00:30:20.279 Removing: /var/run/dpdk/spdk4 00:30:20.279 Removing: /var/run/dpdk/spdk_pid103179 00:30:20.279 Removing: /var/run/dpdk/spdk_pid103193 00:30:20.279 Removing: /var/run/dpdk/spdk_pid106137 00:30:20.279 Removing: /var/run/dpdk/spdk_pid106346 00:30:20.279 Removing: /var/run/dpdk/spdk_pid106540 00:30:20.279 Removing: /var/run/dpdk/spdk_pid106810 00:30:20.279 Removing: /var/run/dpdk/spdk_pid106821 00:30:20.279 Removing: /var/run/dpdk/spdk_pid108062 00:30:20.279 Removing: /var/run/dpdk/spdk_pid109277 00:30:20.279 Removing: /var/run/dpdk/spdk_pid110491 00:30:20.279 Removing: /var/run/dpdk/spdk_pid111708 00:30:20.279 Removing: /var/run/dpdk/spdk_pid112923 00:30:20.279 Removing: /var/run/dpdk/spdk_pid114146 00:30:20.279 Removing: /var/run/dpdk/spdk_pid11556 00:30:20.279 Removing: /var/run/dpdk/spdk_pid118786 00:30:20.279 Removing: /var/run/dpdk/spdk_pid119132 00:30:20.279 Removing: /var/run/dpdk/spdk_pid120450 00:30:20.279 Removing: /var/run/dpdk/spdk_pid121211 00:30:20.279 Removing: /var/run/dpdk/spdk_pid125112 00:30:20.279 Removing: /var/run/dpdk/spdk_pid127177 00:30:20.279 Removing: /var/run/dpdk/spdk_pid130795 00:30:20.279 Removing: /var/run/dpdk/spdk_pid134553 00:30:20.279 Removing: /var/run/dpdk/spdk_pid138113 00:30:20.279 Removing: /var/run/dpdk/spdk_pid138648 00:30:20.279 Removing: /var/run/dpdk/spdk_pid139078 00:30:20.279 Removing: /var/run/dpdk/spdk_pid139500 00:30:20.279 Removing: /var/run/dpdk/spdk_pid140089 00:30:20.279 Removing: /var/run/dpdk/spdk_pid140647 00:30:20.279 Removing: /var/run/dpdk/spdk_pid141193 00:30:20.279 Removing: /var/run/dpdk/spdk_pid141744 00:30:20.279 Removing: /var/run/dpdk/spdk_pid144418 00:30:20.279 Removing: /var/run/dpdk/spdk_pid144572 00:30:20.279 Removing: /var/run/dpdk/spdk_pid148551 00:30:20.279 Removing: /var/run/dpdk/spdk_pid148819 00:30:20.279 Removing: /var/run/dpdk/spdk_pid151013 00:30:20.279 Removing: /var/run/dpdk/spdk_pid156179 00:30:20.279 Removing: /var/run/dpdk/spdk_pid156184 00:30:20.279 Removing: /var/run/dpdk/spdk_pid159261 00:30:20.279 Removing: /var/run/dpdk/spdk_pid160703 00:30:20.279 Removing: /var/run/dpdk/spdk_pid162136 00:30:20.279 Removing: /var/run/dpdk/spdk_pid162986 00:30:20.279 Removing: /var/run/dpdk/spdk_pid164468 00:30:20.279 Removing: /var/run/dpdk/spdk_pid165338 00:30:20.279 Removing: /var/run/dpdk/spdk_pid170907 00:30:20.279 Removing: /var/run/dpdk/spdk_pid171313 00:30:20.279 Removing: /var/run/dpdk/spdk_pid171718 00:30:20.279 Removing: /var/run/dpdk/spdk_pid173191 00:30:20.279 Removing: /var/run/dpdk/spdk_pid173603 00:30:20.279 Removing: /var/run/dpdk/spdk_pid174012 00:30:20.279 Removing: /var/run/dpdk/spdk_pid18309 00:30:20.279 Removing: /var/run/dpdk/spdk_pid24356 00:30:20.279 Removing: /var/run/dpdk/spdk_pid2465 00:30:20.279 Removing: /var/run/dpdk/spdk_pid25664 00:30:20.279 Removing: /var/run/dpdk/spdk_pid26395 00:30:20.279 Removing: /var/run/dpdk/spdk_pid2815 00:30:20.279 Removing: /var/run/dpdk/spdk_pid36901 00:30:20.279 Removing: /var/run/dpdk/spdk_pid39278 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4093717 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4094516 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4095431 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4095934 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4097280 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4098230 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4098556 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4098889 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4099108 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4099440 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4099599 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4099753 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4100077 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4100552 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4103181 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4103414 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4103706 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4103846 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4104165 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4104302 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4104743 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4104884 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4105055 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4105199 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4105363 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4105505 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4105890 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4106126 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4106376 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4106550 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4106702 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4106755 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4107006 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4107183 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4107329 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4107499 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4107758 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4107913 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4108059 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4108341 00:30:20.279 Removing: /var/run/dpdk/spdk_pid4108482 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4108640 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4108906 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4109068 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4109206 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4109494 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4109634 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4109795 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4110054 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4110223 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4110361 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4110641 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4110788 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4110950 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4111149 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4111372 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4111519 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4111686 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4111939 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4112107 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4112246 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4112526 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4112669 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4112829 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4113095 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4113258 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4113409 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4113687 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4113835 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4113991 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4114259 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4114420 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4114617 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4114831 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4117067 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4174243 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4176903 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4184765 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4188126 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4190638 00:30:20.539 Removing: /var/run/dpdk/spdk_pid4191048 00:30:20.539 Removing: /var/run/dpdk/spdk_pid42117 00:30:20.539 Removing: /var/run/dpdk/spdk_pid43330 00:30:20.539 Removing: /var/run/dpdk/spdk_pid44699 00:30:20.539 Removing: /var/run/dpdk/spdk_pid44973 00:30:20.539 Removing: /var/run/dpdk/spdk_pid45127 00:30:20.539 Removing: /var/run/dpdk/spdk_pid45397 00:30:20.539 Removing: /var/run/dpdk/spdk_pid45994 00:30:20.539 Removing: /var/run/dpdk/spdk_pid47361 00:30:20.539 Removing: /var/run/dpdk/spdk_pid48388 00:30:20.539 Removing: /var/run/dpdk/spdk_pid48836 00:30:20.539 Removing: /var/run/dpdk/spdk_pid52472 00:30:20.539 Removing: /var/run/dpdk/spdk_pid5506 00:30:20.539 Removing: /var/run/dpdk/spdk_pid56365 00:30:20.539 Removing: /var/run/dpdk/spdk_pid60205 00:30:20.539 Removing: /var/run/dpdk/spdk_pid84124 00:30:20.539 Removing: /var/run/dpdk/spdk_pid87479 00:30:20.539 Removing: /var/run/dpdk/spdk_pid91315 00:30:20.539 Removing: /var/run/dpdk/spdk_pid92418 00:30:20.539 Removing: /var/run/dpdk/spdk_pid9325 00:30:20.539 Removing: /var/run/dpdk/spdk_pid93544 00:30:20.539 Removing: /var/run/dpdk/spdk_pid96253 00:30:20.539 Removing: /var/run/dpdk/spdk_pid98779 00:30:20.539 Clean 00:30:20.539 killing process with pid 4065433 00:30:28.666 killing process with pid 4065430 00:30:28.666 killing process with pid 4065432 00:30:28.926 killing process with pid 4065431 00:30:28.926 09:53:51 -- common/autotest_common.sh@1446 -- # return 0 00:30:28.926 09:53:51 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:28.926 09:53:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:28.926 09:53:51 -- common/autotest_common.sh@10 -- # set +x 00:30:28.926 09:53:51 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:28.926 09:53:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:28.926 09:53:51 -- common/autotest_common.sh@10 -- # set +x 00:30:28.926 09:53:51 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:28.926 09:53:51 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:28.926 09:53:51 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:28.926 09:53:51 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:28.926 09:53:51 -- spdk/autotest.sh@383 -- # hostname 00:30:28.926 09:53:51 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:29.186 geninfo: WARNING: invalid characters removed from testname! 00:30:55.756 09:54:18 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:59.959 09:54:21 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:01.870 09:54:24 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:04.408 09:54:27 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:06.951 09:54:29 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:10.250 09:54:32 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:12.794 09:54:35 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:12.794 09:54:35 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:31:12.794 09:54:35 -- common/autotest_common.sh@1690 -- $ lcov --version 00:31:12.794 09:54:35 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:31:12.794 09:54:35 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:31:12.794 09:54:35 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:31:12.794 09:54:35 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:31:12.794 09:54:35 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:31:12.794 09:54:35 -- scripts/common.sh@335 -- $ IFS=.-: 00:31:12.794 09:54:35 -- scripts/common.sh@335 -- $ read -ra ver1 00:31:12.794 09:54:35 -- scripts/common.sh@336 -- $ IFS=.-: 00:31:12.794 09:54:35 -- scripts/common.sh@336 -- $ read -ra ver2 00:31:12.794 09:54:35 -- scripts/common.sh@337 -- $ local 'op=<' 00:31:12.794 09:54:35 -- scripts/common.sh@339 -- $ ver1_l=2 00:31:12.794 09:54:35 -- scripts/common.sh@340 -- $ ver2_l=1 00:31:12.794 09:54:35 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:31:12.794 09:54:35 -- scripts/common.sh@343 -- $ case "$op" in 00:31:12.794 09:54:35 -- scripts/common.sh@344 -- $ : 1 00:31:12.794 09:54:35 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:31:12.794 09:54:35 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:12.794 09:54:35 -- scripts/common.sh@364 -- $ decimal 1 00:31:12.794 09:54:35 -- scripts/common.sh@352 -- $ local d=1 00:31:12.794 09:54:35 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:31:12.794 09:54:35 -- scripts/common.sh@354 -- $ echo 1 00:31:12.794 09:54:35 -- scripts/common.sh@364 -- $ ver1[v]=1 00:31:12.794 09:54:35 -- scripts/common.sh@365 -- $ decimal 2 00:31:12.794 09:54:35 -- scripts/common.sh@352 -- $ local d=2 00:31:12.794 09:54:35 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:31:12.794 09:54:35 -- scripts/common.sh@354 -- $ echo 2 00:31:12.794 09:54:35 -- scripts/common.sh@365 -- $ ver2[v]=2 00:31:12.794 09:54:35 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:31:12.794 09:54:35 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:31:12.794 09:54:35 -- scripts/common.sh@367 -- $ return 0 00:31:12.794 09:54:35 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:12.794 09:54:35 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:31:12.794 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:12.794 --rc genhtml_branch_coverage=1 00:31:12.794 --rc genhtml_function_coverage=1 00:31:12.794 --rc genhtml_legend=1 00:31:12.794 --rc geninfo_all_blocks=1 00:31:12.794 --rc geninfo_unexecuted_blocks=1 00:31:12.794 00:31:12.794 ' 00:31:12.794 09:54:35 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:31:12.794 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:12.794 --rc genhtml_branch_coverage=1 00:31:12.794 --rc genhtml_function_coverage=1 00:31:12.794 --rc genhtml_legend=1 00:31:12.794 --rc geninfo_all_blocks=1 00:31:12.794 --rc geninfo_unexecuted_blocks=1 00:31:12.794 00:31:12.794 ' 00:31:12.794 09:54:35 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:31:12.794 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:12.794 --rc genhtml_branch_coverage=1 00:31:12.794 --rc genhtml_function_coverage=1 00:31:12.794 --rc genhtml_legend=1 00:31:12.794 --rc geninfo_all_blocks=1 00:31:12.794 --rc geninfo_unexecuted_blocks=1 00:31:12.794 00:31:12.794 ' 00:31:12.794 09:54:35 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:31:12.794 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:12.794 --rc genhtml_branch_coverage=1 00:31:12.794 --rc genhtml_function_coverage=1 00:31:12.794 --rc genhtml_legend=1 00:31:12.794 --rc geninfo_all_blocks=1 00:31:12.794 --rc geninfo_unexecuted_blocks=1 00:31:12.794 00:31:12.794 ' 00:31:12.794 09:54:35 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:12.794 09:54:35 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:12.794 09:54:35 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:12.794 09:54:35 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:12.794 09:54:35 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.794 09:54:35 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.795 09:54:35 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.795 09:54:35 -- paths/export.sh@5 -- $ export PATH 00:31:12.795 09:54:35 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.795 09:54:35 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:12.795 09:54:35 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:12.795 09:54:35 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732870475.XXXXXX 00:31:12.795 09:54:35 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732870475.9kFY0p 00:31:12.795 09:54:35 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:12.795 09:54:35 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:12.795 09:54:35 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:12.795 09:54:35 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:12.795 09:54:35 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:12.795 09:54:35 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:12.795 09:54:35 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:31:12.795 09:54:35 -- common/autotest_common.sh@10 -- $ set +x 00:31:12.795 09:54:35 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:12.795 09:54:35 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:12.795 09:54:35 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:12.795 09:54:35 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:12.795 09:54:35 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:12.795 09:54:35 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:12.795 09:54:35 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:12.795 09:54:35 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:12.795 09:54:35 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:12.795 09:54:35 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:12.795 09:54:35 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:12.795 + [[ -n 4023126 ]] 00:31:12.795 + sudo kill 4023126 00:31:12.806 [Pipeline] } 00:31:12.818 [Pipeline] // stage 00:31:12.823 [Pipeline] } 00:31:12.834 [Pipeline] // timeout 00:31:12.839 [Pipeline] } 00:31:12.850 [Pipeline] // catchError 00:31:12.856 [Pipeline] } 00:31:12.871 [Pipeline] // wrap 00:31:12.877 [Pipeline] } 00:31:12.890 [Pipeline] // catchError 00:31:12.900 [Pipeline] stage 00:31:12.902 [Pipeline] { (Epilogue) 00:31:12.916 [Pipeline] catchError 00:31:12.918 [Pipeline] { 00:31:12.934 [Pipeline] echo 00:31:12.937 Cleanup processes 00:31:12.944 [Pipeline] sh 00:31:13.251 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:13.251 186606 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:13.266 [Pipeline] sh 00:31:13.553 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:13.553 ++ grep -v 'sudo pgrep' 00:31:13.553 ++ awk '{print $1}' 00:31:13.553 + sudo kill -9 00:31:13.553 + true 00:31:13.567 [Pipeline] sh 00:31:13.855 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:23.837 [Pipeline] sh 00:31:24.168 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:24.168 Artifacts sizes are good 00:31:24.211 [Pipeline] archiveArtifacts 00:31:24.223 Archiving artifacts 00:31:24.380 [Pipeline] sh 00:31:24.656 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:24.670 [Pipeline] cleanWs 00:31:24.677 [WS-CLEANUP] Deleting project workspace... 00:31:24.677 [WS-CLEANUP] Deferred wipeout is used... 00:31:24.682 [WS-CLEANUP] done 00:31:24.684 [Pipeline] } 00:31:24.697 [Pipeline] // catchError 00:31:24.707 [Pipeline] sh 00:31:24.988 + logger -p user.info -t JENKINS-CI 00:31:24.994 [Pipeline] } 00:31:25.006 [Pipeline] // stage 00:31:25.009 [Pipeline] } 00:31:25.020 [Pipeline] // node 00:31:25.024 [Pipeline] End of Pipeline 00:31:25.174 Finished: SUCCESS